Smart Cache Loader - Home Page
What is Smart Cache LoaderSmart Cache Loader is most configurable web batch downloader in world! If you have a very specific needs to grab some portions of web site -- this is right tool for you! This program can be also used as web crawler if you need to crawl defined parts of www site(s).
OperationThis program is command line driven. Forget slow GUI and other nice things. If you want GUI downloader, there are other programs. Main power of this program is configuration file. And yes this program has a very nice integration with Smart Cache proxy server.
SupportIf you need help with this program feel free to ask on mailing list.
Latest versions0.31 - released 10-Aug-2007. Fixed bug in localstores, only nullstore worked, send Host: header to server, decode HTML entities before extracting URLs, request gziped pages from server if available.
0.30 - released 8-Aug-2007. Support for extracting URLs from page text using regexp and possible replace, regexp package is used from standard Java runtime library, Loader now depends on JDK1.5.
CVS repository converted to Bazaar and now using standard sf.net provides tools.