Smart Cache Loader - Home Page

What is Smart Cache Loader

Smart Cache Loader is most configurable web batch downloader in world! If you have a very specific needs to grab some portions of web site – this is right tool for you! This program can be also used as web crawler if you need to crawl defined parts of www site(s).

Operation

This program is command line driven. Forget slow GUI and other nice things. If you want GUI downloader, there are other programs. Main power of this program is configuration file. And yes this program has a very nice integration with Smart Cache proxy server.

Support

If you need help with this program feel free to ask on mailing list scloader-users.

Latest version

0.32 - released 02-Jun-2010

News

02-Jun-2010: SC Loader 0.32 Fixed value in upd= its in hours. Code updated to Java 5 typesafe collections. Added locking to work better on multi CPU. Support for smart cache cacheinfo version 4 and fixed bugs in smart cache cooperation. Corrected test for object age during update.

10-Aug-2007: SC Loader 0.31 Fixed bug in localstores, only nullstore worked, send Host: header to server, decode HTML entities before extracting URLs, request gziped pages from server if available.

8-Aug-2007: SC Loader 0.30 Support for extracting URLs from page text using regexp and possible replace, regexp package is used from standard Java runtime library, Loader now depends on JDK1.5.