Smart Cache Loader - Home Page

What is Smart Cache Loader

Smart Cache Loader is most configurable web batch downloader in world! If you have a very specific needs to grab some portions of web site -- this is right tool for you! This program can be also used as web crawler if you need to crawl defined parts of www site(s).

Operation

This program is command line driven. Forget slow GUI and other nice things. If you want GUI downloader, there are other programs. Main power of this program is configuration file. And yes this program has a very nice integration with Smart Cache proxy server.

Support

If you need help with this program feel free to ask on mailing list.

Latest versions

0.31 - released 10-Aug-2007. Fixed bug in localstores, only nullstore worked, send Host: header to server, decode HTML entities before extracting URLs, request gziped pages from server if available.

0.30 - released 8-Aug-2007. Support for extracting URLs from page text using regexp and possible replace, regexp package is used from standard Java runtime library, Loader now depends on JDK1.5.

Bazaar-NG repository

You can checkout source code with Bazaar-NG VCS. You need bzr version 0.15 or higher.

bzr get http://scloader.sourceforge.net/bazaar-ng/scloader--head/