BetaBot
CCBot
MSFrontPage
NimbleCrawler
Octopus
RocketCrawler
Upflow
VCI
WebmasterWorldForumBot
heritrix