JetCar
LinksManager
Nutch
OnCrawl
PHPCrawl
QueryN Metasearch
ScreenerBot
Sitebeam
WebmasterWorldForumBot
crawl.sogou.com