Dirbuster
Flunky
Mata Hari
Pavuk
SEOkicks-Robot
SiteLockSpider
Swiftbot
WWW-Mechanize
arquivo-web-crawler
heritrix