HMView
Harvest
Lftp
LinqiaMetadataDownloaderBot
Msrabot
Sucker
Xenu
crawl.sogou.com
heritrix
ubermetrics-technologies.com