AdsTxtCrawlerTP
Digincore
Dotbot
Grafula
GrapeshotCrawler
Psbot
Scrapy
Upflow
Web Auto
Web Pix