BotALot
Image Sucker
LWP::Simple
NimbleCrawler
Petalbot
ScreenerBot
Siteimprove
WebStripper
backlink-check
scalaj-http