ASPSeek
Image Fetch
Openvas
Pavuk
SeoSiteCheckup
Site Sucker
Sitebeam
SpaceBison
WebFetch
crawler4j