404checker
404enemy
80legs
ADmantX
ASPSeek
Aboundexbot
Alligator
Anarchie
Anthill
Aspiegel
Asterias
Attach
BDCbot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Blow
BlowFish
Brandprotect
Buck
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Chlooe
Cloud mapping
Cogentbot
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
Crescent
Custo
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Dirbuster
DomCopBot
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
EasyDL
EirGrabber
Exabot
Express WebPictures
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
GrabNet
Grabber
Grafula
GrapeFX
GridBot
HMView
HTMLparser
Haansoft
Havij
Heritrix
HybridBot
IDBot
IRLbot
Iblog
Id-search
Image Fetch
IndeedBot
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
Jorgee
LWP::Simple
Lanshanbot
Lftp
Libwhisker
LinkScan
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MQQBrowser
MSFrontPage
Majestic-SEO
MarkMonitor
Masscan
Mediatoolkitbot
Metauri
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Name Intelligence
Nameprotect
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
NextGenSearchBot
Niki-bot
Nuclei
Offline Explorer
OnCrawl
OpenVAS
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Panscient
Papa Foto
PeoplePal
Pi-Monster
Picsearch
Pixray
Pockey
Psbot
QueryN Metasearch
RSSingBot
RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re
RebelMouse
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOprofiler
ScanAlert
Scanbot
Scrapy
Searchestate
SearchmetricsBot
SentiBot
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteSnagger
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Spammen
SpankBot
Spanner
Spinn3r
Sqworm
Sucker
Sucuri
Surfbot
SurveyBot
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Titan
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TurnitinBot
Twice
Typhoeus
Upflow
V-BOT
VB Project
VCI
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WISENutbot
WWW-Collector-E
WWW-Mechanize
Web Collage
Web Fuck
Web Pix
Web Sauger
WebAuto
WebBandit
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebPix
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whack
Whacker
Whatweb
WiseGuys Robot
Wonderbot
Woobot
YoudaoBot
Zauba
Zermelo
Zitebot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
coccocbot-web
cognitiveseo
demandbase-bot
eCatch
heritrix
instabid
internetVista monitor
isitwp.com
meanpathbot
netEstate NE Crawler
oBot
page scorer
polaris version
ripz
seoscanners
sitechecker.pro
sysscan
tAkeOut
voyagerx.com
webpros.com
xpymep1.exe
zgrab