404checker
80legs
Abonti
Aboundexbot
Acunetix
AhrefsBot
AIBOT
AiHitBot
Alexibot
Ankit
Asterias
Attach
BackDoorBot
Backlink-Ceck
BackStreet
Badass
Bandit
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
BetaBot
Bigfoot
Black Hole
BLEXBot
Boardreader
BuiltBotTough
BunnySlippers
CATExplorador
CazoodleBot
CheeseBot
CheTeam
ChinaClaw
Chlooe
Claritybot
Cloud mapping
coccocbot-web
cognitiveseo
Collector
CopyRightCheck
Cosmos
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
DatabaseDriverMysqli
DataCha0s
Deusu
Dirbuster
DnyzBot
EirGrabber
EMail Siphon
EMail Wolf
Evil
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
facebookscraper
FHscan
GalaxyBot
Genieo
Getintent
GetRight
GetWeb
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Havij
Heritrix
HMView
HTTrack
Iblog
IDBot
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
IRLbot
JamesBOT
Jetty
JikeSpider
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
Linkdexbot
LinkpadBot
LinkWalker
Lipperhey
Lmspider
Ltx71
Magnet
Majestic12
Mata Hari
MauiBot
MeanPath Bot
Microsoft Data Access
MIDown tool
MJ12bot
Morfeus Fucking Scanner
MQQBrowser
MSIECrawler
Musobot
Name Intelligence
Nameprotect
Needle
NetAnts
Nettrack
NetZIP
NimbleCrawler
Nimbostratus
Offline Explorer
Openfind
Openvas
OpenVAS
OutclicksBot
OutfoxBot
Pavuk
PECL::HTTP
PeoplePal
Picscout
Pockey
POE-Component-Client-HTTP
polaris version
ProWebWalker
Psbot
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RepoMonkey
RSSingBot
ScanAlert
Scanbot
scan.lol
Scrapy
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOlyticsCrawler
SeoSiteCheckup
SEOstats
sexsearcher
Siphon
Sitebeam
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
SpaceBison
sp_auditbot
Spinn3r
SputnikBot
spyfu
Sqlworm
Sqworm
Stripper
Sucker
Suzuran
Szukacz
T0PHackTeam
tAkeOut
Telesoft
Telesphoreo
TheNomad
TightTwatBot
Titan
Toata
Tracemyfile
trendiction.com
trendiction.de
True_Robot
Turingos
Twice
Typhoeus
UnisterBot
Upflow
Vacuum
Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
Web Fuck
WebmasterWorldForumBot
webmeup-crawler
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebSucker
Web Sucker
Whack
Whatweb
Widow
Wonderbot
WWW-Collector-E
WWWOFFLE
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
zauba.io
Zermelo
zgrab
Zitebot
ZmEu
ZyBorg