404checker
404enemy
AIBOT
ALittle Client
Abonti
Aboundex
Acunetix
AhrefsBot
AiHitBot
Aipbot
Anarchie
Asterias
Atomseobot
BBBike
BLEXBot
BackDoorBot
Badass
BatchFTP
BetaBot
Bigfoot
Blow
BlowFish
Bolt
Brandprotect
Buck
BuzzSumo
CCBot
CSHttp
CazoodleBot
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Copyscape
Cosmos
Craftbot
Crescent
DBLBot
DataCha0s
Digincore
Discobot
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
ECCP/1.0
EasyDL
Ecxi
Evil
ExtLinksBot
FDM
Flunky
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Gigabot
Go!Zilla
GoZilla
Gotit
Grabber
GridBot
HTMLparser
HTTP::Lite
HTTrack
Harvest
Havij
Heritrix
Hloader
HonoluluBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
Intelliseek
InterGET
InternetSeer
IstellaBot
Jbrofuzz
JennyBot
JetCar
Joomla
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
LexiBot
Lftp
Likse
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MIIxpc
Mag-Net
Magnet
MarkWatch
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Minefield
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
Name Intelligence
Nameprotect
Needle
Net Vampire
Netcraft
Netvibes
Nikto
Nimbostratus
Ninja
Octopus
Openfind
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
Piepmatz
Pimonster
Pixray
ProPowerBot
ProWebWalker
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
Rankivabot
Re-re
RealDownload
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
ScanAlert
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
Semrush
SentiBot
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
Sociscraper
SpaceBison
SpankBot
Spanner
Spinn3r
Sqlmap
Stripper
Sucker
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
Telesphoreo
TightTwatBot
Titan
Toata
Toweyabot
Trendictionbot
True_Robot
URLy Warning
URLy.Warning
VB Project
Voil
Voltron
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WallpapersHD
Web Fetch
Web Fuck
Web Pix
WebBandit
WebImageCollector
WebPix
WebSucker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whatweb
WiseGuys Robot
Woobot
Wprecon
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
eCatch
evc-batch
heritrix
instabid
isitwp.com
lwp-request
lwp-trivial
oBot
page scorer
polaris version
ripz
scan.lol
seobility
seocompany.store
seoscanners
sexsearcher
siteripz
sogouspider
spyfu
tAkeOut
trendiction.de
webmeup-crawler
zauba.io