404enemy
80legs
ADmantX
Abonti
Aboundex
AhrefsBot
Aipbot
Anarchie
Anarchy
Ankit
Asterias
Attach
BDCbot
BLEXBot
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
Blackboard
BlowFish
Boardreader
Brandprotect
Buck
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CCBot
CSHttp
Calculon
CazoodleBot
CensysInspect
CheTeam
CheeseBot
Cliqzbot
Collector
CopyRightCheck
Copyscape
CrazyWebCrawler
Custo
CyotekWebCopy
DTS Agent
Demon
DigitalPebble
Dirbuster
Disco
DnyzBot
DomainAppender
EasyDL
Evil
Exabot
ExtLinksBot
FDM
FHscan
FemtosearchBot
Fimap
Flunky
Freeuploader
FrontPage
Fuzz
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
Go!Zilla
GoZilla
Gotit
GrabNet
Grabber
GrapeFX
Haansoft
Harvest
Heritrix
Hloader
IDBTE4M
IDBot
IlseBot
IndeedBot
Indy Library
Intelliseek
InterGET
InternetSeer
Iria
IstellaBot
JetCar
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
Larbin
LeechFTP
Lftp
LibWeb
LieBaoFast
Likse
Linkbot
LinkpadBot
Lipperhey
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
NICErsPRO
NPbot
Name Intelligence
NearSite
NetSpider
NetZIP
Netvibes
Nibbler
Nuclei
Offline Explorer
OpenLinkProfiler
Openfind
OutfoxBot
PHPCrawl
PageScorer
PageThing.com
Panscient
Picscout
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pockey
ProPowerBot
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Re-re
ReGet
Recorder
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOstats
SMTBot
ScanAlert
Scrapy
Screaming
ScreenerBot
ScrepyBot
Semrush
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SlySearch
Sogou web spider
Spammen
Spbot
Spinn3r
SputnikBot
Sqworm
Steeler
SuperBot
SuperHTTP
Suzuran
T8Abot
Telesoft
TheNomad
TightTwatBot
Toweyabot
Trendiction
Turingos
Turnitin
TwengaBot
Twice
URLy Warning
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WISENutbot
WWW-Collector-E
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebAuto
WebCollage
WebFetch
WebFuck
WebGo IS
WebSucker
WebWhacker
Webalta
Whack
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Zauba
ZoomBot
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
facebookscraper
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
s1z.ru
scalaj-http
seoscanners
sexsearcher
siteripz
sp_auditbot
tAkeOut
trendiction.com
xpymep1.exe