404checker
404enemy
ASPSeek
Aipbot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Anthill
Apexoo
Aspiegel
Asterias
AwarioRssBot
BBBike
BDCbot
BLEXBot
Backlink-Ceck
Bandit
Black Hole
Bolt
BuiltBotTough
BuiltWith
CCBot
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Cogentbot
CopyRightCheck
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DIIbot
DSearch
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DomCopBot
Domains Project
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Exabot
ExtractorPro
EyeNetIE
Fimap
Firefox/7.0
FlashGet
Flunky
FyberSpider
Fyrebot
GermCrawler
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
GrabNet
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Harvest
Hloader
HonoluluBot
Humanlinks
IRLbot
IlseBot
IndeedBot
Iria
JOC Web Spider
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechGet
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
LinksManager
Ltx71
MIDown tool
MTRobot
Mag-Net
Magnet
Majestic SEO
MarkMonitor
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Mojeek
Mr.4x3
Nameprotect
Nessus
NetLyzer
NetSpider
NetZIP
Nettrack
Nibbler
Niki-bot
Nimbostratus
Not
Octopus
OnCrawl
OpenVAS
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Papa Foto
Pavuk
PeoplePal
Picscout
PictureFinder
Piepmatz
Pimonster
Pixray
Pu_iN
Pump
PyCurl
RankingBot
Reaper
RedesScrapy
Ripper
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scrapy
ScrepyBot
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitevigil
Sociscraper
Sosospider
Spammen
SpankBot
Spanner
Sqlmap
Steeler
SuperBot
SuperHTTP
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesphorep
TheNomad
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendictionbot
Turnitin
Typhoeus
URLy.Warning
UnisterBot
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebFuck
WebSauger
WebSucker
WebZIP
Website Quester
WebsiteQuester
Whack
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
clark-crawler
crawler.feedback
facebookscraper
instabid
linkdexbot
lwp-request
lwp-trivial
oBot
pcBrowser
ripz
s1z.ru
satoristudio.net
scalaj-http
seobility
sogouspider
sysscan
trendiction.de
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
zauba.io
zgrab