404enemy
80legs
ADmantX
AfD-Verbotsverfahren
AIBOT
AiHitBot
Alligator
Ankit
Aspiegel
ASPSeek
Attach
autoemailspider
AwarioRssBot
AwarioSmartBot
backlink-check
BacklinkCrawler
Bandit
Barkrowler
BDFetch
BetaBot
BlackWidow
BlowFish
Bolt
BuiltBotTough
BuzzSumo
Calculon
CATExplorador
CCBot
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Cliqzbot
coccocbot-web
cognitiveseo
Copier
CopyRightCheck
Craftbot
crawler4j
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
Custo
DatabaseDriverMysqli
DBLBot
Demon
Deusu
Devil
Disco
Discobot
Discoverybot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
eCatch
ECCP/1.0
Ecxi
Evil
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
Fimap
Firefox/7.0
FlashGet
FrontPage
GalaxyBot
Getintent
GetRight
Gigabot
Go-Ahead-Got-It
Go!Zilla
Grabber
GrabNet
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HTTP::Lite
Iblog
IlseBot
Image Fetch
internetVista monitor
Iria
IRLbot
Jbrofuzz
JennyBot
JetCar
JOC Web Spider
Joomla
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
LexiBot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
LNSpiderguy
Ltx71
Majestic12
Majestic SEO
Majestic-SEO
Masscan
Mata Hari
MeanPath Bot
Metauri
Microsoft Data Access
MIDown tool
MIIxpc
Mister PiX
Mojeek
Mojolicious
MQQBrowser
Mr.4x3
Nameprotect
NearSite
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
Net Vampire
Netvibes
NICErsPRO
NPbot
oBot
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OPPO A33
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
pcBrowser
PHPCrawl
Pi-Monster
PleaseCrawl
POE-Component-Client-HTTP
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankurBot
Recorder
RedesScrapy
ReGet
ScanAlert
ScoutJet
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SEOlyticsCrawler
Seomoz
seoscanners
sexsearcher
Siphon
Siteimprove
SiteSnagger
SiteSucker
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
Sqworm
Stripper
Sucker
SuperBot
Surfbot
Suzuran
sysscan
T8Abot
tAkeOut
TeleportPro
The Intraformant
Thumbor
TightTwatBot
Toata
Tracemyfile
trendiction.de
True_Robot
TurnitinBot
UnisterBot
Upflow
URLy.Warning
VeriCiteCrawler
Virusdie
Voltron
Webalta
WebAuto
WEBDAV
WebEnhancer
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebPix
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebStripper
WebWhacker
WeSEE
Whack
Who.is Bot
Widow
WISENutbot
Wonderbot
Wotbox
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Zade
Zauba
zauba.io
Zitebot
ZmEu
ZumBot