360Spider
404enemy
80legs
ADmantX
Acunetix
AfD-Verbotsverfahren
Alexibot
Apexoo
Asterias
Atomseobot
Attach
AwarioRssBot
BBBike
BackStreet
Battleztar Bazinga
BetaBot
Blackboard
Bolt
BotALot
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
Citoid
Cloud mapping
Cogentbot
Collector
Copyscape
Cosmos
Curious
DBLBot
DTS Agent
DataCha0s
Demon
Devil
DigitalPebble
Dirbuster
Discobot
Dispatch
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dragonfly
Drip
EasyDL
Ebingbong
EroCrawler
Ezooms
FHscan
Fimap
Foobot
Fuzz
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
GetRight
Go!Zilla
GoZilla
Gotit
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HonoluluBot
Humanlinks
IDBot
Id-search
Image Fetch
Indy Library
InterGET
Iria
IstellaBot
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Leap
LeechGet
LexiBot
Libwhisker
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MIDown tool
MJ12bot
Magnet
Mail.RU_Bot
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Musobot
Name Intelligence
Nameprotect
Navroad
Nessus
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Not
Nuclei
Nutch
Offline Explorer
Openvas
OutfoxBot
POE-Component-Client-HTTP
PageScorer
PageThing.com
Pandalytics
Papa Foto
Petalbot
Picscout
Picsearch
PictureFinder
Piepmatz
Psbot
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
Re-re
RedesScrapy
Rogerbot
SalesIntelligent
ScrepyBot
Seekport
SemanticJuice
Semrush
SentiBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
Siteimprove
SlySearch
SmartDownload
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Telesphoreo
TightTwatBot
Toata
Trendictionbot
True_Robot
Turnitin
Twice
URLy Warning
URLy.Warning
VB Project
Vagabondo
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebCollage
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebStripper
WebSucker
Webshag
WebsiteExtractor
WebsiteQuester
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
YoudaoBot
Zade
Zeus
ZmEu
ZumBot
adscanner
archive.org_bot
arquivo.pt
coccocbot
crawl.sogou.com
crawler.feedback
demandbase-bot
facebookscraper
heritrix
ips-agent
magpie-crawler
page scorer
pcBrowser
plumanalytics
probe-image-size
s1z.ru
scan.lol
seobility
seoscanners
serpstatbot
sogouspider
sp_auditbot
spyfu
sysscan
webmeup-crawler
zgrab