360Spider
404enemy
Abonti
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Anarchie
Apexoo
Asterias
autoemailspider
Backlink-Ceck
backlink-check
BackWeb
Badass
Barkrowler
BatchFTP
Black Hole
BlackWidow
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
CherryPicker
CheTeam
Claritybot
cognitiveseo
Collector
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
Custo
demandbase-bot
Devil
Digincore
DigitalPebble
Dirbuster
Disco
Dispatch
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
DSearch
EasyDL
Ebingbong
Ecxi
EMail Siphon
evc-batch
Evil
Exabot
Express WebPictures
Extractor
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
Genieo
GetWeb
Gigablast
Gigabot
Gotit
Go!Zilla
GrapeFX
Haansoft
HaosouSpider
HEADMasterSEO
Hloader
HTTP::Lite
HTTrack
Iblog
IDBot
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
internetVista monitor
IRLbot
JennyBot
JOC Web Spider
Joomla
JustView
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Likse
LinkScan
LinksManager
LinkWalker
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
lwp-request
LWP::Simple
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
MFC_Tear_Sample
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
muhstik-scan
Navroad
Nessus
Netcraft
NetSpider
Nettrack
Net Vampire
NetZIP
Nikto
NimbleCrawler
Nmap
NPbot
Offline Explorer
Openfind
OpenVAS
OrangeSpider
Page Analyzer
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
pcBrowser
PHPCrawl
Picscout
Picsearch
Pimonster
Pixray
PleaseCrawl
POE-Component-Client-HTTP
Probethenet
Psbot
PxBroker
PyCurl
RankActiveLinkBot
RankurBot
Recorder
Ripper
RocketCrawler
s1z.ru
ScanAlert
Scanbot
scan.lol
SearchmetricsBot
SemrushBot
SEOkicks
SEOkicks-Robot
SEOprofiler
serpstatbot
Shodan
SISTRIX
Sitebeam
SiteExplorer
SiteSucker
SlySearch
Snake
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
Sosospider
Sottopop
sp_auditbot
Spinn3r
Sqlmap
Sqlworm
Sqworm
Steeler
Sucker
Sucuri
SuperBot
Suzuran
Swiftbot
Szukacz
tAkeOut
TeleportPro
Telesphorep
Titan
Tracemyfile
Trendictionbot
trendiction.de
True_Robot
Turingos
Turnitin
URLy.Warning
VB Project
VCI
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WebCollage
Web Collage
WebCopier
WEBDAV
WebEnhancer
WebFuck
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebsiteQuester
Website Quester
WebStripper
Web Sucker
WebWhacker
WebZIP
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
WWW-Collector-E
WWW::Mechanize
x09Mozilla
Xaldon WebSpider
Zauba
zauba.io
Zermelo
Zitebot
ZyBorg