360Spider
AIBOT
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
Anarchie
Ankit
Anthill
Apexoo
Aspiegel
Attach
AwarioSmartBot
BBBike
BDCbot
BDFetch
BackStreet
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Boardreader
Brandwatch
BuiltWith
Bullseye
CATExplorador
CCBot
CensysInspect
CherryPicker
Claritybot
Cloud mapping
Cogentbot
Collector
Cosmos
Craftbot
CrunchBot
DTS Agent
Deusu
Devil
DigitalPebble
Dirbuster
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
Dragonfly
Ebingbong
Ecxi
EroCrawler
ExtLinksBot
ExtractorPro
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeshotCrawler
HTMLparser
HTTrack
Haansoft
HaosouSpider
Havij
HybridBot
IDBot
IRLbot
Id-search
Image Sucker
InfoTekies
Intelliseek
Iria
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LexiBot
Lftp
LibWeb
Lightspeedsystems
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Nessus
Net Vampire
NetAnts
NetSpider
Netcraft
Nibbler
Niki-bot
Nuclei
OnCrawl
OpenVAS
Openvas
OrangeBot
OutclicksBot
PageAnalyzer
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
Pixray
PleaseCrawl
Probethenet
Pump
RSSingBot
RankActive
RankingBot2
ReGet
RealDownload
Reaper
Recorder
RedesScrapy
RocketCrawler
Scanbot
SearchmetricsBot
Semrush
SeobilityBot
Shodan
Siphon
SiteLockSpider
SiteSnagger
Sitebeam
Sociscraper
Sogou web spider
Sosospider
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperBot
Swiftbot
Telesoft
TightTwatBot
Trendiction
TwengaBot
Twice
URLy Warning
URLy.Warning
VCI
Vagabondo
Virusdie
Voil
WASALive-Bot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Sauger
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebPix
WebSauger
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Widow
Wonderbot
Woobot
Wotbox
Zade
Zeus
ZmEu
ZyBorg
arquivo-web-crawler
autoemailspider
coccocbot
com.plumanalytics
dataforseo.com
demandbase-bot
domainsproject.org
heritrix
isitwp.com
linkdexbot
meanpathbot
mediawords
oBot
plumanalytics
probe-image-size
ripz
s1z.ru
scan.lol
seobility
sitechecker.pro
siteripz
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla