404enemy
80legs
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Aipbot
AllSubmitter
Anarchie
archive.org_bot
Asterias
autoemailspider
BacklinkCrawler
BackStreet
Barkrowler
BatchFTP
BBBike
BetaBot
Black Hole
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Collector
com.plumanalytics
Copier
Copyscape
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
demandbase-bot
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Discoverybot
DomainCrawler
Dragonfly
DTS Agent
EasyDL
eCatch
EroCrawler
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
Fimap
FlashGet
Fyrebot
Genieo
Getintent
GetWeb
GoZilla
Grafula
GrapeshotCrawler
GT::WWW
Haansoft
Harvest
HEADMasterSEO
Hloader
HTMLparser
IDBot
IlseBot
IndeedBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iria
Iskanie
IstellaBot
JennyBot
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Kozmosbot
Larbin
LexiBot
Lftp
LibWeb
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaScrapeBot
Lipperhey
LWP::Simple
lwp-trivial
Magnet
Mag-Net
MarkMonitor
Masscan
MauiBot
meanpathbot
MJ12bot
Mojeek
Mr.4x3
MS Web Services Client Protocol
muhstik-scan
Musobot
Nameprotect
Navroad
NearSite
NetLyzer
NetMechanic
Net Vampire
Netvibes
NetZIP
Nibbler
NICErsPRO
Nikto
Nimbostratus
Ninja
Nutch
oBot
Octopus
OnCrawl
Openfind
OpenLinkProfiler
OrangeSpider
Page Analyzer
PageGrabber
PageScorer
Pavuk
pcBrowser
PECL::HTTP
PHPCrawl
PictureFinder
Pi-Monster
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Psbot
Pump
PxBroker
PyCurl
RankingBot
Rankivabot
RealDownload
Reaper
RedesScrapy
RepoMonkey
Rogerbot
s1z.ru
SBIder
ScanAlert
Screaming
Searchestate
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
Sitevigil
SmartDownload
SocialRankIOBot
sogouspider
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
spyfu
Sqworm
Sucker
SuperBot
SurveyBot
Suzuran
sysscan
T8Abot
tAkeOut
Teleport
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toata
Tracemyfile
Trendiction
trendiction.com
True_Robot
URLy.Warning
Vagabondo
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
Web Collage
WebCopier
WebEnhancer
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebStripper
WebSucker
WebWhacker
Whatweb
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Zade
Zeus
Zitebot
ZumBot