360Spider
404checker
80legs
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchie
archive.org_bot
arquivo.pt
arquivo-web-crawler
AwarioRssBot
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Badass
Barkrowler
BatchFTP
BDCbot
BDFetch
Bigfoot
Blackboard
BLEXBot
Boardreader
Brandwatch
Buddy
BuiltBotTough
BuzzSumo
CazoodleBot
CherryPicker
Claritybot
Cloud mapping
coccocbot-web
cognitiveseo
com.plumanalytics
Copier
CopyRightCheck
crawler.feedback
CrazyWebCrawler
CSHttp
Curious
Custo
demandbase-bot
Deusu
DIIbot
Disco
DittoSpyder
DnyzBot
DomainSigmaCrawler
Dotbot
Ebingbong
Ecxi
EMail Siphon
evc-batch
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FHscan
Fimap
Freeuploader
FrontPage
FyberSpider
Fyrebot
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
GrabNet
Harvest
Havij
heritrix
HTMLparser
HTTrack
HybridBot
Iblog
IDBot
Id-search
IlseBot
Image Fetch
IndeedBot
Intelliseek
InterGET
Internet Ninja
IstellaBot
Jetty
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Larbin
LexiBot
Lftp
LibWeb
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Ltx71
Magnet
Mail.RU_Bot
Masscan
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
MeanPath Bot
mediawords
Microsoft URL Control
Mister PiX
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
Name Intelligence
NearSite
netEstate NE Crawler
NetLyzer
NetMechanic
Net Vampire
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
NPbot
Nutch
Offline Explorer
Offline Navigator
OpenVAS
OPPO A33
OutfoxBot
page scorer
PageScorer
Panscient
Papa Foto
PHPCrawl
Picsearch
Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
Pump
RankActive
RankingBot
Rankivabot
RankurBot
RebelMouse
Recorder
RedesScrapy
RepoMonkey
s1z.ru
Scanbot
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks-Robot
Siphon
SISTRIX
Sitebeam
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
SmartDownload
SMTBot
Snoopy
Sogou web spider
SpankBot
Spanner
SputnikBot
spyfu
Sqlmap
Sqworm
Stripper
Sucker
Surfbot
Suzuran
Swiftbot
sysscan
Szukacz
T0PHackTeam
tAkeOut
Teleport
Telesoft
Telesphorep
TheNomad
Tracemyfile
trendiction.com
trendiction.de
True_Robot
Turingos
TwengaBot
URLy Warning
URLy.Warning
VCI
VidibleScraper
Virusdie
VoidEYE
Voltron
Webalta
WebAuto
Web Auto
WebBandit
Web Collage
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebFuck
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
WebSucker
WebWhacker
Whatweb
WinHTTrack
WiseGuys Robot
WISENutbot
Woobot
Wotbox
Wprecon
WPScan
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zade
Zauba
Zermelo
Zeus
ZmEu
ZyBorg