360Spider
404enemy
80legs
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
Alexibot
Anarchy99
Anthill
BLEXBot
BackDoorBot
BackWeb
Bandit
BatchFTP
Bigfoot
Bitacle
Blackboard
Brandprotect
Buddy
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CODE87
CheTeam
CheeseBot
ChinaClaw
Cocolyzebot
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
CrunchBot
Curious
DataCha0s
Deusu
Dirbuster
DnBCrawler-Analytics
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
ExtractorPro
Ezooms
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GermCrawler
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
GrabNet
Havij
Heritrix
Hloader
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
IndeedBot
InfoTekies
Iria
JOC Web Spider
JamesBOT
JikeSpider
Jorgee
JustView
LNSpiderguy
Leap
LeechFTP
LieBaoFast
LinkScan
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Musobot
NICErsPRO
Name Intelligence
Navroad
NearSite
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Nmap
Not
Nuclei
Offline Navigator
OpenLinkProfiler
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picsearch
PictureFinder
ProPowerBot
ProWebWalker
Probethenet
PxBroker
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
Re-re
ReGet
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScreenerBot
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
Siphon
Sitevigil
Sogou web spider
SpankBot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
SuperBot
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
The Intraformant
TightTwatBot
Toata
Turingos
URLy Warning
URLy.Warning
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
WEBDAV
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Fuck
WebAuto
WebGo IS
WebSucker
WebWhacker
Webalta
Webshag
Website Quester
WebsiteExtractor
Webster
Whatweb
Who.is Bot
Widow
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZoominfoBot
autoemailspider
coccocbot-web
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
eCatch
facebookscraper
gopher
ips-agent
lwp-trivial
magpie-crawler
meanpathbot
page scorer
plumanalytics
polaris version
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
seoscanners
serpstatbot
sp_auditbot
spyfu
tAkeOut
webmeup-crawler
x22Mozilla
zauba.io
zgrab