80legs
Aboundex
ADmantX
AhrefsBot
AIBOT
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Apexoo
archive.org_bot
autoemailspider
AwarioSmartBot
BackStreet
BackWeb
Badass
Barkrowler
Blackboard
Black Hole
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
Chlooe
Claritybot
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Copier
Copyscape
crawl.sogou.com
CSHttp
Curious
Devil
DIIbot
Dirbuster
Disco
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DTS Agent
EasyDL
Ebingbong
eCatch
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
Exabot
ExtractorPro
EyeNetIE
Ezooms
facebookscraper
FDM
Firefox/7.0
Foobot
Freeuploader
FyberSpider
GalaxyBot
Genieo
Getintent
GetWeb
Gigablast
Go-Ahead-Got-It
Go!Zilla
GrabNet
GT::WWW
Haansoft
HMView
HTTrack
HybridBot
Iblog
IlseBot
Image Fetch
IndeedBot
Indy Library
Intelliseek
InterGET
Internet Ninja
IRLbot
JOC Web Spider
JustView
Kenjin Spider
Keyword Density
Lanshanbot
LeechFTP
LeechGet
LibWeb
Likse
LinkextractorPro
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
LNSpiderguy
Ltx71
lwp-request
Magnet
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
Mass Downloader
Mata Hari
MauiBot
MegaIndex.ru
MIIxpc
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
Musobot
Nameprotect
NetAnts
Netvibes
NetZIP
Nibbler
NimbleCrawler
Ninja
Nmap
NPbot
oBot
Octopus
Offline Navigator
OnCrawl
Openfind
Openvas
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
PageAnalyzer
Page Analyzer
Panscient
pcBrowser
Picsearch
PictureFinder
Pimonster
POE-Component-Client-HTTP
ProWebWalker
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
Reaper
Recorder
RedesScrapy
ReGet
Ripper
ScanAlert
Scanbot
scan.lol
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
serpstatbot
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Sitevigil
SMTBot
Snake
Snoopy
Sociscraper
sogouspider
Sosospider
Sottopop
Spinn3r
Sqlworm
SurveyBot
Suzuran
Swiftbot
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Thumbor
TightTwatBot
Titan
Trendiction
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
URLy Warning
Vacuum
Wallpapers/3.0
Webalta
WebAuto
Web Auto
WebBandit
Web Collage
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebSauger
Webshag
WebsiteExtractor
Website Quester
WebSucker
WeSEE
Whacker
Whatweb
WinHTTrack
WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xenu
xpymep1.exe
YoudaoBot
zauba.io
Zermelo
ZumBot