360Spider
404enemy
Aboundex
ADmantX
AhrefsBot
AIBOT
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Asterias
Attach
BackDoorBot
backlink-check
BackStreet
Badass
BBBike
BDCbot
BDFetch
Bitacle
Black Hole
BlackWidow
BlowFish
Bolt
BotALot
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CCBot
CheeseBot
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Craftbot
crawler.feedback
Crescent
DatabaseDriverMysqli
DBLBot
Deusu
Dirbuster
DnyzBot
DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder
DSearch
EasyDL
ECCP/1.0
EMail Siphon
Exabot
Express WebPictures
Extractor
EyeNetIE
facebookscraper
FHscan
Firefox/7.0
Freeuploader
GetRight
Go-Ahead-Got-It
Gotit
Grabber
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Harvest
HEADMasterSEO
Heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HTTrack
IlseBot
InternetSeer
Iria
Iskanie
IstellaBot
JennyBot
Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Mail.RU_Bot
Masscan
meanpathbot
MeanPath Bot
Metauri
Microsoft URL Control
MIIxpc
MJ12bot
MSIECrawler
Nameprotect
NearSite
Netcraft
netEstate NE Crawler
NetMechanic
Ninja
Nmap
Nutch
Octopus
OnCrawl
Openfind
PageAnalyzer
Page Analyzer
PageGrabber
Pandalytics
Panscient
PeoplePal
Picscout
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Psbot
Quick-Crawler
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
ReGet
RepoMonkey
Ripper
RocketCrawler
s1z.ru
SalesIntelligent
SBIder
ScanAlert
scan.lol
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
Shodan
Siphon
SISTRIX
Sitebeam
Siteimprove
SiteLockSpider
SiteSucker
Site Sucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
SpankBot
Spanner
sp_auditbot
Spbot
SputnikBot
spyfu
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T8Abot
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Toata
Trendiction
trendiction.de
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
Vacuum
Vagabondo
VB Project
VCI
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
Wallpapers/3.0
WASALive-Bot
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
Web Fuck
WebLeacher
webmeup-crawler
Web Sauger
WebStripper
WebSucker
WeSEE
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
WPScan
WWW-Mechanize
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
Zauba
zauba.io
ZumBot
ZyBorg