360Spider
404enemy
Aboundex
AhrefsBot
AiHitBot
AlphaBot
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Atomseobot
Attach
BBBike
BDCbot
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
Bigfoot
Bitacle
Blackboard
Blow
Bolt
BotALot
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CazoodleBot
CensysInspect
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Copier
Copyscape
Craftbot
Crescent
CyotekWebCopy
DBLBot
DTS Agent
DigitalPebble
Discobot
DomainCrawler
DomainSigmaCrawler
ECCP/1.0
Ebingbong
Ecxi
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Fimap
Flunky
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Genieo
Getintent
Gigabot
GoZilla
Grabber
Grafula
HEADMasterSEO
HMView
HTTrack
Harvest
Havij
HybridBot
IDBTE4M
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
Iria
IstellaBot
Jetty
Joomla
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Larbin
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Linkbot
LinkextractorPro
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojeek
Mojolicious
MolokaiBot
Nameprotect
NetMechanic
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Nikto
Not
Octopus
Offline Explorer
OpenLinkProfiler
OrangeBot
OutfoxBot
PageAnalyzer
Papa Foto
Pavuk
PeoplePal
Pi-Monster
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Pu_iN
RankingBot2
Reaper
RebelMouse
RedesScrapy
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scanbot
Scrapy
Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Site Sucker
Sitebeam
SlySearch
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spammen
Spanner
Spbot
Spinn3r
SputnikBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Telesoft
Tracemyfile
TurnitinBot
TwengaBot
Twice
URLy Warning
V-BOT
VCI
Vacuum
Virusdie
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Fuck
WebCollage
WebEnhancer
WebGo IS
WebLeacher
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Webster
Widow
WiseGuys Robot
Woobot
Xaldon_WebSpider
Zade
Zeus
ZoomBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
backlink-check
check1.exe
coccocbot
crawl.sogou.com
facebookscraper
gopher
iubenda-radar
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
oBot
page scorer
pcBrowser
plumanalytics
s1z.ru
scan.lol
seobility
seocompany.store
sp_auditbot
sysscan
trendiction.de
ubermetrics-technologies.com
voyagerx.com
zgrab