360Spider
404enemy
80legs
Aboundex
ADmantX
AiHitBot
Aipbot
Alexibot
Anarchie
archive.org_bot
Asterias
BacklinkCrawler
BackStreet
Badass
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Blackboard
Black Hole
BLEXBot
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
CATExplorador
CazoodleBot
CheTeam
Cloud mapping
Cogentbot
Collector
Copier
crawler.feedback
CrazyWebCrawler
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
Demon
Deusu
DigitalPebble
Disco
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
DSearch
Ebingbong
Ecxi
Evil
Exabot
ExtractorPro
Fimap
FrontPage
GalaxyBot
GermCrawler
GetWeb
Gigablast
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Harvest
Heritrix
HMView
HTMLparser
HTTP::Lite
Humanlinks
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InterGET
IRLbot
Iskanie
Jbrofuzz
JetCar
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
Larbin
LeechGet
LexiBot
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MauiBot
MeanPath Bot
Metauri
Microsoft Data Access
Microsoft URL Control
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
MSFrontPage
Msrabot
Name Intelligence
Nameprotect
NearSite
Netcraft
netEstate NE Crawler
NetMechanic
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nmap
NPbot
Octopus
Offline Navigator
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
page scorer
PageScorer
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
PictureFinder
Pimonster
Probethenet
ProPowerBot
Psbot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankurBot
Reaper
Ripper
s1z.ru
SBIder
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
Screaming
SearchmetricsBot
Semrush
SemrushBot
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
serpstatbot
Shodan
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SMTBot
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
Sosospider
Sottopop
SpaceBison
Spammen
sp_auditbot
Spbot
Spinn3r
Steeler
Sucker
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
tAkeOut
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
TightTwatBot
Titan
Trendiction
True_Robot
Turingos
Turnitin
Twice
Typhoeus
UnisterBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VCI
VidibleScraper
VoidEYE
Voltron
Wallpapers/3.0
WallpapersHD
WBSearchBot
Webalta
Web Collage
WEBDAV
WebFetch
WebLeacher
webmeup-crawler
Web Sauger
Webshag
WebsiteExtractor
WebSucker
WebWhacker
Whack
Wonderbot
WPScan
WWW-Mechanize
x22Mozilla
YoudaoBot
Zade
Zauba
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZyBorg