360Spider
AhrefsBot
AIBOT
AiHitBot
AllSubmitter
Anarchie
Ankit
Apexoo
arquivo.pt
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
BLEXBot
Bolt
BotALot
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CazoodleBot
Cegbfeieh
CherryPicker
Chlooe
Claritybot
Cogentbot
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CSHttp
Curious
Custo
DatabaseDriverMysqli
Digincore
DigitalPebble
Dirbuster
Discoverybot
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
EasyDL
Ebingbong
eCatch
ECCP/1.0
Ecxi
EMail Siphon
evc-batch
Express WebPictures
Extractor
Extreme Picture Finder
FHscan
Flunky
Foobot
Freeuploader
Fyrebot
GalaxyBot
Genieo
GetRight
GetWeb
Gigablast
Gigabot
GrapeFX
Harvest
heritrix
HMView
Humanlinks
HybridBot
Id-search
IlseBot
Image Sucker
IndeedBot
InterGET
Internet Ninja
InternetSeer
Iria
IRLbot
Iskanie
JetCar
JikeSpider
JOC Web Spider
Joomla
Kinza
Larbin
LeechFTP
LeechGet
LibWeb
Libwhisker
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
LNSpiderguy
LWP::Simple
Magnet
magpie-crawler
Majestic-SEO
MarkMonitor
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
MIIxpc
Mister PiX
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
muhstik-scan
Name Intelligence
Nameprotect
Navroad
NearSite
Netcraft
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Ninja
Nmap
NPbot
Nutch
oBot
Octopus
Offline Explorer
OnCrawl
Openvas
OpenVAS
OPPO A33
OrangeSpider
OutclicksBot
Page Analyzer
page scorer
Pandalytics
Pavuk
pcBrowser
PeoplePal
Picscout
PictureFinder
Pimonster
plumanalytics
Pockey
POE-Component-Client-HTTP
polaris version
Pump
PxBroker
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Reaper
RedesScrapy
ReGet
RocketCrawler
RSSingBot
s1z.ru
SBIder
scan.lol
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks
seoscanners
SEOstats
Sitebeam
SiteExplorer
SiteSnagger
SlySearch
SMTBot
Snoopy
Sociscraper
Sottopop
Spanner
sp_auditbot
spyfu
Sqlworm
Steeler
Sucker
SuperHTTP
SurveyBot
Swiftbot
T8Abot
The Intraformant
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
trendiction.de
True_Robot
Twice
Typhoeus
UnisterBot
Vacuum
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
Webalta
Web Auto
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebFuck
Web Fuck
webmeup-crawler
Webshag
WebStripper
WebSucker
Web Sucker
WebZIP
WeSEE
Who.is Bot
WISENutbot
Wonderbot
WWWOFFLE
x22Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
Zermelo
zgrab
Zitebot
ZumBot