360Spider
404enemy
80legs
Abonti
Aboundex
Aboundexbot
ADmantX
AiHitBot
AlphaBot
Ankit
Apexoo
archive.org_bot
ASPSeek
Attach
AwarioSmartBot
BackDoorBot
BackStreet
BackWeb
Badass
Barkrowler
BBBike
BDCbot
Black Hole
Blow
BlowFish
Brandwatch
Buddy
CATExplorador
CheeseBot
CherryPicker
CheTeam
ChinaClaw
coccocbot-web
cognitiveseo
Collector
Cosmos
Craftbot
crawler4j
Crescent
DataCha0s
demandbase-bot
Demon
Devil
Digincore
Dirbuster
Discobot
Dispatch
DomainStatsBot
Dotbot
Download Wonder
DSearch
eCatch
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FDM
Foobot
FrontPage
GalaxyBot
Genieo
GetRight
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Grabber
GT::WWW
Haansoft
Harvest
Hloader
HTMLparser
HTTP::Lite
Iblog
Id-search
Image Fetch
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
InternetSeer
ips-agent
Iria
JamesBOT
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
Lftp
LieBaoFast
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
LWP::Simple
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
Meanpathbot
MeanPath Bot
Mediatoolkitbot
Metauri
MIDown tool
MJ12bot
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Msrabot
Name Intelligence
Navroad
Nessus
NetAnts
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Net Vampire
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Nmap
oBot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OpenVAS
OrangeBot
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
pcBrowser
PeoplePal
Pi-Monster
POE-Component-Client-HTTP
polaris version
ProPowerBot
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
ReGet
RepoMonkey
Ripper
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
ScoutJet
Scrapy
Semrush
SEOkicks-Robot
SEOprofiler
SeoSiteCheckup
SEOstats
serpstatbot
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Site Sucker
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sogou web spider
Sottopop
SpaceBison
Spammen
Spbot
Spinn3r
spyfu
SuperBot
Surfbot
Swiftbot
sysscan
Telesphoreo
Telesphorep
TheNomad
Thumbor
Tracemyfile
Trendiction
Trendictionbot
trendiction.de
True_Robot
Turingos
TurnitinBot
URLy Warning
URLy.Warning
Virusdie
Voil
Voltron
WBSearchBot
WebCollage
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebGo IS
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Webster
WebSucker
WebWhacker
Who.is Bot
Wonderbot
Woobot
Wprecon
WPScan
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
xpymep1.exe
Zade
Zauba
zauba.io
Zitebot
ZmEu
ZumBot