360Spider
404checker
80legs
Abonti
Aboundex
ADmantX
AhrefsBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
arquivo-web-crawler
ASPSeek
Asterias
AwarioRssBot
AwarioSmartBot
BacklinkCrawler
BackStreet
BBBike
BDFetch
Bigfoot
Black Hole
BlackWidow
BLEXBot
Boardreader
Brandwatch
BuiltWith
BunnySlippers
Calculon
CATExplorador
CCBot
CheeseBot
CheTeam
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CSHttp
Curious
DBLBot
demandbase-bot
Deusu
Dirbuster
DomainSigmaCrawler
domainsproject.org
DomainStatsBot
Dotbot
Download Wonder
EasyDL
ECCP/1.0
Ecxi
EMail Siphon
EMail Wolf
EroCrawler
Express WebPictures
Extractor
EyeNetIE
FemtosearchBot
Fimap
FlashGet
Flunky
FrontPage
Fyrebot
GalaxyBot
Genieo
GoZilla
Grafula
GridBot
Harvest
HTMLparser
HybridBot
Iblog
IDBot
Id-search
InfoTekies
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JOC Web Spider
Jyxobot
Kenjin Spider
Kozmosbot
LeechFTP
LeechGet
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MFC_Tear_Sample
MicroMessenger
MIIxpc
Mister PiX
MJ12bot
Mojolicious
MQQBrowser
Name Intelligence
Navroad
Netcraft
netEstate NE Crawler
NetSpider
Netvibes
Niki-bot
NimbleCrawler
Ninja
NPbot
Nutch
oBot
OnCrawl
Openfind
OpenLinkProfiler
OPPO A33
OrangeBot
OutfoxBot
PageScorer
Pandalytics
PECL::HTTP
PHPCrawl
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProPowerBot
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
RedesScrapy
ReGet
RepoMonkey
Rogerbot
SBIder
Scanbot
scan.lol
ScoutJet
Searchestate
Semrush
SEOkicks
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SmartDownload
Sogou web spider
Sosospider
Spammen
Spanner
SputnikBot
Sqlmap
Sucker
Sucuri
SuperBot
T0PHackTeam
Teleport
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toata
Tracemyfile
Trendiction
trendiction.com
Turingos
TurnitinBot
TwengaBot
Typhoeus
Vacuum
VB Project
VidibleScraper
Voil
Wallpapers/3.0
Webalta
Web Collage
Web Fetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Sauger
Webshag
Website Quester
Webster
Web Sucker
WebZIP
Whacker
Who.is Bot
Widow
WiseGuys Robot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x09Mozilla
xpymep1.exe
Zade
Zeus
Zitebot