80legs
AIBOT
ASPSeek
Abonti
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Anarchie
Anthill
Asterias
Atomseobot
Attach
BLEXBot
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
Blow
Boardreader
Bolt
Brandprotect
Brandwatch
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Cogentbot
Collector
Copier
Crawling at Home Project
Curious
Custo
CyotekWebCopy
DIIbot
Disco
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
Evil
FDM
FemtosearchBot
FlashGet
Flunky
Fuzz
FyberSpider
GT::WWW
GetRight
Gotit
Grabber
GrapeFX
HMView
Humanlinks
IDBTE4M
Iblog
InfoNaviRobot
InternetSeer
Iria
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Jetty
Joomla
Keyword Density
LNSpiderguy
LWP::Simple
Leap
LeechGet
Libwhisker
Likse
LinkWalker
Linkbot
LinkextractorPro
Litemage_walker
MFC_Tear_Sample
MIIxpc
MSIECrawler
Mag-Net
Majestic-SEO
MarkWatch
Mass Downloader
Masscan
Mata Hari
MauiBot
Meanpathbot
Metauri
MicroMessenger
Microsoft Data Access
Minefield
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Needle
NetAnts
NetMechanic
Netcraft
Nettrack
Niki-bot
Nikto
NimbleCrawler
Not
Nutch
Offline Explorer
Offline Navigator
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Papa Foto
PeoplePal
Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Pu_iN
PxBroker
RankActive
Rankivabot
RankurBot
Re-re
RebelMouse
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SalesIntelligent
ScanAlert
Scrapy
Seekport
SemanticJuice
Semrush
Siphon
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Snapbot
Sogou web spider
Sosospider
SpaceBison
Spammen
Spanner
Sqlworm
Steeler
Sucker
Szukacz
Telesphorep
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
V-BOT
VelenPublicWebCrawler
VidibleScraper
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Pix
Web Sucker
WebAuto
WebFuck
WebImageCollector
WebPix
WebReaper
WebSauger
Webalta
Whack
Whacker
Who.is Bot
Widow
Zauba
Zeus
ZoomBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
check1.exe
coccocbot
crawl.sogou.com
crawler4j
demandbase-bot
gopher
heritrix
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-trivial
meanpathbot
page scorer
plumanalytics
ripz
seobility
seocompany.store
sitechecker.pro
sogouspider
tAkeOut
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
webprosbot
zgrab