360Spider
80legs
AIBOT
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alexibot
Anarchy
Attach
BBBike
BDCbot
BackDoorBot
Bandit
BlackWidow
Blackboard
Blow
Boardreader
Bolt
BotALot
Brandwatch
Buck
BuiltBotTough
CSHttp
Cegbfeieh
Cloud mapping
Collector
Copier
Cosmos
CrazyWebCrawler
CrunchBot
Curious
DIIbot
Deusu
Digincore
Dirbuster
Discoverybot
Dispatch
DomainAppender
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Siphon
EasyDL
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
FHscan
FlashGet
Freeuploader
Fuzz
Fyrebot
Genieo
GermCrawler
Gigabot
Go-Ahead-Got-It
GoZilla
Grabber
HTMLparser
HTTrack
HaosouSpider
Heritrix
Humanlinks
HybridBot
IRLbot
Iblog
Image Fetch
Image Sucker
Indy Library
InterGET
Internet Ninja
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
JikeSpider
Joomla
Jyxobot
Kenjin Spider
LWP::Simple
Lanshanbot
Leap
LexiBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MJ12bot
MTRobot
Magnet
Majestic-SEO
Mb2345Browser
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojeek
Mozlila
Mr.4x3
NPbot
Navroad
NearSite
Needle
NetLyzer
NetZIP
Netcraft
Nibbler
Nikto
Nimbostratus
Nutch
Offline Explorer
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PHPCrawl
PageGrabber
PageScorer
Panscient
Papa Foto
PictureFinder
Pixray
Pockey
ProWebWalker
Probethenet
PxBroker
RankActive
RankFlex
Rankivabot
RankurBot
ReGet
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
ScrepyBot
SearchmetricsBot
SemrushBot
SentiBot
SeobilityBot
Site Sucker
SiteExplorer
SiteSucker
Sociscraper
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spanner
SputnikBot
Stripper
SuperBot
SurveyBot
Szukacz
T0PHackTeam
Telesoft
The Intraformant
Titan
Tracemyfile
Trendiction
True_Robot
Turnitin
TwengaBot
URLy Warning
UnisterBot
Upflow
V-BOT
VeriCiteCrawler
VoidEYE
Voil
Voltron
WISENutbot
WPScan
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Enhancer
Web Fetch
Web Fuck
WebFuck
WebLeacher
WebSauger
WebWhacker
Webalta
Webshag
WebsiteQuester
Whacker
Who.is Bot
Woobot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zeus
ZmEu
ZoomBot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
eCatch
facebookscraper
heritrix
instabid
linkdexbot
magpie-crawler
mediawords
oBot
page scorer
polaris version
ripz
satoristudio.net
seobility
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com
x09Mozilla
x22Mozilla
zgrab