360Spider
404enemy
80legs
ADmantX
ALittle Client
Abonti
Aboundexbot
Acunetix
AhrefsBot
Aipbot
AlphaBot
Anarchie
Anarchy99
Anthill
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
BetaBot
Black Hole
Blackboard
BlowFish
Brandprotect
Buck
Buddy
CATExplorador
CheTeam
CherryPicker
Chlooe
Citoid
Claritybot
Cloud mapping
Cocolyzebot
Copier
Craftbot
Curious
CyotekWebCopy
Demon
Dirbuster
Disco
Discobot
Discoverybot
DomainCrawler
Dotbot
Dragonfly
EMail Wolf
EasyDL
EirGrabber
EroCrawler
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
FlashGet
Foobot
FrontPage
Fuzz
GalaxyBot
Getintent
GoZilla
Grabber
HTTP::Lite
Haansoft
Harvest
Heritrix
IDBTE4M
Iblog
Image Fetch
IndeedBot
Intelliseek
InternetSeer
Iria
JamesBOT
Jetty
Kenjin Spider
LWP::Simple
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinqiaRSSBot
Litemage_walker
Ltx71
MSIECrawler
MTRobot
Majestic-SEO
Majestic12
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
Musobot
NICErsPRO
Net Vampire
NetAnts
Nibbler
Niki-bot
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
PictureFinder
Piepmatz
Pimonster
Pump
PxBroker
PyCurl
QueryN Metasearch
RankingBot2
RankurBot
Re-re
RealDownload
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spinn3r
SputnikBot
Sqlworm
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
Telesoft
Telesphorep
TheNomad
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voltron
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Auto
WebCopier
WebEnhancer
WebFuck
WebImageCollector
WebsiteExtractor
Whatweb
WinHTTrack
WiseGuys Robot
YoudaoBot
Zade
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
com.plumanalytics
crawler.feedback
domainsproject.org
evc-batch
gopher
heritrix
isitwp.com
lwp-request
magpie-crawler
meanpathbot
oBot
plumanalytics
probe-image-size
scalaj-http
seobility
seostar
serpstatbot
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.de
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x22Mozilla