360Spider
404checker
Abonti
AhrefsBot
Anarchie
Anarchy99
Anthill
BBBike
BDFetch
BLEXBot
Bandit
Battleztar Bazinga
BetaBot
Blow
BlowFish
Boardreader
Bolt
BotALot
Buck
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
Chlooe
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DTS Agent
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Disco
Discobot
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Exabot
ExtLinksBot
Extractor
EyeNetIE
Firefox/7.0
Fuzz
GalaxyBot
Getintent
GoZilla
Gotit
Grabber
GrapeFX
HTTP::Lite
Haansoft
Hloader
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
IlseBot
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
Jbrofuzz
Jetty
Joomla
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
LexiBot
LibWeb
Libwhisker
LieBaoFast
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
Ltx71
MIIxpc
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
MauiBot
Mediatoolkitbot
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
NPbot
Name Intelligence
Navroad
Needle
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Nutch
OPPO A33
OpenVAS
Openfind
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageThing.com
Pandalytics
Pavuk
PeoplePal
Petalbot
Picscout
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Pu_iN
PxBroker
QueryN Metasearch
Quick-Crawler
RankingBot2
Reaper
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SISTRIX
SalesIntelligent
Scanbot
Screaming
Searchestate
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitebeam
SocialRankIOBot
Sociscraper
SpankBot
Spbot
Sqworm
Steeler
Sucuri
SuperBot
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Twice
URLy Warning
UnisterBot
Upflow
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Sauger
WebAuto
WebBandit
WebCollage
WebCopier
WebFetch
WebLeacher
WebSauger
WebStripper
WebZIP
WebsiteQuester
Webster
Widow
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zade
ZmEu
ZoominfoBot
arquivo-web-crawler
arquivo.pt
coccocbot-web
com.plumanalytics
crawl.sogou.com
evc-batch
facebookscraper
gopher
heritrix
instabid
isitwp.com
lwp-request
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
page scorer
plumanalytics
s1z.ru
seobility
seoscanners
seostar
sexsearcher
sysscan
webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab