360Spider
ADmantX
AIBOT
ALittle Client
ASPSeek
AhrefsBot
AiHitBot
Alexibot
Anarchy
Anarchy99
Anthill
Aspiegel
BDCbot
BackWeb
Badass
Bandit
Barkrowler
Bigfoot
Bitacle
BlackWidow
Brandprotect
Brandwatch
Buck
Buddy
Bullseye
CODE87
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cogentbot
CopyRightCheck
Custo
DBLBot
DIIbot
Demon
Devil
DigitalPebble
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
EasyDL
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
EyeNetIE
Ezooms
Firefox/7.0
GT::WWW
GermCrawler
GetRight
Grafula
HEADMasterSEO
HTMLparser
Harvest
IDBTE4M
IRLbot
Id-search
IlseBot
Intelliseek
Iskanie
IstellaBot
JOC Web Spider
JetCar
Jyxobot
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
LexiBot
Lftp
Libwhisker
Likse
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
MolokaiBot
NICErsPRO
Nameprotect
Navroad
NearSite
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nimbostratus
Nmap
Octopus
Offline Navigator
OnCrawl
OpenVAS
PageAnalyzer
Papa Foto
Pi-Monster
Picscout
Picsearch
Piepmatz
PleaseCrawl
ProWebWalker
Probethenet
Pump
RankActive
RankFlex
RankingBot
RankingBot2
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
Scrapy
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
Sitebeam
Siteimprove
Sitevigil
Sosospider
SpaceBison
Spanner
Spbot
Spinn3r
Sqlworm
Steeler
Sucker
Surfbot
Suzuran
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
Telesphoreo
TheNomad
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Typhoeus
V-BOT
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WEBDAV
WWW-Mechanize
WallpapersHD
Web Auto
Web Collage
Web Enhancer
WebBandit
WebCopier
WebFetch
WebImageCollector
WebLeacher
WebPix
WebSucker
WebWhacker
WebZIP
Webalta
Website Quester
WebsiteQuester
Widow
Wonderbot
Xenu
YoudaoBot
Zade
ZmEu
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
cognitiveseo
com.plumanalytics
crawler4j
demandbase-bot
domainsproject.org
evc-batch
gopher
internetVista monitor
isitwp.com
iubenda-radar
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
s1z.ru
scalaj-http
siteripz
sysscan
tAkeOut
trendiction.com
webprosbot
x22Mozilla