360Spider
80legs
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
AllSubmitter
Ankit
Apexoo
Aspiegel
Asterias
AwarioRssBot
Bigfoot
Black Hole
BlackWidow
Blackboard
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltBotTough
CATExplorador
CCBot
CODE87
CSHttp
CazoodleBot
CheTeam
ChinaClaw
Chlooe
Citoid
Claritybot
Cliqzbot
Cogentbot
Collector
Copier
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DBLBot
DSearch
Deusu
Devil
Dirbuster
Discoverybot
DomainCrawler
Domains Project
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
Evil
Extractor
Ezooms
Firefox/7.0
Flunky
Foobot
FrontPage
Fuzz
GalaxyBot
Genieo
Go!Zilla
Grabber
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTrack
HaosouSpider
Heritrix
Hloader
HybridBot
IDBot
Id-search
IlseBot
Image Sucker
InfoNaviRobot
InterGET
Internet Ninja
Iria
Iskanie
Jbrofuzz
JustView
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
Larbin
LeechFTP
LieBaoFast
Lightspeedsystems
LinkScan
Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
MIIxpc
MSFrontPage
MSIECrawler
Mag-Net
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Nameprotect
Navroad
Needle
Nessus
Net Vampire
NetSpider
NetZIP
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nmap
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
PHPCrawl
PageAnalyzer
Pandalytics
Petalbot
Picsearch
Pimonster
PleaseCrawl
Probethenet
RankActive
RankActiveLinkBot
Re-re
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
ScanAlert
Scanbot
Screaming
SearchmetricsBot
Seekport
SemanticJuice
Semrush
SemrushBot
SeobilityBot
Seomoz
Siteimprove
Snapbot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
Thumbor
Titan
Toata
Toweyabot
Turingos
Typhoeus
UnisterBot
VCI
VelenPublicWebCrawler
Virusdie
Voil
WASALive-Bot
Web Collage
Web Enhancer
Web Sauger
WebLeacher
WebPix
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webshag
Website Quester
Whack
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zitebot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
crawler.feedback
magpie-crawler
meanpathbot
mediawords
muhstik-scan
polaris version
scalaj-http
seostar
sitechecker.pro
siteripz
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
x22Mozilla
zgrab