360Spider
404enemy
80legs
Acunetix
AhrefsBot
Aipbot
Alexibot
AlphaBot
Anarchy
Ankit
Asterias
AwarioSmartBot
BDCbot
BLEXBot
BackWeb
Badass
BetaBot
Bigfoot
Black Hole
Blow
BotALot
BuiltBotTough
Bullseye
BunnySlippers
CATExplorador
CCBot
CODE87
CazoodleBot
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Curious
Custo
DIIbot
DSearch
Devil
DigitalPebble
Dirbuster
DittoSpyder
DomainAppender
DomainStatsBot
Dragonfly
Drip
EMail Siphon
EasyDL
Ecxi
EroCrawler
Evil
ExtLinksBot
FDM
FHscan
Fimap
Firefox/7.0
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
GalaxyBot
Genieo
GetRight
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grabber
GrapeFX
GrapeshotCrawler
GridBot
Harvest
Hloader
Humanlinks
IDBTE4M
Id-search
IlseBot
Indy Library
InfoTekies
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
JustView
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MIDown tool
Magnet
Majestic SEO
Majestic12
Masscan
Mata Hari
MeanPath Bot
MegaIndex.ru
Minefield
Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Mozlila
Mr.4x3
Name Intelligence
Navroad
Needle
Net Vampire
NetMechanic
NetSpider
NetZIP
Nettrack
Netvibes
Nutch
Offline Navigator
OnCrawl
Openfind
OrangeSpider
OutfoxBot
PageScorer
Papa Foto
Pavuk
Petalbot
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
Psbot
Pump
Quick-Crawler
RankActiveLinkBot
RebelMouse
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
Screaming
ScrepyBot
SearchmetricsBot
SemanticJuice
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteSnagger
SiteSucker
Sitebeam
Snoopy
Sociscraper
Sogou web spider
Sosospider
SpankBot
Spanner
Spinn3r
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot
Suzuran
Szukacz
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TheNomad
Thumbor
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
Upflow
VidibleScraper
Voil
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Auto
Web Enhancer
Web Sauger
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSauger
Website Quester
WebsiteQuester
Whacker
Widow
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zermelo
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check
crawler4j
domainsproject.org
heritrix
instabid
isitwp.com
linkdexbot
lwp-request
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
s1z.ru
satoristudio.net
seocompany.store
sexsearcher
sp_auditbot
tAkeOut
voyagerx.com
x09Mozilla
x22Mozilla
zgrab