360Spider
80legs
ASPSeek
Aboundex
Acunetix
AhrefsBot
AiHitBot
Alligator
Anarchy99
Anthill
Attach
BDCbot
BDFetch
BackDoorBot
BackStreet
Badass
Barkrowler
Battleztar Bazinga
Blow
BlowFish
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
CCBot
CODE87
Cegbfeieh
CheeseBot
ChinaClaw
Claritybot
Cocolyzebot
CopyRightCheck
Copyscape
Cosmos
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Dirbuster
Disco
Discoverybot
DittoSpyder
DomainSigmaCrawler
Dotbot
Drip
EMail Siphon
EasyDL
Ecxi
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Flunky
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Getintent
Gigablast
Gigabot
GoZilla
Gotit
GrabNet
HMView
HTMLparser
Haansoft
HaosouSpider
Havij
Humanlinks
HybridBot
IDBot
IlseBot
Image Sucker
IndeedBot
Iria
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JustView
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
LexiBot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MarkWatch
Mass Downloader
MauiBot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Musobot
NICErsPRO
Navroad
NearSite
Needle
NetMechanic
NetZIP
Netcraft
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Ninja
Nmap
Octopus
Offline Explorer
OnCrawl
Openfind
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PageAnalyzer
PageGrabber
Pandalytics
PeoplePal
Petalbot
Picscout
Picsearch
PleaseCrawl
Pu_iN
PyCurl
RankFlex
Rankivabot
Reaper
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
SearchmetricsBot
Semrush
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
Sociscraper
Sottopop
Spinn3r
Sqlworm
Sqworm
Stripper
SuperBot
SurveyBot
Swiftbot
T0PHackTeam
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
TwengaBot
Twice
Upflow
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WISENutbot
WWWOFFLE
WeSEE
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebEnhancer
WebFetch
WebStripper
Webalta
WebsiteExtractor
Whack
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
Zauba
Zermelo
Zeus
ZoomBot
ZoominfoBot
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
check1.exe
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
eCatch
evc-batch
gopher
netEstate NE Crawler
page scorer
pcBrowser
satoristudio.net
seobility
sogouspider
sp_auditbot
sysscan
tAkeOut