AhrefsBot
AiHitBot
Alligator
Anarchy99
Aspiegel
Asterias
AwarioRssBot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
BetaBot
Bigfoot
Bitacle
Blow
Boardreader
Bolt
BotALot
Buck
Buddy
BuzzSumo
CODE87
CSHttp
CazoodleBot
Chlooe
Cocolyzebot
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crescent
CyotekWebCopy
DBLBot
DIIbot
Demon
Deusu
DigitalPebble
DittoSpyder
DnyzBot
DomainCrawler
Domains Project
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Freeuploader
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
HMView
HTMLparser
Heritrix
Hloader
HonoluluBot
IDBot
IRLbot
Id-search
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Larbin
Leap
LibWeb
Likse
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
MSFrontPage
Mail.RU_Bot
MarkWatch
Masscan
MeanPath Bot
Mediatoolkitbot
NICErsPRO
NPbot
Nameprotect
NearSite
Nessus
NetAnts
NetZIP
Netcraft
Nibbler
Nikto
Nimbostratus
Ninja
Nmap
Not
Nutch
Offline Explorer
OnCrawl
Openfind
OutclicksBot
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Petalbot
Pi-Monster
Picsearch
Pimonster
Pixray
Pockey
ProWebWalker
Pu_iN
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankurBot
Recorder
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SMTBot
ScoutJet
SearchmetricsBot
Seekport
SemanticJuice
Semrush
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
Sitebeam
SmartDownload
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
Spinn3r
Steeler
Sucker
Sucuri
SuperHTTP
Szukacz
Teleport
TeleportPro
The Intraformant
TheNomad
Thumbor
Toata
Tracemyfile
True_Robot
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WEBDAV
WWW-Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Fetch
Web Sauger
WebAuto
WebFuck
WebImageCollector
WebPix
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whack
Widow
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zeus
Zitebot
ZoomBot
adscanner
autoemailspider
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
gopher
ips-agent
linkdexbot
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler
pcBrowser
plumanalytics
polaris version
seobility
seocompany.store
seoscanners
sogouspider
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
x09Mozilla
x22Mozilla
zgrab