80legs
ADmantX
ALittle Client
Aboundex
Aboundexbot
AhrefsBot
Alexibot
AllSubmitter
Alligator
Anarchy99
Aspiegel
Attach
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
BetaBot
Bolt
Brandprotect
Buddy
BuiltBotTough
Bullseye
CATExplorador
CCBot
CensysInspect
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cliqzbot
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Craftbot
CrunchBot
Curious
DSearch
Demon
Digincore
Dirbuster
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainSigmaCrawler
Dragonfly
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Flunky
Freeuploader
FyberSpider
GetWeb
Grabber
Grafula
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Havij
Hloader
HybridBot
IDBTE4M
IDBot
IndeedBot
JOC Web Spider
JikeSpider
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LeechFTP
LexiBot
LibWeb
Libwhisker
LinkWalker
LinkpadBot
LinksManager
Lipperhey
Ltx71
MTRobot
Mag-Net
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
Name Intelligence
Nameprotect
Needle
NetZIP
Netcraft
Nettrack
Netvibes
Niki-bot
Nmap
Not
Nuclei
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
PictureFinder
Pimonster
Pixray
Pu_iN
Pump
PxBroker
PyCurl
RankActive
RankActiveLinkBot
RankurBot
Re-re
Recorder
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScoutJet
Scrapy
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SemrushBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
SputnikBot
Sqlmap
Sqlworm
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
Titan
True_Robot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
VB Project
VidibleScraper
Virusdie
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WebBandit
WebCopier
WebFetch
WebFuck
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webster
Whack
Whacker
Widow
WiseGuys Robot
YoudaoBot
Zauba
Zitebot
ZoominfoBot
ZyBorg
arquivo.pt
backlink-check
cah.io.community
cognitiveseo
crawl.sogou.com
crawler4j
evc-batch
instabid
isitwp.com
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
plumanalytics
seobility
seoscanners
serpstatbot
sogouspider
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla
zauba.io
zgrab