80legs
ALittle Client
Abonti
Aboundex
Acunetix
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Alligator
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BDFetch
Bandit
BatchFTP
Black Hole
Boardreader
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CCBot
CSHttp
CazoodleBot
CheeseBot
Citoid
Cloud mapping
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
DBLBot
DTS Agent
DatabaseDriverMysqli
Deusu
Devil
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainSigmaCrawler
Ecxi
Exabot
Express WebPictures
ExtractorPro
Ezooms
FDM
Fimap
FlashGet
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Go!Zilla
Go-Ahead-Got-It
Gotit
HTMLparser
HTTrack
Haansoft
HaosouSpider
HonoluluBot
Iblog
Id-search
IlseBot
InfoTekies
InterGET
Iria
Iskanie
IstellaBot
JOC Web Spider
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Lanshanbot
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
MIDown tool
MIIxpc
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NICErsPRO
NPbot
NearSite
Needle
Nessus
NetAnts
Nikto
Not
Octopus
OnCrawl
Openfind
Openvas
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picsearch
Pockey
Probethenet
Psbot
Pu_iN
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
RealDownload
Recorder
RedesScrapy
SBIder
SEOkicks-Robot
SISTRIX
ScanAlert
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteSucker
Sitebeam
SlySearch
SmartDownload
Snake
Sogou web spider
Sosospider
Spammen
SpankBot
Sqworm
Steeler
Stripper
Sucuri
Surfbot
Teleport
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toata
Toweyabot
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
Upflow
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
WPScan
WWW::Mechanize
Web Collage
Web Enhancer
Web Fetch
Web Sauger
Web Sucker
WebBandit
WebCollage
WebStripper
WebSucker
WebWhacker
Webshag
WebsiteQuester
Webster
Whack
Whacker
Who.is Bot
Xaldon_WebSpider
Zade
Zeus
Zitebot
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
clark-crawler
crawl.sogou.com
heritrix
iubenda-radar
lwp-request
netEstate NE Crawler
oBot
plumanalytics
polaris version
probe-image-size
s1z.ru
seocompany.store
seoscanners
seostar
sitechecker.pro
siteripz
sogouspider
sysscan
trendiction.com
webmeup-crawler
x22Mozilla
zgrab