360Spider
404enemy
AIBOT
ALittle Client
Abonti
Aipbot
Alexibot
AlphaBot
Anarchy
Ankit
Aspiegel
Asterias
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Blackboard
Brandprotect
BuiltWith
Bullseye
BunnySlippers
CODE87
CherryPicker
Cloud mapping
Cocolyzebot
Copier
Copyscape
Craftbot
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Deusu
Discoverybot
Dispatch
DomainSigmaCrawler
Domains Project
Download Wonder
Drip
ECCP/1.0
EasyDL
Evil
EyeNetIE
Ezooms
FemtosearchBot
FlashGet
Flunky
Foobot
FyberSpider
GalaxyBot
GetWeb
Gigabot
Grabber
HMView
HaosouSpider
Havij
IDBTE4M
IDBot
Id-search
Image Sucker
IndeedBot
Indy Library
InterGET
Internet Ninja
Iria
Jetty
Joomla
Jyxobot
Kenjin Spider
Keyword Density
LWP::Simple
Lanshanbot
Larbin
LeechGet
Lftp
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
MIDown tool
MQQBrowser
MSFrontPage
MSIECrawler
Majestic-SEO
Majestic12
Mb2345Browser
Meanpathbot
MicroMessenger
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Name Intelligence
Net Vampire
NetAnts
NetLyzer
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nmap
Openfind
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Papa Foto
Pavuk
PeoplePal
Petalbot
Picsearch
Piepmatz
Pimonster
ProWebWalker
Pump
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankurBot
Re-re
RealDownload
RebelMouse
Recorder
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
ScanAlert
Scanbot
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch
SmartDownload
Snapbot
Snoopy
Sociscraper
Sogou web spider
SpaceBison
Spammen
SputnikBot
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Swiftbot
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendictionbot
URLy.Warning
Upflow
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Auto
Web Sauger
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebImageCollector
WebReaper
WebSauger
WebStripper
WebSucker
Webshag
WebsiteExtractor
Whacker
Whatweb
Widow
WinHTTrack
Wonderbot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler4j
dataforseo.com
domainsproject.org
facebookscraper
internetVista monitor
ips-agent
iubenda-radar
linkdexbot
meanpathbot
oBot
seocompany.store
seostar
sogouspider
sp_auditbot
sysscan
tAkeOut
voyagerx.com
x09Mozilla
zgrab