360Spider
404enemy
Abonti
Aboundex
ADmantX
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
ASPSeek
backlink-check
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Bitacle
Black Hole
Blow
Boardreader
BotALot
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
coccocbot-web
Cogentbot
Collector
com.plumanalytics
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
Curious
Custo
Demon
Deusu
Devil
Digincore
Dirbuster
Disco
Dispatch
DnyzBot
DomainCrawler
Dragonfly
DSearch
Ebingbong
EirGrabber
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FemtosearchBot
FHscan
Firefox/7.0
FyberSpider
Fyrebot
GalaxyBot
GetRight
GetWeb
Gigablast
Gigabot
Gotit
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
GridBot
HaosouSpider
Havij
HTMLparser
HTTP::Lite
HTTrack
Iblog
IDBot
Image Fetch
Indy Library
InfoTekies
instabid
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
JamesBOT
JetCar
Jetty
JikeSpider
JOC Web Spider
JustView
Kozmosbot
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinkpadBot
LinksManager
LinkWalker
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan
meanpathbot
Meanpathbot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft URL Control
Mister PiX
Mojeek
MSFrontPage
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
NearSite
NetAnts
netEstate NE Crawler
NetLyzer
NetSpider
Net Vampire
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Ninja
Nmap
Nutch
Octopus
Offline Explorer
OnCrawl
OutfoxBot
PageAnalyzer
Pandalytics
Pavuk
pcBrowser
PECL::HTTP
Picsearch
Pimonster
Pi-Monster
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot2
Rankivabot
RankurBot
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SBIder
scan.lol
Scrapy
ScreenerBot
SemrushBot
SEOkicks
Seomoz
SEOstats
sexsearcher
Siphon
Siteimprove
SiteLockSpider
Sitevigil
SMTBot
Snapbot
Snoopy
Sociscraper
sogouspider
SpaceBison
Spammen
sp_auditbot
spyfu
Sqworm
Stripper
Sucuri
Suzuran
T0PHackTeam
T8Abot
Telesoft
The Intraformant
Thumbor
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Upflow
URLy Warning
URLy.Warning
Vacuum
Virusdie
VoidEYE
Voil
Voltron
WebBandit
WebCollage
Web Collage
Web Enhancer
WebFuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebReaper
WebSauger
WebStripper
Web Sucker
WeSEE
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
WISENutbot
Woobot
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xenu
YoudaoBot
Zeus
zgrab
Zitebot
ZyBorg