80legs
Aboundex
AhrefsBot
Aipbot
Alligator
AlphaBot
archive.org_bot
ASPSeek
Asterias
autoemailspider
backlink-check
BackStreet
BackWeb
Badass
Bandit
Battleztar Bazinga
BBBike
BDFetch
Bigfoot
BlackWidow
BLEXBot
Boardreader
Bolt
Brandprotect
Bullseye
BuzzSumo
CCBot
CheeseBot
CheTeam
ChinaClaw
Cliqzbot
Cogentbot
cognitiveseo
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
DBLBot
Demon
Digincore
DigitalPebble
DIIbot
Disco
Discobot
Dispatch
DnyzBot
DomainCrawler
Drip
DSearch
DTS Agent
EasyDL
ECCP/1.0
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
EyeNetIE
Ezooms
facebookscraper
FDM
FemtosearchBot
Firefox/7.0
Fyrebot
GalaxyBot
GermCrawler
Getintent
Go-Ahead-Got-It
Grabber
GrabNet
Grafula
GrapeFX
HEADMasterSEO
Hloader
HMView
HTTrack
Humanlinks
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
instabid
Intelliseek
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
Jetty
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Lanshanbot
Lightspeedsystems
Likse
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
Ltx71
lwp-request
lwp-trivial
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Meanpathbot
Mediatoolkitbot
mediawords
MFC_Tear_Sample
Microsoft URL Control
Mister PiX
Mojeek
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Musobot
Name Intelligence
NetSpider
NextGenSearchBot
Niki-bot
Nmap
NPbot
Nutch
OnCrawl
Openfind
Openvas
Page Analyzer
PageScorer
Papa Foto
Pavuk
pcBrowser
PeoplePal
PictureFinder
Pimonster
Pockey
ProWebWalker
Psbot
PxBroker
Quick-Crawler
RankFlex
RankingBot
Rankivabot
Reaper
RebelMouse
Recorder
RedesScrapy
Ripper
RocketCrawler
SalesIntelligent
SBIder
ScanAlert
Scanbot
scan.lol
Scrapy
ScreenerBot
SemrushBot
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
Siphon
SISTRIX
Sitebeam
SiteExplorer
Site Sucker
SlySearch
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
SpaceBison
Spammen
SpankBot
Spanner
sp_auditbot
spyfu
Steeler
Sucuri
SurveyBot
Suzuran
sysscan
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Titan
Trendictionbot
trendiction.de
True_Robot
TurnitinBot
Twice
Typhoeus
UnisterBot
URLy Warning
Vacuum
Vagabondo
VCI
Virusdie
VoidEYE
Wallpapers/3.0
WASALive-Bot
WBSearchBot
Webalta
WebBandit
WEBDAV
WebmasterWorldForumBot
Web Pix
WebReaper
Webshag
WebsiteExtractor
Webster
WebSucker
WebWhacker
WebZIP
Whatweb
Widow
WinHTTrack
WISENutbot
Wonderbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Zade
Zermelo
Zitebot
ZmEu
ZyBorg