360Spider
AhrefsBot
AIBOT
Alexibot
AlphaBot
Anarchie
archive.org_bot
ASPSeek
Asterias
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
Badass
Battleztar Bazinga
BBBike
Bigfoot
Bitacle
Blackboard
Black Hole
BlackWidow
Boardreader
Brandprotect
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
CherryPicker
CheTeam
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
com.plumanalytics
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DataCha0s
DBLBot
demandbase-bot
Devil
Digincore
DIIbot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Drip
DSearch
eCatch
ECCP/1.0
Ecxi
evc-batch
Evil
Exabot
Extractor
facebookscraper
FHscan
Firefox/7.0
FlashGet
FyberSpider
Genieo
Gotit
Go!Zilla
GrabNet
Grafula
GrapeFX
Haansoft
Harvest
Havij
Hloader
HMView
HTMLparser
HTTP::Lite
Humanlinks
HybridBot
Image Fetch
Indy Library
InfoNaviRobot
InterGET
IRLbot
Iskanie
Jbrofuzz
JennyBot
Jetty
JOC Web Spider
JustView
Jyxobot
Lanshanbot
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
LNSpiderguy
lwp-request
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
mediawords
Microsoft URL Control
MIDown tool
Mojeek
Mr.4x3
MSIECrawler
NearSite
NetLyzer
NetMechanic
NetSpider
Nettrack
Netvibes
NextGenSearchBot
NICErsPRO
Niki-bot
NimbleCrawler
Ninja
Nutch
oBot
Octopus
Offline Navigator
OnCrawl
Openfind
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
Pandalytics
Pavuk
pcBrowser
PictureFinder
Pimonster
Pixray
ProPowerBot
Psbot
PyCurl
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
ReGet
RSSingBot
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
ScoutJet
Screaming
Searchestate
SearchmetricsBot
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
Siphon
Sitebeam
SiteExplorer
SiteSucker
Site Sucker
SMTBot
Snake
Snoopy
SocialRankIOBot
sogouspider
Spammen
SpankBot
Spanner
Sqlmap
Sqlworm
Sqworm
Steeler
Sucker
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
tAkeOut
Telesoft
Telesphoreo
The Intraformant
Toata
Toweyabot
Trendiction
trendiction.com
True_Robot
TurnitinBot
Typhoeus
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WBSearchBot
WebCollage
WebCopier
WEBDAV
Web Enhancer
WebFetch
WebFuck
WebLeacher
webmeup-crawler
WebPix
WebReaper
Web Sauger
Webshag
WebsiteQuester
Webster
WebZIP
Who.is Bot
Widow
WiseGuys Robot
WISENutbot
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
YoudaoBot
Zade
zauba.io
Zermelo
ZyBorg