AhrefsBot
Alligator
AllSubmitter
Anarchie
Anarchy
Anarchy99
Ankit
archive.org_bot
arquivo-web-crawler
Asterias
Attach
autoemailspider
AwarioSmartBot
backlink-check
BackStreet
BDCbot
Blackboard
BLEXBot
BlowFish
Boardreader
Bolt
Buddy
BuiltBotTough
Bullseye
CazoodleBot
CensysInspect
CheeseBot
CheTeam
Cloud mapping
CODE87
cognitiveseo
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
Crescent
CrunchBot
Custo
CyotekWebCopy
DBLBot
demandbase-bot
Deusu
Digincore
DigitalPebble
DomainCrawler
DomainSigmaCrawler
Domains Project
domainsproject.org
DomainStatsBot
Dotbot
DSearch
EasyDL
Ebingbong
eCatch
Ecxi
EirGrabber
EMail Wolf
Evil
ExtLinksBot
ExtractorPro
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Getintent
GetRight
G-i-g-a-b-o-t
Gotit
Grafula
Haansoft
HEADMasterSEO
heritrix
Heritrix
Hloader
HTMLparser
HTTP::Lite
Humanlinks
HybridBot
Iblog
IDBot
IlseBot
IndeedBot
internetVista monitor
Iskanie
JamesBOT
Jbrofuzz
JikeSpider
Jorgee
Kinza
Lftp
Libwhisker
LinkextractorPro
LinkpadBot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Ltx71
lwp-request
magpie-crawler
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
Mata Hari
Mb2345Browser
meanpathbot
MeanPath Bot
MicroMessenger
Microsoft Data Access
MIDown tool
Mojolicious
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
Msrabot
muhstik-scan
Name Intelligence
Netcraft
netEstate NE Crawler
NetLyzer
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Niki-bot
Ninja
Nmap
Nutch
oBot
Offline Explorer
OnCrawl
OPPO A33
OrangeBot
OrangeSpider
PageAnalyzer
Pandalytics
Panscient
Picsearch
PictureFinder
Pimonster
Pixray
plumanalytics
Pockey
POE-Component-Client-HTTP
polaris version
Probethenet
Quick-Crawler
RankFlex
Rankivabot
Reaper
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
RSSingBot
SBIder
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SEOkicks
Seomoz
sexsearcher
Siphon
SISTRIX
Sitebeam
sitechecker.pro
SlySearch
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
sp_auditbot
Spbot
Spinn3r
Sqlmap
Stripper
SurveyBot
T8Abot
Teleport
Telesoft
Telesphorep
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
trendiction.de
True_Robot
Turnitin
UnisterBot
URLy.Warning
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
WASALive-Bot
WebCollage
WEBDAV
Web Fetch
WebFuck
Web Fuck
WebImageCollector
webmeup-crawler
WebReaper
WebsiteQuester
WebSucker
Web Sucker
Whack
Whatweb
Who.is Bot
Widow
WISENutbot
Wonderbot
Woobot
Wprecon
WPScan
WWW-Collector-E
xpymep1.exe
YoudaoBot
Zauba
Zeus
zgrab
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZyBorg