360Spider
404checker
404enemy
AIBOT
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
backlink-check
BacklinkCrawler
BackStreet
BackWeb
Bandit
Battleztar Bazinga
BBBike
BetaBot
Bigfoot
Blackboard
BlackWidow
BLEXBot
Blow
BlowFish
BotALot
Brandwatch
Buddy
BuiltWith
CCBot
Cegbfeieh
CheeseBot
CheTeam
Cliqzbot
Cloud mapping
Cogentbot
cognitiveseo
com.plumanalytics
Copyscape
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CSHttp
Curious
Demon
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
Download Wonder
DSearch
DTS Agent
EasyDL
Ebingbong
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Extractor
Ezooms
Firefox/7.0
FlashGet
Fyrebot
GetRight
GetWeb
Gigablast
G-i-g-a-b-o-t
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GT::WWW
Havij
HEADMasterSEO
heritrix
Heritrix
HTMLparser
Humanlinks
HybridBot
Iblog
Id-search
Image Sucker
IndeedBot
instabid
Intelliseek
Internet Ninja
internetVista monitor
ips-agent
IRLbot
Iskanie
JennyBot
JikeSpider
JOC Web Spider
Jorgee
Lightspeedsystems
Likse
LinkextractorPro
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
lwp-request
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkWatch
Mata Hari
MauiBot
meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
MSFrontPage
Msrabot
muhstik-scan
Name Intelligence
Nessus
NetLyzer
NetMechanic
NetSpider
NICErsPRO
Niki-bot
NimbleCrawler
Ninja
oBot
Octopus
OpenLinkProfiler
Openvas
OPPO A33
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
Pimonster
PleaseCrawl
Pockey
polaris version
Probethenet
Psbot
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2
Recorder
Ripper
Rogerbot
s1z.ru
ScanAlert
Scanbot
scan.lol
ScoutJet
Screaming
SearchmetricsBot
Semrush
SEOkicks
Seomoz
SEOprofiler
SeoSiteCheckup
SEOstats
sexsearcher
Sitebeam
SiteExplorer
Site Sucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sociscraper
sogouspider
Sosospider
sp_auditbot
Spinn3r
Sqlworm
Sqworm
Steeler
Sucker
Surfbot
sysscan
T0PHackTeam
T8Abot
Teleport
Telesphoreo
Telesphorep
TightTwatBot
Trendictionbot
True_Robot
Typhoeus
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
Web Auto
WebBandit
WebCollage
WebFetch
Web Fuck
WebImageCollector
WebLeacher
webmeup-crawler
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
Website Quester
WebStripper
Web Sucker
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
x09Mozilla
YoudaoBot
Zade
Zermelo
Zeus
zgrab
ZumBot
ZyBorg