360Spider
404enemy
ADmantX
AhrefsBot
AIBOT
AiHitBot
Alexibot
AllSubmitter
archive.org_bot
ASPSeek
autoemailspider
Backlink-Ceck
Bandit
BBBike
BDCbot
BetaBot
BlackWidow
BLEXBot
Boardreader
Bolt
BotALot
Brandwatch
CATExplorador
CazoodleBot
CCBot
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
cognitiveseo
Collector
Copyscape
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
Curious
DataCha0s
DBLBot
demandbase-bot
Deusu
Devil
Digincore
Disco
Discobot
DnyzBot
Dotbot
Dragonfly
DSearch
DTS Agent
EasyDL
Ebingbong
EMail Siphon
Express WebPictures
ExtLinksBot
Ezooms
FemtosearchBot
Firefox/7.0
FyberSpider
Fyrebot
Genieo
GermCrawler
Getintent
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit
Go!Zilla
Grafula
GridBot
GT::WWW
Harvest
Havij
HEADMasterSEO
HTTrack
Humanlinks
HybridBot
Iblog
IDBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
instabid
Intelliseek
Internet Ninja
InternetSeer
Iria
Jbrofuzz
JikeSpider
JustView
Jyxobot
Kenjin Spider
Lanshanbot
Larbin
LeechFTP
LexiBot
Likse
Linkdexbot
LinkextractorPro
LinkScan
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
Magnet
Mag-Net
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
MIDown tool
MJ12bot
MS Web Services Client Protocol
Needle
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetSpider
Netvibes
Nibbler
NICErsPRO
Nimbostratus
Ninja
Nutch
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
PageAnalyzer
Page Analyzer
Panscient
Papa Foto
pcBrowser
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Probethenet
ProPowerBot
QueryN Metasearch
RankActive
RankingBot2
RankurBot
RealDownload
RebelMouse
RepoMonkey
Ripper
s1z.ru
SBIder
Scanbot
scan.lol
Searchestate
SemrushBot
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
sexsearcher
Siphon
SISTRIX
Sitebeam
SiteLockSpider
SiteSucker
Site Sucker
SMTBot
Snake
Snoopy
Sociscraper
Sogou web spider
Sosospider
SpankBot
Spanner
Spinn3r
Sqlmap
Sqworm
Sucker
SurveyBot
sysscan
Szukacz
T8Abot
TeleportPro
Telesoft
TheNomad
Titan
Trendiction
TurnitinBot
TwengaBot
Twice
UnisterBot
URLy Warning
URLy.Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
Voil
Voltron
WallpapersHD
WASALive-Bot
WBSearchBot
WebBandit
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebFuck
Web Fuck
Web Pix
WebReaper
WebSauger
WebsiteExtractor
WebsiteQuester
Web Sucker
WebWhacker
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WISENutbot
Wonderbot
Woobot
Wotbox
WWW-Collector-E
WWWOFFLE
x09Mozilla
x22Mozilla
YoudaoBot
Zauba
Zeus
Zitebot
ZumBot