404enemy
80legs
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AIBOT
AlphaBot
arquivo.pt
ASPSeek
Asterias
autoemailspider
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
BDCbot
Blow
Boardreader
BotALot
Calculon
CherryPicker
ChinaClaw
Chlooe
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Cosmos
Craftbot
crawler4j
CrazyWebCrawler
Crescent
Curious
Custo
demandbase-bot
Demon
Deusu
DigitalPebble
DIIbot
Disco
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Dragonfly
Drip
DSearch
DTS Agent
Ebingbong
eCatch
EirGrabber
ExtractorPro
Extreme Picture Finder
facebookscraper
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FrontPage
GalaxyBot
GermCrawler
Getintent
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
GrabNet
GrapeFX
Haansoft
Harvest
Havij
HEADMasterSEO
Hloader
HMView
HTTrack
Humanlinks
IDBot
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
instabid
InterGET
IRLbot
IstellaBot
Jbrofuzz
Jetty
JikeSpider
Jorgee
JustView
Jyxobot
Keyword Density
Kinza
Larbin
LexiBot
Libwhisker
LieBaoFast
Likse
Linkdexbot
LinkScan
Lipperhey Spider
Litemage_walker
lwp-request
LWP::Simple
Mail.RU_Bot
Majestic12
Majestic SEO
MarkWatch
Masscan
Mass Downloader
Meanpathbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MIIxpc
Mojeek
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
muhstik-scan
Name Intelligence
NearSite
Nessus
Netcraft
NetSpider
Nettrack
NetZIP
Nibbler
Nikto
NimbleCrawler
Nutch
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OpenVAS
OPPO A33
OrangeSpider
PageAnalyzer
page scorer
Panscient
Papa Foto
PeoplePal
PHPCrawl
Picscout
Picsearch
PleaseCrawl
plumanalytics
Pockey
ProPowerBot
Psbot
PxBroker
RankActive
RankingBot
RankurBot
RealDownload
Reaper
RebelMouse
Ripper
Rogerbot
RSSingBot
SalesIntelligent
SBIder
ScoutJet
Scrapy
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks
SEOprofiler
serpstatbot
sexsearcher
Siphon
SISTRIX
sitechecker.pro
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SmartDownload
Snoopy
SpaceBison
Spammen
sp_auditbot
Spbot
Sqlworm
Sucker
SuperHTTP
Suzuran
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
Toweyabot
Trendictionbot
trendiction.com
trendiction.de
TurnitinBot
URLy Warning
VCI
VidibleScraper
VoidEYE
Voltron
WBSearchBot
WebAuto
WebBandit
Web Collage
WebEnhancer
WebFetch
Web Fetch
WebFuck
Web Fuck
WebLeacher
webmeup-crawler
Web Sauger
Webshag
Website Quester
Webster
WebStripper
WebSucker
Whatweb
Who.is Bot
WinHTTrack
WISENutbot
Wprecon
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
Zeus