360Spider
404checker
404enemy
80legs
ADmantX
Aipbot
arquivo.pt
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Badass
Battleztar Bazinga
BDCbot
Blackboard
Black Hole
BlackWidow
BLEXBot
BlowFish
Bolt
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
Cliqzbot
coccocbot-web
cognitiveseo
Collector
Copyscape
Cosmos
CrazyWebCrawler
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
DBLBot
demandbase-bot
Demon
Devil
Digincore
Dirbuster
Disco
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
EirGrabber
EMail Siphon
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
facebookscraper
FHscan
Firefox/7.0
Flunky
Freeuploader
FrontPage
Getintent
GetRight
Gigablast
Gotit
GoZilla
Grabber
Grafula
HEADMasterSEO
Heritrix
Hloader
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
instabid
JennyBot
Joomla
JustView
Jyxobot
Keyword Density
LeechFTP
LieBaoFast
Likse
LinkextractorPro
LinkScan
LinkWalker
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
lwp-request
LWP::Simple
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mass Downloader
MeanPath Bot
mediawords
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
MJ12bot
Mojeek
MSIECrawler
Msrabot
muhstik-scan
Nameprotect
Needle
Netcraft
NetLyzer
NetSpider
Nettrack
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nmap
Nutch
Octopus
Offline Navigator
Openfind
OPPO A33
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageScorer
PeoplePal
Picscout
PictureFinder
Pimonster
Pi-Monster
plumanalytics
POE-Component-Client-HTTP
polaris version
ProWebWalker
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
RedesScrapy
ReGet
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
Scanbot
Searchestate
SearchmetricsBot
SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup
sexsearcher
Shodan
SISTRIX
SiteExplorer
SiteSnagger
SiteSucker
Site Sucker
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Sogou web spider
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucker
Suzuran
Swiftbot
Szukacz
tAkeOut
Telesphoreo
TheNomad
Thumbor
Toata
Trendiction
Trendictionbot
True_Robot
TwengaBot
Typhoeus
UnisterBot
Upflow
URLy.Warning
VB Project
VCI
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
WBSearchBot
WebCollage
WebCopier
WEBDAV
WebFuck
Web Fuck
WebLeacher
Web Sauger
WebsiteQuester
WebSucker
WebWhacker
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
WPScan
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
zgrab
Zitebot
ZmEu
ZumBot