360Spider
404checker
404enemy
Abonti
Acunetix
ADmantX
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Apexoo
ASPSeek
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Bandit
BDCbot
Bigfoot
Bitacle
Buddy
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CCBot
ChinaClaw
Chlooe
Claritybot
Cliqzbot
coccocbot-web
com.plumanalytics
Copier
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Curious
DataCha0s
DBLBot
Demon
Deusu
Devil
Digincore
Dirbuster
Discobot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
Dragonfly
Drip
DSearch
DTS Agent
eCatch
ECCP/1.0
EMail Siphon
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FrontPage
FyberSpider
GalaxyBot
Genieo
GetRight
GetWeb
Gigabot
G-i-g-a-b-o-t
GoZilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GT::WWW
Haansoft
HaosouSpider
Havij
HTMLparser
Humanlinks
HybridBot
IDBot
Indy Library
Internet Ninja
Iria
IRLbot
JamesBOT
JennyBot
Jetty
JikeSpider
Joomla
JustView
Lanshanbot
LexiBot
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
lwp-request
lwp-trivial
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
MIDown tool
MIIxpc
Mojeek
Morfeus Fucking Scanner
MS Web Services Client Protocol
muhstik-scan
Musobot
Nameprotect
NearSite
Needle
Nessus
Netcraft
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
NetZIP
NICErsPRO
NimbleCrawler
Ninja
Nmap
oBot
Octopus
Offline Explorer
Offline Navigator
OpenVAS
PageAnalyzer
PageGrabber
page scorer
PageScorer
Pavuk
PECL::HTTP
PHPCrawl
Picscout
Picsearch
Pi-Monster
PleaseCrawl
plumanalytics
Probethenet
ProPowerBot
Pump
PxBroker
QueryN Metasearch
RankActive
RankingBot
RealDownload
Reaper
RebelMouse
ReGet
Ripper
RocketCrawler
ScanAlert
ScoutJet
Scrapy
SearchmetricsBot
SemrushBot
SEOkicks
Seomoz
sexsearcher
Sitebeam
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
SlySearch
SMTBot
Snoopy
Sogou web spider
Sottopop
Spammen
sp_auditbot
Spbot
Sqlmap
Steeler
Stripper
Sucuri
SuperBot
Surfbot
Suzuran
Szukacz
T0PHackTeam
tAkeOut
Teleport
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toata
Toweyabot
Tracemyfile
trendiction.com
trendiction.de
True_Robot
UnisterBot
Upflow
URLy.Warning
VB Project
VCI
Virusdie
Voil
WallpapersHD
WBSearchBot
WebEnhancer
Web Fetch
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebReaper
Web Sauger
WebsiteExtractor
Web Sucker
WebWhacker
Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
WWW-Collector-E
WWW-Mechanize
x22Mozilla
YoudaoBot
Zauba
Zeus
zgrab
Zitebot
ZyBorg