80legs
Aboundex
Aboundexbot
AhrefsBot
AIBOT
Alexibot
AlphaBot
archive.org_bot
Asterias
BackStreet
Bandit
BDFetch
Bigfoot
Blackboard
Boardreader
Bolt
Buddy
BuiltBotTough
Bullseye
Calculon
CATExplorador
CCBot
Cegbfeieh
CheTeam
Chlooe
Claritybot
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Copyscape
Craftbot
crawl.sogou.com
CrunchBot
Curious
Custo
DataCha0s
Deusu
Devil
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DTS Agent
Ebingbong
ECCP/1.0
Ecxi
EMail Wolf
EroCrawler
Exabot
ExtractorPro
FDM
FHscan
Firefox/7.0
Freeuploader
FrontPage
Genieo
GermCrawler
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Gotit
GoZilla
Go!Zilla
GrabNet
Grafula
GridBot
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HMView
HTTP::Lite
Humanlinks
IDBot
Id-search
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
instabid
InternetSeer
IRLbot
JennyBot
JetCar
Jetty
JikeSpider
Joomla
Lanshanbot
Larbin
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LinqiaScrapeBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
Magnet
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mata Hari
Meanpathbot
MeanPath Bot
MegaIndex.ru
MFC_Tear_Sample
MIDown tool
Mister PiX
Mr.4x3
MS Web Services Client Protocol
muhstik-scan
Nameprotect
Navroad
NearSite
Needle
NetLyzer
NetMechanic
NetSpider
Net Vampire
Niki-bot
Nmap
NPbot
oBot
Offline Explorer
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
PageAnalyzer
PageScorer
Panscient
PECL::HTTP
Picscout
Picsearch
PictureFinder
Pi-Monster
plumanalytics
POE-Component-Client-HTTP
Pump
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2
RealDownload
Recorder
ReGet
RepoMonkey
Rogerbot
s1z.ru
SBIder
ScanAlert
Scanbot
scan.lol
ScreenerBot
SEOkicks
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
Shodan
Siphon
SISTRIX
SiteLockSpider
Site Sucker
SlySearch
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Spammen
Spanner
sp_auditbot
Spbot
Sqlmap
Sqlworm
Sqworm
Sucker
Sucuri
sysscan
T0PHackTeam
tAkeOut
Teleport
TeleportPro
Telesphorep
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
True_Robot
TurnitinBot
Twice
Typhoeus
Upflow
URLy.Warning
VCI
VidibleScraper
VoidEYE
WallpapersHD
WASALive-Bot
WBSearchBot
WebCollage
WebEnhancer
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebPix
WebReaper
WebSauger
WebsiteExtractor
WebsiteQuester
Webster
WebStripper
WebZIP
WeSEE
Whacker
WiseGuys Robot
WISENutbot
Woobot
Wotbox
Wprecon
WPScan
WWW-Collector-E
Xaldon_WebSpider
Xenu
Zade
Zermelo
zgrab
ZmEu
ZumBot