80legs
Abonti
Aboundex
ADmantX
AhrefsBot
AiHitBot
Alexibot
Alligator
Apexoo
Asterias
backlink-check
BacklinkCrawler
BackStreet
Barkrowler
BBBike
BDCbot
BetaBot
Blackboard
Black Hole
BlowFish
Boardreader
Brandwatch
BuiltBotTough
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Cloud mapping
coccocbot-web
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Custo
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Devil
Discobot
Discoverybot
Dispatch
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DSearch
ECCP/1.0
Ecxi
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Genieo
Go-Ahead-Got-It
Gotit
Go!Zilla
Grabber
GrabNet
GrapeshotCrawler
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
Hloader
HMView
HTMLparser
Humanlinks
HybridBot
Id-search
IlseBot
Indy Library
InfoTekies
instabid
InterGET
internetVista monitor
ips-agent
Iria
IRLbot
JennyBot
Jetty
Jorgee
JustView
Jyxobot
Lftp
LibWeb
LinkextractorPro
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
lwp-request
LWP::Simple
magpie-crawler
Mail.RU_Bot
Majestic SEO
Masscan
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Meanpathbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
Name Intelligence
Navroad
Needle
NetAnts
NetLyzer
NetSpider
Net Vampire
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Nikto
Nimbostratus
Ninja
Nmap
NPbot
Nutch
oBot
Offline Navigator
OpenLinkProfiler
OrangeSpider
OutfoxBot
PageAnalyzer
page scorer
PageScorer
Panscient
pcBrowser
PECL::HTTP
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
Pockey
ProPowerBot
ProWebWalker
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankFlex
RankingBot
Rankivabot
RankurBot
Recorder
RedesScrapy
RocketCrawler
s1z.ru
SalesIntelligent
ScanAlert
Scrapy
Searchestate
SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
Shodan
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
SlySearch
SMTBot
Snapbot
Sogou web spider
Sottopop
SpaceBison
Spammen
Spanner
sp_auditbot
Spbot
Sqlmap
Sucker
Swiftbot
sysscan
Szukacz
tAkeOut
TeleportPro
The Intraformant
TheNomad
Titan
Toata
Tracemyfile
Trendictionbot
trendiction.com
Turingos
Turnitin
TwengaBot
Twice
Typhoeus
UnisterBot
URLy Warning
URLy.Warning
VB Project
WallpapersHD
WBSearchBot
WebAuto
Web Collage
WebEnhancer
Web Enhancer
WebZIP
Whatweb
WiseGuys Robot
WISENutbot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Xaldon WebSpider
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zitebot