Abonti
Aboundex
Aboundexbot
ADmantX
AhrefsBot
AiHitBot
Aipbot
Alligator
AllSubmitter
AlphaBot
Anarchie
Apexoo
archive.org_bot
autoemailspider
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Badass
Bandit
Barkrowler
BatchFTP
BBBike
BDCbot
BDFetch
BetaBot
Blackboard
Black Hole
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
BuiltWith
Bullseye
BuzzSumo
CazoodleBot
CCBot
CheeseBot
CheTeam
Cliqzbot
Cloud mapping
cognitiveseo
Copier
Cosmos
crawler.feedback
crawl.sogou.com
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Devil
Disco
DittoSpyder
Dotbot
Download Wonder
Dragonfly
DSearch
Ebingbong
ECCP/1.0
evc-batch
ExtLinksBot
Extractor
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GalaxyBot
GermCrawler
Getintent
GetRight
GetWeb
Gigablast
G-i-g-a-b-o-t
GoZilla
Go!Zilla
GrapeshotCrawler
HaosouSpider
HEADMasterSEO
Heritrix
HTTP::Lite
HTTrack
IDBot
IlseBot
Image Fetch
Indy Library
InfoTekies
internetVista monitor
ips-agent
Iskanie
JennyBot
JetCar
JOC Web Spider
Joomla
Jorgee
Jyxobot
LeechFTP
LexiBot
LibWeb
Libwhisker
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Ltx71
lwp-request
LWP::Simple
magpie-crawler
Majestic12
Masscan
Mass Downloader
Mata Hari
Meanpathbot
mediawords
Mister PiX
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Musobot
Name Intelligence
NearSite
Netcraft
NetMechanic
NetSpider
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nikto
Openfind
OpenLinkProfiler
OrangeBot
OutfoxBot
Page Analyzer
PageGrabber
Panscient
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Pimonster
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
Pump
PyCurl
RankActive
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
Ripper
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
SBIder
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
SEOstats
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
SiteLockSpider
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spanner
spyfu
Sqlmap
Sqworm
Sucker
Sucuri
Surfbot
SurveyBot
Suzuran
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
trendiction.com
TurnitinBot
Twice
Upflow
URLy Warning
Vagabondo
VB Project
Virusdie
Voltron
WASALive-Bot
Web Auto
WebBandit
WebCollage
Web Collage
Web Fetch
WebFuck
Web Fuck
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebPix
Webshag
Web Sucker
WebZIP
WiseGuys Robot
Wprecon
WWW-Mechanize
WWW::Mechanize
Xaldon WebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
Zermelo
Zitebot
ZumBot
ZyBorg