360Spider
80legs
ADmantX
AIBOT
Abonti
Aboundexbot
Acunetix
AllSubmitter
AlphaBot
Anarchy
Anthill
Apexoo
Asterias
Atomseobot
AwarioRssBot
BBBike
BLEXBot
BackStreet
BackWeb
Bandit
Barkrowler
Black Hole
Blackboard
Boardreader
BuiltWith
Bullseye
CCBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Chlooe
Citoid
Copier
Copyscape
Cosmos
CrazyWebCrawler
Crescent
DSearch
DTS Agent
DataCha0s
Demon
Devil
Digincore
Discobot
Dispatch
DittoSpyder
DomainStatsBot
ECCP/1.0
EasyDL
EirGrabber
EroCrawler
Evil
Exabot
Extractor
Extreme Picture Finder
Ezooms
FHscan
FlashGet
Foobot
GT::WWW
GermCrawler
GetWeb
GrabNet
GrapeFX
GridBot
HTMLparser
HTTP::Lite
Haansoft
Harvest
Hloader
HonoluluBot
IRLbot
Id-search
InfoNaviRobot
InternetSeer
Iskanie
JOC Web Spider
Jbrofuzz
Joomla
Jyxobot
Kenjin Spider
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
LeechGet
Lftp
Likse
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
MTRobot
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Minefield
Mojeek
Mojolicious
NICErsPRO
Nameprotect
Navroad
Needle
Netcraft
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nmap
Not
Octopus
Offline Navigator
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Pandalytics
Pavuk
PeoplePal
Petalbot
PictureFinder
Piepmatz
ProPowerBot
Probethenet
Psbot
Pu_iN
Pump
PxBroker
Quick-Crawler
RankingBot
RankingBot2
RankurBot
Re-re
Reaper
RepoMonkey
Ripper
Rogerbot
SBIder
SEOstats
SalesIntelligent
Scanbot
Scrapy
ScrepyBot
SearchmetricsBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sitevigil
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Sqlworm
Steeler
Stripper
Sucuri
Swiftbot
Szukacz
T0PHackTeam
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
True_Robot
Turingos
Twice
Typhoeus
URLy Warning
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
WallpapersHD
Web Collage
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebCollage
WebCopier
WebFuck
WebGo IS
WebLeacher
WebStripper
WebSucker
WebWhacker
WebZIP
WebsiteExtractor
WebsiteQuester
Whacker
Wprecon
Xaldon WebSpider
YoudaoBot
ZmEu
ZoomBot
adscanner
archive.org_bot
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
heritrix
instabid
lwp-request
magpie-crawler
mediawords
page scorer
probe-image-size
s1z.ru
satoristudio.net
seobility
seocompany.store
seostar
sitechecker.pro
sogouspider
sp_auditbot
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io
zgrab