360Spider
404checker
404enemy
80legs
Aboundex
ADmantX
AIBOT
Aipbot
Alexibot
archive.org_bot
ASPSeek
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Bandit
BatchFTP
BBBike
BDFetch
Bigfoot
Black Hole
BlackWidow
BotALot
Brandwatch
Buddy
BuiltWith
BuzzSumo
Calculon
Cegbfeieh
CherryPicker
ChinaClaw
Claritybot
coccocbot-web
Collector
CopyRightCheck
Cosmos
Craftbot
crawler4j
crawl.sogou.com
DataCha0s
DBLBot
demandbase-bot
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
EasyDL
ECCP/1.0
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
FHscan
Fimap
FyberSpider
Fyrebot
Getintent
GetWeb
Go-Ahead-Got-It
Gotit
GrabNet
GridBot
GT::WWW
Haansoft
HaosouSpider
HEADMasterSEO
Heritrix
HMView
HTTrack
Humanlinks
Iblog
Id-search
IlseBot
IndeedBot
InfoTekies
instabid
Intelliseek
IRLbot
JikeSpider
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
LNSpiderguy
Ltx71
lwp-request
Mass Downloader
Mata Hari
meanpathbot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Navroad
Nessus
NetLyzer
NetSpider
Netvibes
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Ninja
Nmap
Nutch
Octopus
Openfind
Openvas
OpenVAS
OrangeSpider
OutfoxBot
PageGrabber
page scorer
Papa Foto
Pavuk
pcBrowser
PeoplePal
Picsearch
Pimonster
Pi-Monster
plumanalytics
Psbot
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
Rogerbot
ScanAlert
Scanbot
scan.lol
Screaming
Searchestate
Semrush
SEOkicks-Robot
SEOprofiler
SeoSiteCheckup
SISTRIX
Siteimprove
SiteLockSpider
SmartDownload
SocialRankIOBot
Sociscraper
SpaceBison
SpankBot
sp_auditbot
Spbot
SputnikBot
spyfu
Sqworm
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
sysscan
T0PHackTeam
tAkeOut
Teleport
TeleportPro
The Intraformant
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
TwengaBot
Twice
URLy Warning
URLy.Warning
Vagabondo
VidibleScraper
Virusdie
WallpapersHD
WBSearchBot
Webalta
WebAuto
Web Auto
WEBDAV
WebFetch
WebFuck
Web Fuck
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebSauger
Webshag
WebsiteQuester
Webster
WebSucker
Web Sucker
WebZIP
WeSEE
Whatweb
WinHTTrack
WISENutbot
Woobot
Wprecon
WWW-Collector-E
WWW-Mechanize
x09Mozilla
Xenu
xpymep1.exe
Zauba