nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-03 22:04:56 +00:00

100 lines
1 KiB
Text

404enemy
Aboundexbot
Aspiegel
Asterias
BDFetch
Badass
BatchFTP
BlackWidow
BuiltBotTough
BuzzSumo
CazoodleBot
Chlooe
Citoid
Copier
CopyRightCheck
Copyscape
DIIbot
DataCha0s
Devil
Disco
Domains Project
Ecxi
Exabot
Extractor
FDM
FrontPage
Fyrebot
GetRight
Getintent
HTMLparser
HaosouSpider
HonoluluBot
Humanlinks
IDBTE4M
Iria
JOC Web Spider
Joomla
Kozmosbot
Leap
LinkextractorPro
LinksManager
LinqiaRSSBot
MIIxpc
MJ12bot
Mb2345Browser
MegaIndex.ru
Morfeus Fucking Scanner
Name Intelligence
Needle
NetMechanic
Netcraft
Nimbostratus
Ninja
OpenLinkProfiler
OutclicksBot
PHPCrawl
PageAnalyzer
Pavuk
Pimonster
RankingBot
Rankivabot
RepoMonkey
SEOlyticsCrawler
Scanbot
ScoutJet
SeoSiteCheckup
Shodan
Sosospider
Spanner
Sucuri
SurveyBot
Suzuran
TeleportPro
Thumbor
True_Robot
Turingos
Upflow
Vacuum
VoidEYE
WEBDAV
WPScan
WWW-Collector-E
WebFetch
WebReaper
WebsiteExtractor
Webster
Whacker
Woobot
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
eCatch
internetVista monitor
muhstik-scan
pcBrowser
sexsearcher
sp_auditbot
sysscan