nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-17 10:12:25 +00:00

100 lines
1.2 KiB
Text

ASPSeek
Aboundexbot
AdsTxtCrawlerTP
Aipbot
Badass
Barkrowler
Black Hole
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Cegbfeieh
CherryPicker
ChinaClaw
ClaudeBot
CopyRightCheck
DSearch
Discobot
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
Drip
Fimap
Flunky
Fuzz
HaosouSpider
Information Security Team InfraSec Scanner
Intelliseek
JOC Web Spider
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
Libwhisker
Lipperhey Spider
MIDown tool
MSIECrawler
Mail.RU_Bot
Majestic12
MarkWatch
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mozlila
Name Intelligence
Needle
Niki-bot
Ninja
Nmap
Page Analyzer
PageScorer
Papa Foto
Pavuk
PleaseCrawl
ProPowerBot
Probethenet
Pump
RSSingBot
RankActiveLinkBot
SEOlyticsCrawler
SalesIntelligent
Scanbot
Scrapy
SeekportBot
Semrush
SemrushBot-FT
SemrushBot-OCOB
SentiBot
SenutoBot
SiteSnagger
Sociscraper
SpankBot
Steeler
Suzuran
True_Robot
WASALive-Bot
WebWhacker
Webshag
Website Quester
Wotbox
Xaldon_WebSpider
arquivo.pt
autoemailspider
crawler.feedback
dataforseobot
gopher
iubenda-radar
lwp-trivial
meanpathbot
ripz
scalaj-http
seobility
siteripz
voyagerx.com
webgains-bot
webmeup-crawler