nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-19 22:04:50 +00:00

100 lines
1 KiB
Text

AlphaBot
Anthill
AwarioSmartBot
BLEXBot
Bandit
BatchFTP
Black Hole
BotALot
Brandwatch
BuiltBotTough
BuzzSumo
CCBot
Cegbfeieh
CheTeam
Cloud mapping
Crawling at Home Project
Crescent
CyotekWebCopy
Demon
Discoverybot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Firefox/7.0
GPTBot
Genieo
Grabber
Grafula
HaosouSpider
Id-search
Iskanie
JOC Web Spider
Jetty
JikeSpider
LexiBot
LinkScan
Lipperhey
Majestic SEO
Masscan
Metauri
Mister PiX
Mr.4x3
NearSite
Nessus
NetSpider
Netcraft
Nikto
Nmap
OnCrawl
OpenLinkProfiler
OutfoxBot
PageScorer
Panscient
Pavuk
PeoplePal
Picscout
ProPowerBot
ProWebWalker
Rogerbot
SEOlyticsCrawler
SMTBot
Screaming
Semrush
SemrushBot
SiteExplorer
SiteSnagger
Sogou web spider
Spanner
SputnikBot
Steeler
SuperBot
Surfbot
Telesoft
Twice
URLy.Warning
VCI
Vagabondo
WASALive-Bot
WPScan
Web Fetch
WebReaper
WebSucker
Who.is Bot
ZoominfoBot
cah.io.community
cognitiveseo
isitwp.com
lwp-request
magpie-crawler
meanpathbot
openai.com
page scorer
polaris version
probe-image-size
siteripz
sogouspider
sp_auditbot
voyagerx.com
x09Mozilla