nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-03 22:08:06 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Abonti
AhrefsBot
AiHitBot
Alexibot
AwarioSmartBot
BDCbot
BlackWidow
Brandprotect
Bytespider
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Cocolyzebot
DatabaseDriverMysqli
Deusu
Devil
Disco
DomainSigmaCrawler
Dragonfly
EroCrawler
Evil
FDM
Flunky
GalaxyBot
GrapeshotCrawler
Hloader
HybridBot
JOC Web Spider
JamesBOT
JetCar
LexiBot
Lightspeedsystems
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Masscan
MeanPath Bot
Metauri
Microsoft URL Control
Minefield
Mozlila
Msrabot
Name Intelligence
Nameprotect
Net Vampire
NetSpider
Pavuk
PeoplePal
Pockey
ProPowerBot
RSSingBot
RankingBot
RankurBot
Reaper
SEOkicks
SalesIntelligent
SemrushBot
SemrushBot-SWA
SeoSiteCheckup
SeobilityBot
SiteExplorer
Sitebeam
Sitevigil
Sottopop
Spammen
Spider_Bot
Sucker
SuperBot
Surfbot
T8Abot
Telesphorep
TheNomad
Tracemyfile
URLy.Warning
VoidEYE
Web Fetch
Web Sauger
WebsiteQuester
WinHTTrack
Woobot
Wotbox
Xaldon WebSpider
Zitebot
ZoomBot
anthropic-ai
backlink-check
coccocbot
cohere-ai
eCatch
evc-batch
heritrix
iubenda-radar
plumanalytics
probe-image-size
satoristudio.net
ubermetrics-technologies.com
x09Mozilla
x22Mozilla