nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-23 22:07:44 +00:00

100 lines
1.1 KiB
Text

404checker
Aboundexbot
Aliyun
Anarchie
Anarchy99
Atomseobot
AwarioBot
BackStreet
Battleztar Bazinga
Bigfoot
BlackWidow
BuiltWith
CCBot
CensysInspect
CherryPicker
ChinaClaw
ClaudeBot
Cliqzbot
Cocolyzebot
Collector
Copier
Crawling at Home Project
CrunchBot
DTS Agent
Dispatch
Domains Project
Dotbot
Dragonfly
ECCP/1.0
Extreme Picture Finder
Fuzz
GPTBot
GT::WWW
GrabNet
HEADMasterSEO
Haansoft
Image Sucker
Internet Ninja
InternetSeer
Iskanie
LWP::Simple
Lanshanbot
Leap
Lftp
LibWeb
Libwhisker
LinksManager
Lmspider
MJ12bot
MQQBrowser
MSFrontPage
MarkWatch
Mata Hari
Mb2345Browser
MegaIndex.ru
Mister PiX
Moblie Safari
Navroad
NetZIP
PHPCrawl
PyCurl
RankActiveLinkBot
RankingBot
Reaper
RepoMonkey
SEOkicks-Robot
SemrushBot-BA
SiteExplorer
Sosospider
Spanner
SputnikBot
Surfbot
Swiftbot
The Intraformant
TheNomad
Turingos
URLy.Warning
Upflow
WWW-Collector-E
WWW-Mechanize
Web Enhancer
Web Pix
WebBandit
WebFuck
WebStripper
WebZIP
Whacker
YaK
YoudaoBot
autoemailspider
backlink-check
com.plumanalytics
dataprovider
eCatch
everyfeed-spider
facebookscraper
s1z.ru
sitechecker.pro
sp_auditbot
tAkeOut