nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-02 22:08:01 +00:00

100 lines
1 KiB
Text

404enemy
80legs
ALittle Client
Aboundex
Alexibot
Alligator
Anarchie
Apexoo
AwarioRssBot
BDFetch
BackWeb
BacklinksExtendedBot
Barkrowler
BlowFish
CODE87
Cegbfeieh
ChinaClaw
Cliqzbot
Cloud mapping
Craftbot
Custo
DTS Agent
Devil
DomainAppender
DomainSigmaCrawler
ExtractorPro
Firefox/7.0
FyberSpider
G-i-g-a-b-o-t
GPTBot
Grabber
Hloader
HonoluluBot
InfoTekies
Kinza
Mail.RU_Bot
Majestic SEO
Masscan
MauiBot
MeanPath Bot
Microsoft URL Control
Musobot
Netcraft
Niki-bot
NimbleCrawler
Ninja
Nuclei
Offline Explorer
OnCrawl
Openfind
OutclicksBot
OutfoxBot
PageThing.com
Panscient
PictureFinder
Pixray
Proximic
Pu_iN
RankurBot
Reaper
Recorder
SEOprofiler
Seekport
SemrushBot-BA
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Sociscraper
Spammen
Szukacz
Trendiction
Trendictionbot
Turingos
URLy Warning
WEBDAV
WPScan
Wallpapers/3.0
Web Sauger
WebGo IS
WebImageCollector
WebZIP
Website Quester
WebsiteExtractor
Whacker
Wprecon
Zauba
Zermelo
ZoomBot
anthropic-ai
awario.com
check1.exe
crawler4j
iubenda-radar
linkdexbot
lwp-request
seostar
tAkeOut
webgains-bot
x22Mozilla