nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-09 10:15:01 +00:00

100 lines
1.1 KiB
Text

Apexoo
BDFetch
Bandit
BlackWidow
Bolt
Brandprotect
Buddy
ChatGPT-User
Collector
CrunchBot
DTS Agent
Deusu
DomCopBot
Download Wonder
Ebingbong
EirGrabber
Exabot
ExtLinksBot
FemtosearchBot
GetWeb
Getintent
Go!Zilla
GoZilla
HTMLparser
Heritrix
JamesBOT
Jetty
Kinza
LeechGet
Lightspeedsystems
Likse
Lipperhey
Lmspider
MJ12bot
MTRobot
Majestic12
Mass Downloader
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
NPbot
Needle
Net Vampire
NetSpider
Nettrack
Ninja
Offline Explorer
Offline Navigator
Openvas
Petalbot
ProPowerBot
Rankivabot
RedesScrapy
SBIder
SEOprofiler
SISTRIX
SMTBot
Seekport
SemrushBot-BA
SemrushBot-SI
SemrushBot-SWA
Site Sucker
SiteSnagger
Siteimprove
SlySearch
Sociscraper
Sottopop
Spammen
Spbot
Sqlworm
Stripper
Sucker
SuperBot
Suzuran
T0PHackTeam
The Intraformant
Turnitin
Vacuum
Vagabondo
VelenPublicWebCrawler
Wallpapers
Web Auto
Web Enhancer
WebImageCollector
WebZIP
Webster
WiseGuys Robot
YoudaoBot
anthropic-ai
arquivo-web-crawler
cah.io.community
coccocbot
crawl.sogou.com
heritrix
imagesift.com
mediawords
openai
serpstatbot
sitechecker.pro
voyagerx.com