nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-19 22:07:57 +00:00

100 lines
1 KiB
Text

01h4x.com
404enemy
AIBOT
Aboundexbot
AlphaBot
Anarchie
Apexoo
BDCbot
Bitacle
Black Hole
Brandprotect
Bytespider
Calculon
CazoodleBot
Cegbfeieh
CherryPicker
ClaudeBot
Cogentbot
Crescent
Custo
DBLBot
DataCha0s
Digincore
Discobot
DomainStatsBot
Download Wonder
EirGrabber
Foobot
FyberSpider
Getintent
GoZilla
GrapeFX
Heritrix
Hloader
IDBTE4M
IDBot
InfoTekies
Information Security Team InfraSec Scanner
Internet Ninja
InternetMeasurement
JennyBot
Jorgee
JustView
Jyxobot
Kenjin Spider
LeechGet
MSIECrawler
Majestic-SEO
Microsoft URL Control
Msrabot
Nessus
Nibbler
Nmap
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
Page Analyzer
Pi-Monster
PleaseCrawl
Pockey
ProPowerBot
Pu_iN
RSSingBot
RankingBot
RedesScrapy
SEOkicks-Robot
Scrapy
Siteimprove
Spanner
Spider_Bot/3.0
Thumbor
Tracemyfile
TurnitinBot
URLy Warning
VB Project
Virusdie
WWW-Collector-E
Wallpapers
Web Collage
Web Sucker
WebEnhancer
WebLeacher
WebReaper
WebStripper
WebWhacker
Webalta
Widow
Zauba
ZoomBot
ZyBorg
backlink-check
check1.exe
cohere-ai
evc-batch
meanpathbot
plumanalytics
s1z.ru
webmeup-crawler