vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2025.08.5396 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2025-08-10 22:08:14 +00:00
parent f678aca419
commit f7ebc1984f
35 changed files with 60848 additions and 60966 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.08.5395 #### Version: V4.2025.08.5396
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.08.5395 #### Version: V4.2025.08.5396
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2025.08.5395 #### Version: V4.2025.08.5396
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10062
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2025.08.5395 #### Version: V4.2025.08.5396
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10066
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10066
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10066
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
5395 5396

10066
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10066
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.161.30.48 0; 64.236.133.177 0;

10066
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.132 0;
127.0.0.1 0; 127.0.0.1 0;

10066
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.132 0;
127.0.0.1 0; 127.0.0.1 0;

10066
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.132 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.132 0;
127.0.0.1 0; 127.0.0.1 0;

10066
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.161.30.48 0; 64.236.133.177 0;

10066
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.161.30.48 0; 64.236.133.177 0;

10066
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 1; 10.1.0.132 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Buck BacklinksExtendedBot
LinqiaRSSBot Curious
MeanPath Bot DnBCrawler-Analytics
LinkextractorPro
NICErsPRO
Netvibes
Pimonster Pimonster
Reaper WebFetch
SentiBot mediawords
SiteLockSpider xpymep1.exe
Spinn3r
T8Abot
polaris version

174
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
Aboundexbot 404enemy
AhrefsBot AIBOT
AiHitBot Aboundex
Aspiegel Aliyun
Bandit Anarchy
Blow BBBike
Buck BackDoorBot
CazoodleBot BackWeb
Citoid BacklinkCrawler
Cogentbot BatchFTP
BetaBot
Black Hole
Blackboard
BuiltBotTough
Bullseye
Calculon
Collector Collector
DBLBot
DIIbot
DSearch DSearch
DTS Agent DataCha0s
Demon DnyzBot
Deusu EroCrawler
Discoverybot ExtLinksBot
DomCopBot FHscan
DomainSigmaCrawler FacebookBot
EMail Siphon FlashGet
EMail Wolf Foobot
Ecxi Freeuploader
Getintent Image Fetch
Gigabot
HTMLparser
Image Sucker
InfoTekies
Intelliseek Intelliseek
JOC Web Spider JOC Web Spider
JamesBOT Kinza
Libwhisker LWP::Simple
LinkextractorPro Lanshanbot
MFC_Tear_Sample LibWeb
MJ12bot Likse
MSFrontPage
MSIECrawler MSIECrawler
Mail.RU_Bot Mag-Net
Majestic-SEO Mozlila
MauiBot Name Intelligence
MeanPath Bot NetAnts
Meanpathbot NetLyzer
Mister PiX Netvibes
Musobot Ninja
NICErsPRO Offline Explorer
NPbot Page Analyzer
OpenVAS PageGrabber
POE-Component-Client-HTTP Pimonster
PageThing.com Pu_iN
Panscient
Petalbot
Pixray
Pockey
Pump
PxBroker PxBroker
PyCurl PyCurl
RankurBot RSSingBot
SEOprofiler RankActive
SenutoBot RankingBot
SiteSnagger ReGet
Siteimprove Rogerbot
Spbot SEOkicks-Robot
SputnikBot SMTBot
Sucuri SalesIntelligent
ScoutJet
SemrushBot-SWA
SentiBot
SeoCherryBot
SeoSiteCheckup
SiteCheckerBotCrawler
Snake
Sociscraper
Spammen
Spider_Bot/3.0
Spinn3r
Sqlmap
SuperHTTP SuperHTTP
Szukacz Toata
Thumbor Twice
Tracemyfile V-BOT
True_Robot Virusdie
TwengaBot VoidEYE
Upflow WASALive-Bot
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WPScan WPScan
Wallpapers Wallpapers
Web Collage WebCopier
Web Fetch
Web Sucker
WebFetch
WebSucker
WebWhacker
WebZIP WebZIP
Website Quester WebmasterWorldForumBot
WebsiteExtractor Webshag
Widow
Wotbox Wotbox
Zade Zitebot
ZoomBot arquivo-web-crawler
cohere-ai arquivo.pt
crawler.feedback autoemailspider
crawler4j imagesift.com
heritrix omgili
lwp-trivial plumanalytics
magpie-crawler s1z.ru
muhstik-scan sp_auditbot
polaris version trendiction.de
ripz voyagerx.com
satoristudio.net webmeup-crawler
scalaj-http webprosbot
sitechecker.pro
x22Mozilla x22Mozilla

18
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cwetochki.ru
domaincdn.xyz domaincdn.xyz
focalink.com dominateforex.ml
letslowbefast.today everytalk.tv
mobile.ok.ru ezigarettenkaufen2.dreamwidth.org
ossmalta.com gsasearchenginerankerdiscount.com
radiogambling.com mmostrike.ru
sitopreferito.it simplesite.com
topkarkas.com svtrd.com
viandpet.com telsis.com
zeroredirect1.com

196
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
7a2rnuey1tw9ar.ru 123kuma.com
adbetclickin.pink 14b.info
adverster.com 6hopping.com
ahrntal.verymes.xyz alta-realestate.com
alborzan.com anal-acrobats.com
allfinweb.com animali.deagostinipassion.it
alloysteel.ru bestmarriages.com
android-systems.ru
aosexkontakte.net
applicationg29.com
automatic-seo.com
avirasecureserver.com
azinoofficial777.ru
bambi.ck.ua
best-seo-solution.com
bestchoice.cf
bigpenisguide.com bigpenisguide.com
bravegirlsclub.com bolitgorlo.net
calcularpagerank.com bookmark4you.com.biz
burger-tycoon.com
canrole.com canrole.com
caulderwoodkennels.com carina-sy.de
cbb1smartlist12.click cdncash.net
chatroulette.si cineacademy.ru
clayvasedesigns.tk cosmeticswomens-womensports.rhcloud.com
cobaltpro.ru designdevise.com
compliance-elena.top discovertreasurenow.com
compliance-george.xyz dostavimvdom.ru
custom-product-labels.com eachdayisagift.review
cutt.us easyshoppermac.com
dstroy.su ekn-art.se
electronicadirect.com electrik-avenue.com
essayassist.com elitesportsadvisor.com
excaliburfilms.com erectile.bid
extener.org este-line.com.ua
ezigarettenkaufen1.pagina.gr fanpagerobot.com
food.dtu.dk free-fbook-traffic.com
forms-mtm.ru fuckmill.com
foto-weinberger.at gaming-journal.com
foxjuegos.com gardene.ru
free-share-buttons.top geoads.com
gemgrab-a.akamaihd.net getprismatic.com
gnuetella.com hdwalls.xyz
greenidesign.co healgastro.com
greenshop.su health-medical-portal.info
guge.io heatpower.ru
hdxnxxtube.mobi hkdiiohi.skyrock.com
healmytrauma.info host-tracker.com
hobbyhuren24.net hut1.ru
hobild.net imitex-plus.ru
howmuchdoestizanidinecost.blogspot.com inbabes.sexushost.com
hydropump.su indo-export.ru
indianmedicaltourismshop.com infobabki.ru
javrip.net jetsli.de
justucalling32211123456789.tk jimmychoosale.online
kamagragelusa.net jobgirl24.ru
keywordsdoctor.com jpcycles.com
komp-pomosch.ru kinobaks.com
lanadelreyfans.us kinozapas.com
linkarena.com koopilka.com
lkbennettstore.online labplus.ru
localmatchbook.com littlecity.ch
misswell.net lollypopgaming.com
muzaporn.com members.ghanaweb.com
myanyone.net mensandals.xyz
myfreemp3.eu michaelkorsoutlet.store
nfljerseysforsalewholesaler.com moscow.xrus.org
normalegal.ru mototsikl.org
ohmyrings.com mtmtv.info
otbelivanie-zubov.com nippon-bearings.ru
pdfprof.com nullrefer.com
pechikamini.ru offer.wpsecurity.website
picanalyzer.data-ox.com omoikiri-japan.ru
pix24x7.com onko-24.com
pizda.lol online-sbank.ru
pkr1hand.com p-business.ru
play-movie.pl paphoselectricianandplumber.com
purplesphere.in park.above.com
pussyspace.net pc-services.ru
registry-clean-up.net poisk-zakona.ru
romhacking.ru popugauka.ru
rossanasaavedra.net portside.cc
scanner-jess.top puteshestvennik.com
searchaddis.com rarbg.to
stpolice.com ruex.org.ua
tizanidinenarcotic.blogspot.com rustic-quiver.win
tizanidineorflexeril.blogspot.com rusvideos.su
topquality.cf sarafangel.ru
traffic-club.info smart-scripts.com
trafficmp.com social-s-iii.xyz
tuberkulezanet.ru socialtrade.biz
url-img.link spravka130.ru
webadvance.club standardchartered-forex.com
webjam.com startwp.org
wedding0venues.tk szucs.ru
wejdz-tu.pl templates.radiodigital.co
xboxster.ru tizanidinehcl2mg.blogspot.com
xmnb.net top10-way.com
xn----ctbigni3aj4h.xn--p1ai truemfilelj.gq
xn--h1aakne2ba.xn--p1ai umaseh.com
yatrk.xyz underthesite.com
us-america.ru
vekzdorov.ru
wallpaperstock.net
x5market.ru
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn--c1acygb.xn--p1ai
zdesformula.ru
zoogdisany.com

958
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,544 +8,426 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml> </html><!DOCTYPE html>
<head><title>503 Service Temporarily Unavailable</title></head> <html>
<body> <head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <title>Welcome to NginX</title>
<hr><center>nginx/1.24.0 (Ubuntu)</center> </head>
</body> <body>
</html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head><title>503 Service Temporarily Unavailable</title></head> <p>This is merely used for testing !!!</p>
<body> </body>
<center><h1>503 Service Temporarily Unavailable</h1></center> </html><!DOCTYPE html>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <html>
</body> <head>
</html> <title>Welcome to NginX</title>
<html> </head>
<head><title>503 Service Temporarily Unavailable</title></head> <body>
<body> <div align=center>
<center><h1>503 Service Temporarily Unavailable</h1></center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <p>This is merely used for testing !!!</p>
</body> </body>
</html> </html><!DOCTYPE html>
<html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head>
<body> <title>Welcome to NginX</title>
<center><h1>503 Service Temporarily Unavailable</h1></center> </head>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <body>
</body> <div align=center>
</html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<!DOCTYPE html> <p>This is merely used for testing !!!</p>
<html> </body>
<head> </html><!DOCTYPE html>
<title>Welcome to NginX</title> <html>
</head> <head>
<body> <title>Welcome to NginX</title>
<div align=center> </head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <body>
<p>This is merely used for testing !!!</p> <div align=center>
</body> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
</html><html> <p>This is merely used for testing !!!</p>
<head><title>503 Service Temporarily Unavailable</title></head> </body>
<body> </html><!DOCTYPE html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <html>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <head>
</body> <title>Welcome to NginX</title>
</html> </head>
<html> <body>
<head><title>503 Service Temporarily Unavailable</title></head> <div align=center>
<body> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<center><h1>503 Service Temporarily Unavailable</h1></center> <p>This is merely used for testing !!!</p>
<hr><center>nginx/1.24.0 (Ubuntu)</center> </body>
</body> </html><!DOCTYPE html>
</html> <html>
<!DOCTYPE html> <head>
<html> <title>Welcome to NginX</title>
<head> </head>
<title>Welcome to NginX</title> <body>
</head> <div align=center>
<body> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<div align=center> <p>This is merely used for testing !!!</p>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> </body>
<p>This is merely used for testing !!!</p> </html><!DOCTYPE html>
</body> <html>
</html><html> <head>
<head><title>503 Service Temporarily Unavailable</title></head> <title>Welcome to NginX</title>
<body> </head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <body>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <div align=center>
</body> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
</html> <p>This is merely used for testing !!!</p>
<!DOCTYPE html> </body>
<html> </html><!DOCTYPE html>
<head> <html>
<title>Welcome to NginX</title> <head>
</head> <title>Welcome to NginX</title>
<body> </head>
<div align=center> <body>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <div align=center>
<p>This is merely used for testing !!!</p> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
</body> <p>This is merely used for testing !!!</p>
</html><html> </body>
<head><title>503 Service Temporarily Unavailable</title></head> </html><!DOCTYPE html>
<body> <html>
<center><h1>503 Service Temporarily Unavailable</h1></center> <head>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <title>Welcome to NginX</title>
</body> </head>
</html> <body>
<!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><!DOCTYPE html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head> <p>This is merely used for testing !!!</p>
<title>Welcome to NginX</title> </body>
</head> </html><!DOCTYPE html>
<body> <html>
<div align=center> <head>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <title>Welcome to NginX</title>
<p>This is merely used for testing !!!</p> </head>
</body> <body>
</html><html> <div align=center>
<head><title>503 Service Temporarily Unavailable</title></head> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<body> <p>This is merely used for testing !!!</p>
<center><h1>503 Service Temporarily Unavailable</h1></center> </body>
<hr><center>nginx/1.24.0 (Ubuntu)</center> </html><!DOCTYPE html>
</body> <html>
</html> <head>
<!DOCTYPE html> <title>Welcome to NginX</title>
<html> </head>
<head> <body>
<title>Welcome to NginX</title> <div align=center>
</head> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<body> <p>This is merely used for testing !!!</p>
<div align=center> </body>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> </html><!DOCTYPE html>
<p>This is merely used for testing !!!</p> <html>
</body> <head>
</html><html> <title>Welcome to NginX</title>
<head><title>503 Service Temporarily Unavailable</title></head> </head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <div align=center>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
</body> <p>This is merely used for testing !!!</p>
</html> </body>
<!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>
</head> </head>
<body> <body>
<div align=center> <div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><html> </html><!DOCTYPE html>
<head><title>503 Service Temporarily Unavailable</title></head> <html>
<body> <head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <title>Welcome to NginX</title>
<hr><center>nginx/1.24.0 (Ubuntu)</center> </head>
</body> <body>
</html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<head><title>503 Service Temporarily Unavailable</title></head> <p>This is merely used for testing !!!</p>
<body> </body>
<center><h1>503 Service Temporarily Unavailable</h1></center> </html><!DOCTYPE html>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <html>
</body> <head>
</html> <title>Welcome to NginX</title>
<!DOCTYPE html> </head>
<html> <body>
<head> <div align=center>
<title>Welcome to NginX</title> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
</head> <p>This is merely used for testing !!!</p>
<body> </body>
<div align=center> </html><!DOCTYPE html>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <html>
<p>This is merely used for testing !!!</p> <head>
</body> <title>Welcome to NginX</title>
</html><html> </head>
<head><title>503 Service Temporarily Unavailable</title></head> <body>
<body> <div align=center>
<center><h1>503 Service Temporarily Unavailable</h1></center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<hr><center>nginx/1.24.0 (Ubuntu)</center> <p>This is merely used for testing !!!</p>
</body> </body>
</html> </html><!DOCTYPE html>
<!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body> </html><!DOCTYPE html>
</html><!DOCTYPE html> <html>
<html> <head>
<head> <title>Welcome to NginX</title>
<title>Welcome to NginX</title> </head>
</head> <body>
<body> <div align=center>
<div align=center> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <p>This is merely used for testing !!!</p>
<p>This is merely used for testing !!!</p> </body>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.24.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.117 0; 10.1.0.132 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.08.5395 ### Version: V4.2025.08.5396
### Updated: Sun Aug 10 10:08:46 UTC 2025 ### Updated: Sun Aug 10 22:04:34 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.08.5395 ### Version: V4.2025.08.5396
### Updated: Sun Aug 10 10:08:46 UTC 2025 ### Updated: Sun Aug 10 22:04:34 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### Version Information ## ### Version Information ##