vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.04.4454 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-04-24 12:19:07 +00:00
parent 292a160c22
commit 807c11a8fe
33 changed files with 304 additions and 241 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4453 #### Version: V4.2024.04.4454
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4453 #### Version: V4.2024.04.4454
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.04.4453 #### Version: V4.2024.04.4454
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.04.4453 #### Version: V4.2024.04.4454
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

11
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4453 ### Version: V3.2024.04.4454
### Updated: Wed Apr 24 10:04:23 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -18973,6 +18973,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -18985,6 +18986,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

11
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4453 4454

4
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4453 ### Version: V3.2024.04.4454
### Updated: Wed Apr 24 10:04:23 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################

4
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.75.95.244 0; 172.183.132.30 0;

11
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.10 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.10 0;
127.0.0.1 0; 127.0.0.1 0;

11
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.10 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.10 0;
127.0.0.1 0; 127.0.0.1 0;

11
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.10 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.10 0;
127.0.0.1 0; 127.0.0.1 0;

11
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.75.95.244 0; 172.183.132.30 0;

11
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.75.95.244 0; 172.183.132.30 0;

11
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:22 UTC 2024 ### Updated: Wed Apr 24 12:15:26 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19350,6 +19350,7 @@ geo $ratelimited {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr;
} }
# -------------------------- # --------------------------
@ -19362,6 +19363,12 @@ geo $ratelimited {
limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m; limit_conn_zone $bot_iplimit zone=bot2_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s; limit_req_zone $bot_iplimit zone=bot2_reqlimitip:16m rate=2r/s;
# BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS
# ========================================== # ==========================================

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.10 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BlackWidow BBBike
Heritrix BDFetch
Joomla CazoodleBot
LinkpadBot Haansoft
LinqiaRSSBot IlseBot
Mata Hari LeechFTP
OrangeSpider OrangeBot
SearchmetricsBot Site Sucker
Wprecon Telesoft
sexsearcher WebCollage

160
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
404enemy ALittle Client
Aboundex Acunetix
Aipbot Aipbot
Asterias Anthill
Attach AwarioBot
BackWeb Black Hole
BlackWidow BlackWidow
Blow BotALot
Bolt Buck
BuiltBotTough
BuiltWith BuiltWith
CATExplorador CSHttp
CheTeam Crawling at Home Project
Chlooe CrunchBot
Claritybot CyotekWebCopy
Collector DnBCrawler-Analytics
Copier DomCopBot
Crescent Exabot
DittoSpyder
EMail Wolf
ExtLinksBot ExtLinksBot
FacebookBot GalaxyBot
GrabNet Go!Zilla
GridBot Go-Ahead-Got-It
Humanlinks Grafula
HybridBot HTMLparser
IDBot Haansoft
Intelliseek Heritrix
InternetSeer IDBTE4M
Iskanie InfoNaviRobot
Jetty
Joomla Joomla
Jyxobot Kenjin Spider
Keyword Density
LWP::Simple LWP::Simple
LeechFTP LibWeb
Libwhisker
Lightspeedsystems Lightspeedsystems
MIIxpc MIDown tool
MJ12bot MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
MarkWatch Masscan
Mister PiX Mata Hari
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Msrabot Msrabot
NPbot NPbot
NetSpider Net Vampire
Netvibes Netcraft
Pimonster PeoplePal
Picsearch
Piepmatz
PleaseCrawl
ProPowerBot
ProWebWalker ProWebWalker
Psbot ReGet
QueryN Metasearch Scrapy
RSSingBot SenutoBot
RankActiveLinkBot Site Sucker
RankFlex SiteCheckerBotCrawler
Rankivabot SiteExplorer
Reaper SiteSucker
Recorder
Rogerbot
SEOprofiler
SEOstats
ScreenerBot
SearchmetricsBot
SentiBot
Shodan
Sitevigil Sitevigil
Snake Snake
SocialRankIOBot
Sottopop Sottopop
Spbot Spanner
Spinn3r
Sqworm Sqworm
T8Abot Steeler
The Intraformant SuperBot
Titan SurveyBot
TwengaBot Thumbor
VelenPublicWebCrawler Toata
VoidEYE TurnitinBot
WBSearchBot URLy.Warning
Wallpapers UnisterBot
Wallpapers/3.0 Voil
Web Sucker Voltron
WebBandit WWW-Mechanize
WebFetch Web Fetch
WebPix WebLeacher
WebSauger WebmasterWorldForumBot
Webalta WebsiteQuester
WebsiteExtractor Woobot
Xaldon_WebSpider Wprecon
Zitebot Xenu
ZoominfoBot Zeus
ZoomBot
ZyBorg ZyBorg
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider
cohere-ai
com.plumanalytics com.plumanalytics
gopher heritrix
imagesift.com internetVista monitor
linkdexbot iubenda-radar
linkfluence mediawords
magpie-crawler
ripz ripz
satoristudio.net s1z.ru
webgains-bot webmeup-crawler
webpros.com
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cocyq.inwtrade.com 3weekdiet.com
dekoration.us advokat-grodno.by
eksprognoz.ru alpharma.net
inboxdollars.com cam-kontakte.org
jerseyschinabizwholesale.us googleseo.com.tr
sisi-go.ru polytopesexempt.com
stuff-about-money.com shitmovs.com
telegramdownload10.com tvnewsclips.info
usadacha.net u-cheats.ru
xn----ctbigni3aj4h.xn--p1ai while.cheapwebsitehoster.com

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
1001desert.com akama.com
1pamm.ru alta-realestate.com
2000k.ru ap.senai.br
2drittel.de app5.letmacworkfaster.world
4rent.ru asscenihotosidea.blogspot.co.za
66cpwgln.space autolombard-krasnodar.ru
8xv8.com aviav.org
affrh2015.com axbocz.net
amigobulls.com belsetirehafi.tk
apiitsthirteende-a.akamaihd.net bitcoin-ua.top
bcmp.org blue-square.biz
bedandbreakfast.com cartierreplica.win
best-games.today cfcl.co.uk
bio-japan.net cibpenonptib.flu.cc
blog.koorg.ru clickcash.com
blogs.rediff.com clmforexeu.com
boc.kz com-supportcenter.website
bum.com.ru compliance-mary.top
buttons-for-website.com cookie-law-enforcement-aa.xyz
cartierloveringreplica.xyz covetnica.com
centraletermice.us dentfidemountpreach.tk
checkhit.com detalizaciya-tut.biz
cherrypointplace.ca domaincheck.io
chiblackhawks-jerseys.com e2click.com
chorus.terakeet.com elmacho.xyz
compliance-don.top energydiet-info.ru
compliance-mark.top eropho.net
coolbar.pro essaypro.com
copblock.org ezigarettekaufen2.mpbloggar.se
detsky-nabytek.info feargames.ru
ekosmetyki.net.pl fermersovet.ru
enskedesquashclub.se firstdrugmall.ru
financeloan.us foxtechfpv.com
flooringinstallation-edmonton.com gembird.com
flytourisme.org germes-trans.com
forumprofi.de getlamborghini.ga
freenode.info greatdealshop.com
fym.com.ru guigyverpo.cf
globalscam.ga handicapbathtubarea.com
goblacked.com hoholikik.club
hdfreeporno.net hotchatdate.com
homedecoguide.info hotshoppymac.com
ie.57883.net ideawheel.com
ihc2015.info internet-apteka.ru
interior-stickers.ru juliaworld.net
invivo.hu kam-dom.ru
isoveti.ru karusel-market.ru
ispaniya-costa-blanca.ru kinoplen.ru
kalb.ru kurwa.win
keenoutlet.online lapitec.eu
kung-fu-ru.com lazymanyoga.com
light.ifmo.ru lemon-ade.site
mailemedicinals.com lesbian.xyz
meduza-consult.ru letmacwork.world
methodsmarketing.com lietaer.com
misandesign.se me-ke.com
mobilierland.com
morocco-nomad-excursions.com morocco-nomad-excursions.com
mrcsa.com.au nalogovyy-kodeks.ru
mulberryoutletonlineeu.com nuit-artisanale.com
naval.jislaaik.com officedocuments.net
njpalletremoval.com online-zaymy.ru
obiavo.com onlinefilmz.net
osoznanie-narkotikam.net pdns.cz
paleohub.info pensplan.com
paparazzistudios.com.au picscout.com
partners-ship.pro play-mp3.com
pendelprognos.se popander.mobi
poligon.com pornhub-forum.ga
pornofiljmi.com progonrumarket.ru
poshiv-chehol.ru prostitutki-rostova.org
powc.r.ca.d.sendibm2.com qitt.ru
projectforte.ru rebrand.ly
qld10000.net rfid-locker.co
qor360.com rossanasaavedra.net
quit-smoking.ga sendearnings.com
qwarckoine.com sex.hotblog.top
remont-mobile-phones.ru shakhtar-doneck.ru
salut-camp.ru sky-mine.ru
scanner-brian.top social-fun.ru
seoholding.com spywareit.com
seorankinglinks.us starpages.net
sexy-pings.com suchenindeutschland.com
signx.info tizanidinehclsideeffects.blogspot.com
slutloadlive.com toys.erolove.in
spywarebegone.com treasuretrack-a.akamaihd.net
star61.de trustedmaccleaner.com
thedownloadfromwarez.blogspot.com ultimatesetnewfreeallsoftupgradesystems.pw
titan-ads.life visionwell.com.cn
tizanidinecost.blogspot.com weblo.com
u-cheats.ru westsextube.com
videochaty.ru worldoffiles.ru
vigrx-original.ru wrona.it
vip-file.com wrz0iuebwhp5fg.freeddns.com
vksex.ru xboxster.ru
www.arenda-yeisk.ru xn--c1acygb.xn--p1ai
xn--80aanaardaperhcem4a6i.com yougame.biz
xxxrus.org yourtemplatefinder.com
youradulthosting.com zkjovpdgxivg.ga
yourdesires.ru znakomstvaonlain.ru
zeleznobeton.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.10 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:23 UTC 2024 ### Updated: Wed Apr 24 12:15:27 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4453 ### Version: V4.2024.04.4454
### Updated: Wed Apr 24 10:04:23 UTC 2024 ### Updated: Wed Apr 24 12:15:27 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##