vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 04:00:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.04.4470 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-04-30 11:06:47 +00:00
parent 19b20de56a
commit 1110d9bab1
40 changed files with 957 additions and 910 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4469 #### Version: V4.2024.04.4470
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4469 #### Version: V4.2024.04.4470
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.04.4469 #### Version: V4.2024.04.4470
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.04.4469 #### Version: V4.2024.04.4470
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

35
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

35
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4469 ### Version: V3.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -18967,18 +18967,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -18990,8 +19000,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

35
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4469 4470

4
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4469 ### Version: V3.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################

4
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################

14
dev-tools/test1_conf_files/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.109.39.181 0; 172.183.162.118 0;

35
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

14
dev-tools/test1_conf_files_ip_whitelist/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

35
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

14
dev-tools/test1_conf_files_ratelimiting/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

35
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

14
dev-tools/test1_conf_files_whitelist/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

35
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

14
dev-tools/test2_conf_files/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.109.39.181 0; 172.183.162.118 0;

35
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

14
dev-tools/test3_conf_files/bots.d/blockbots.conf
View file

@ -2,8 +2,8 @@
# VERSION INFORMATION # # VERSION INFORMATION #
#---------------------- #----------------------
# Version: V4.2019.04 # Version: V5.2024.04
# Updated: 2019-06-28 # Updated: 2024-04-30
#---------------------- #----------------------
# VERSION INFORMATION # # VERSION INFORMATION #
@ -49,15 +49,19 @@
# BLOCK BAD BOTS # BLOCK BAD BOTS
# -------------- # --------------
# Section bot_1 Unused
#limit_conn bot1_connlimit 100; #limit_conn bot1_connlimit 100;
#limit_req zone=bot1_reqlimitip burst=50; #limit_req zone=bot1_reqlimitip burst=50;
limit_conn bot2_connlimit 10; limit_conn bot2_connlimit 10;
limit_req zone=bot2_reqlimitip burst=10; limit_req zone=bot2_reqlimitip burst=10;
# Uncomment below lines for super rate limiting feature
#limit_conn bot4_connlimit 10;
#limit_req zone=bot4_reqlimitip burst=10;
if ($bad_bot = '3') { if ($bad_bot = '3') {
return 444; # << Response Code Issued May Be Modified to Whatever you Choose ie. 404 but 444 wastes less of Nginxs time return 444;
} }
# --------------------- # ---------------------
# BLOCK BAD REFER WORDS # BLOCK BAD REFER WORDS

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.109.39.181 0; 172.183.162.118 0;

35
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:27 UTC 2024 ### Updated: Tue Apr 30 11:03:06 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
@ -19347,18 +19347,28 @@ geo $ratelimited {
# ============================================ # ============================================
# -------------------------------------------- # --------------------------------------------
# 1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION # 4.1. MAP BAD BOTS TO OUR RATE LIMITER FUNCTION
# -------------------------------------------- # --------------------------------------------
map $bad_bot $bot_iplimit { map $bad_bot $bot_iplimit {
0 ""; 0 "";
1 ""; 1 "";
2 $binary_remote_addr; 2 $binary_remote_addr;
4 $binary_remote_addr; 4 "";
} }
# --------------------------------------------------
# 4.2. MAP BAD BOTS TO OUR SUPER RATE LIMITER FUNCTION
# --------------------------------------------------
map $bad_bot $bot_iplimit2 {
0 "";
1 "";
2 "";
4 $binary_remote_addr;
}
# -------------------------- # --------------------------
# 2. SET RATE LIMITING ZONES # 4.3. SET RATE LIMITING ZONES
# -------------------------- # --------------------------
# BAD BOT RATE LIMITING ZONE # BAD BOT RATE LIMITING ZONE
@ -19370,8 +19380,9 @@ geo $ratelimited {
# BAD BOT SUPER RATE LIMITING ZONE # BAD BOT SUPER RATE LIMITING ZONE
# Super Rate limiting will only take effect if on any User-Agents with a value of 4 # Super Rate limiting will only take effect if on any User-Agents with a value of 4
limit_conn_zone $bot_iplimit zone=bot4_connlimit:16m; limit_conn_zone $bot_iplimit2 zone=bot4_connlimit:16m;
limit_req_zone $bot_iplimit zone=bot4_reqlimitip:16m rate=1r/m; limit_req_zone $bot_iplimit2 zone=bot4_reqlimitip:16m rate=1r/m;
# ========================================== # ==========================================
# END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS # END SECTION 4 - ACTIVATE BLOCKER FUNCTIONS

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Barkrowler Dispatch
DnyzBot DomCopBot
Ebingbong Indy Library
FlashGet Pump
GermCrawler ReGet
HTTrack Spammen
Joomla Sqworm
MFC_Tear_Sample T0PHackTeam
Telesphorep Web Auto
Thumbor Web Fuck

164
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
01h4x.com
80legs 80legs
Aipbot ADmantX
AlphaBot AhrefsBot
Ankit AiHitBot
AwarioBot Anthill
AwarioSmartBot AwarioRssBot
BLEXBot BackWeb
Blackboard BetaBot
Boardreader BuiltBotTough
CheTeam Chlooe
CheeseBot
CherryPicker
Citoid Citoid
CopyRightCheck Cliqzbot
Custo Copier
Deusu
Dirbuster Dirbuster
Disco DnBCrawler-Analytics
DnyzBot DomainCrawler
Drip Dragonfly
Ebingbong
EirGrabber
Extreme Picture Finder
FDM FDM
Firefox/7.0 GetWeb
Flunky Go!Zilla
Fyrebot Google-Extended
GT::WWW
GoZilla
GrapeshotCrawler GrapeshotCrawler
HMView HTTP::Lite
Haansoft HTTrack
Heritrix HaosouSpider
Havij
Hloader Hloader
ImagesiftBot IDBTE4M
Intelliseek Iblog
IstellaBot Image Fetch
Jorgee Image Sucker
JustView InfoNaviRobot
JetCar
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
Linkbot Linkbot
LinkextractorPro
LinksManager
Lipperhey Spider Lipperhey Spider
MIIxpc Lmspider
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mb2345Browser Mb2345Browser
Mojeek NetMechanic
NICErsPRO NetZIP
NetSpider Nettrack
Nibbler Nuclei
Nutch Offline Explorer
Offline Navigator Offline Navigator
OutclicksBot Openfind
PageScorer OrangeSpider
Pandalytics POE-Component-Client-HTTP
Page Analyzer
Papa Foto Papa Foto
PeoplePal Pump
Psbot RankingBot2
Pu_iN Rankivabot
PyCurl RealDownload
RSSingBot SEOkicks-Robot
SEOstats ScanAlert
SMTBot SemanticJuice
ScreenerBot Shodan
Seekport SiteSucker
SeoSiteCheckup SmartDownload
Siphon
Snoopy Snoopy
Sogou web spider Sociscraper
Sottopop SpaceBison
Spanner Spanner
Spinn3r
SuperBot SuperBot
Teleport SuperHTTP
T8Abot
Telesoft
Telesphoreo Telesphoreo
TinyTestBot Toata
Typhoeus Upflow
UnisterBot V-BOT
WallpapersHD VeriCiteCrawler
WebCopier Virusdie
Whack Voil
Zermelo WebEnhancer
ZumBot WebZIP
arquivo.pt Webalta
autoemailspider WebsiteExtractor
clark-crawler Xaldon_WebSpider
crawler.feedback ZoominfoBot
adscanner
archive.org_bot
crawler4j crawler4j
internetVista monitor dataforseo.com
iubenda-radar domainsproject.org
linkdexbot isitwp.com
mediawords spyfu
omgili
probe-image-size
sexsearcher
siteripz
sogouspider
tAkeOut
ubermetrics-technologies.com ubermetrics-technologies.com
webpros.com webmeup-crawler
x22Mozilla x09Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
21h2o.com androids-store.com
ausmepa.org.au camel-beach.com
azadnegar.com compliance-elena.xyz
babosas.com gemara.com
db.speedup.gdn huhn.altervista.org
ekspertmed.com inclk.com
ljusihus.se kmd-pto.ru
stroimajor.ru nudepatch.net
stuff-about-money.com sel-hoz.com
wdfdocando.com xportvusbdriver8i.snack.ws

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
1pamm.ru 03e.info
8jn.dating-app.ru 4senses.co
abiente.ru aa14ab57a3339c4064bd9ae6fad7495b5f.com
acheterviagrafr24.com acheterviagrafr24.com
alldownload.pw adtech.us
alldubai.biz agecheckadult.com
animal36.com alert-jdh.xyz
asophoto.com alot.com
atlasvkusov.ru apiadanaknet-a.akamaihd.net
azlex.uz astrochicks.com
balook.com avirasecureserver.com
bambi.ck.ua bamo.xsl.pt
bannerpower.com banan.tv
beetpics.pw beget.tech
bitnote.co bestserials.com
braip.com.br brus-vsem.ru
brandimensions.com cartierreplica.pw
callcafe.info chatroulette.online
cardsharp1.ru cheapjerseysa.com
cascadelink.org circlesl.com
chorus.terakeet.com corta.co
christianlouboutinsaleonline.us dawlenie.com
clean-start.net dinkolove.ya.ru
decorationspcs.com docsportal.net
degerlund.net drivotracker.com
delitime.info dyt.net
earl-brown.info efkt.jp
ebonyporn.site elektronischezi.livejournal.com
eloxal.ru elmifarhangi.com
ezaz.info energy-ua.com
farm26.ru eropho.net
free-social-buttons.xyz erotiktreff24.info
fym.com.ru f0815.de
gamblingnerd.com findpics.pw
geile-lelly.eu fitness-video.net
getlaid-xxxhookupdirect.com footballfarrago.com
globetrotting-culture.ru forex21.ru
gourcy.altervista.org forum-engineering.ru
gunsvicceadadebt.tk forums.d2jsp.org
guod.me freeseedsonline.com
hackers-crackers.tk freeuploader.com
hotloans.ru funcrushgames.com
indianmedicaltourismshop.com glogow.pl
joessmogtestonly.com googglet.com
kimcurlrvsms.com handicapbathtubarea.com
klikbonus.com hotenergy.ru
kreativperlen.ch hoztorg-opt.ru
krynica.info impresagaia.it
labafydjxa.su intim-uslugi.info
laexotic.com javxxx18.com
landmania.ru keywordglobal.co.za
lodki-pvh.dp.ua keywordhouse.com
lolnex.us kinocccp.net
low-format.ru kinopolet.net
luciddiagnostics.in kit-opt.ru
madot.onlinewebshop.net kolotiloff.ru
matsdale.com laapp.com
medtherapy.ru languagecode.com
moneyzzz.ru lashstudia.ru
multgo.ru lider-zhaluzi.kiev.ua
newsperuse.com marcogrup.com
offf.info maximilitary.ru
ons-add.men mustat.com
ourville.info muznachas-service.ru
partner-high.men offers.bycontext.com
pills24h.com outclicks.net
porno-raskazy.ru photokitchendesign.com
pornoforadult.com piski.top
pornoinn.com pornhub-ru.com
pornolook.net prodess.ru
proprostatit.com profitfx.online
registratciya-v-moskve.ru profitwithalex.info
remont-komputerov-notebook.ru purplesphere.in
remont-mobile-phones.ru qld10000.net
resant.ru quangcaons.com
rewardit.com rybalka-opt.ru
rossmark.ru sale-japan.com
rus-pornuha.com scanner-don.top
se-welding.ru scanner-walter.top
search-error.com seinterface.com
shakhtar-doneck.ru seonetwizard.com
sispe.com.br spinazdrav.ru
siteaero.com sps-shop.com
soheavyblog.com spylog.com
spacash.com talant-factory.ru
stackthatbucks.com theendivechronicles.com
stauga.altervista.org topflownews.com
stretchingabuckblog.com torrent-newgames.com
tattooreligion.ru traffic-club.info
thefds.net umg-stroy.ru
trafaret74.ru ussearche.cf
truck-land.life valkiria-tk.ru
uamtrk.com videonsk.com
unionmarkt.de vip2ch.com
valsalud.com vvon.co.uk
vereo.eu vzglyadriv.kg
video-hollywood.ru websites-reviews.com
videochat.tv.br yougame.biz
w7s.ru zeg-distribution.com
zeroredirect2.com zeroredirect10.com

1018
dev-tools/test_units/ratelimittest-master.txt
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.138 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:28 UTC 2024 ### Updated: Tue Apr 30 11:03:07 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4469 ### Version: V4.2024.04.4470
### Updated: Tue Apr 30 10:03:28 UTC 2024 ### Updated: Tue Apr 30 11:03:07 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##