From e24aa55b387aa6cf941586338f089c9ee0ae9491 Mon Sep 17 00:00:00 2001 From: mitchellkrogza Date: Sat, 21 Jun 2025 05:59:11 +0000 Subject: [PATCH] V4.2025.06.5290 [ci skip] --- AUTO-CONFIGURATION.md | 4 +- MANUAL-CONFIGURATION.md | 4 +- README.md | 4 +- _generator_lists/bad-user-agents.list | 2 +- _google_analytics_ghost_spam/README.md | 4 +- .../etc/nginx/conf.d/globalblacklist.conf | 7 +- conf.d/globalblacklist-testing-version.conf | 7 +- conf.d/globalblacklist.conf | 7 +- dev-tools/_robots_input/robots-input.txt | 1 + dev-tools/buildnumber | 2 +- dev-tools/globalblacklist-testing.template | 7 +- dev-tools/globalblacklist.template | 7 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/blacklist-user-agents.conf | 1 + .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 7 +- dev-tools/test_units/blacklist-ips.conf | 2 +- .../test_units/blacklist-user-agents.conf | 1 + .../random-bots-for-test-quick.list | 20 +- .../random-bots-for-whitelist-test.list | 168 +++++++-------- .../random-referrers-for-test-quick.list | 20 +- .../random-referrers-for-whitelist-test.list | 196 +++++++++--------- dev-tools/test_units/ratelimittest-master.txt | 27 ++- dev-tools/test_units/whitelist-ips.conf | 2 +- dev-tools/tmp/robots.txt | 8 +- robots.txt/robots.txt | 8 +- 38 files changed, 297 insertions(+), 272 deletions(-) diff --git a/AUTO-CONFIGURATION.md b/AUTO-CONFIGURATION.md index 04618cdeb..d36837466 100755 --- a/AUTO-CONFIGURATION.md +++ b/AUTO-CONFIGURATION.md @@ -4,9 +4,9 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2025.06.5289 +#### Version: V4.2025.06.5290 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) -#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) +#### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) ____________________ diff --git a/MANUAL-CONFIGURATION.md b/MANUAL-CONFIGURATION.md index df773d2e5..00b7b3b87 100755 --- a/MANUAL-CONFIGURATION.md +++ b/MANUAL-CONFIGURATION.md @@ -4,9 +4,9 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2025.06.5289 +#### Version: V4.2025.06.5290 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) -#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) +#### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) ____________________ diff --git a/README.md b/README.md index 316551bb5..09db933d4 100755 --- a/README.md +++ b/README.md @@ -14,9 +14,9 @@ ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) _______________ -#### Version: V4.2025.06.5289 +#### Version: V4.2025.06.5290 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) -#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) +#### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) ____________________ diff --git a/_generator_lists/bad-user-agents.list b/_generator_lists/bad-user-agents.list index 383a633eb..3c231cd03 100755 --- a/_generator_lists/bad-user-agents.list +++ b/_generator_lists/bad-user-agents.list @@ -1,4 +1,3 @@ -GeedoProductSearch 01h4x.com 360Spider 404checker @@ -168,6 +167,7 @@ G-i-g-a-b-o-t GPTBot GT::WWW GalaxyBot +GeedoProductSearch Genieo GermCrawler GetRight diff --git a/_google_analytics_ghost_spam/README.md b/_google_analytics_ghost_spam/README.md index acf1d6bb7..b223d8b37 100644 --- a/_google_analytics_ghost_spam/README.md +++ b/_google_analytics_ghost_spam/README.md @@ -3,9 +3,9 @@ # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM _______________ -#### Version: V4.2025.06.5289 +#### Version: V4.2025.06.5290 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) -#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) +#### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) ____________________ diff --git a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100755 --- a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf +++ b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/conf.d/globalblacklist-testing-version.conf b/conf.d/globalblacklist-testing-version.conf index d64f59fb1..6a25633e1 100644 --- a/conf.d/globalblacklist-testing-version.conf +++ b/conf.d/globalblacklist-testing-version.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V3.2025.06.5290 +### Updated: Sat Jun 21 05:55:31 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -317,6 +317,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/conf.d/globalblacklist.conf b/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100644 --- a/conf.d/globalblacklist.conf +++ b/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/_robots_input/robots-input.txt b/dev-tools/_robots_input/robots-input.txt index 8971d1dc6..fc6573c20 100644 --- a/dev-tools/_robots_input/robots-input.txt +++ b/dev-tools/_robots_input/robots-input.txt @@ -167,6 +167,7 @@ G-i-g-a-b-o-t GPTBot GT::WWW GalaxyBot +GeedoProductSearch Genieo GermCrawler GetRight diff --git a/dev-tools/buildnumber b/dev-tools/buildnumber index 82758ce06..3068556e7 100644 --- a/dev-tools/buildnumber +++ b/dev-tools/buildnumber @@ -1 +1 @@ -5289 +5290 diff --git a/dev-tools/globalblacklist-testing.template b/dev-tools/globalblacklist-testing.template index d64f59fb1..6a25633e1 100644 --- a/dev-tools/globalblacklist-testing.template +++ b/dev-tools/globalblacklist-testing.template @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V3.2025.06.5290 +### Updated: Sat Jun 21 05:55:31 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -317,6 +317,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/globalblacklist.template b/dev-tools/globalblacklist.template index cc6ade13e..5a641a60e 100755 --- a/dev-tools/globalblacklist.template +++ b/dev-tools/globalblacklist.template @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf index a59a9e155..b6691cb0c 100644 --- a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -20.236.81.107 0; +20.241.105.67 0; diff --git a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100644 --- a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf index 14289def5..35e9dd624 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 1; +10.1.0.124 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf index 01fd7a80c..200a3f5e1 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 0; +10.1.0.124 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf index 14289def5..35e9dd624 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 1; +10.1.0.124 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf index 01fd7a80c..200a3f5e1 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 0; +10.1.0.124 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100644 --- a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf index 14289def5..35e9dd624 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 1; +10.1.0.124 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf index d7713a89c..5dc90b421 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf @@ -228,6 +228,7 @@ "~*(?:\b)GPTBot(?:\b|)" 0; "~*(?:\b)GT::WWW(?:\b|)" 0; "~*(?:\b)GalaxyBot(?:\b|)" 0; + "~*(?:\b)GeedoProductSearch(?:\b|)" 0; "~*(?:\b)Genieo(?:\b|)" 0; "~*(?:\b)GermCrawler(?:\b|)" 0; "~*(?:\b)GetRight(?:\b|)" 0; diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf index 01fd7a80c..200a3f5e1 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 0; +10.1.0.124 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf index cc6ade13e..5a641a60e 100644 --- a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf index a59a9e155..b6691cb0c 100644 --- a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -20.236.81.107 0; +20.241.105.67 0; diff --git a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf index d0e08af91..e32e8f720 100644 --- a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf index a59a9e155..b6691cb0c 100644 --- a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -20.236.81.107 0; +20.241.105.67 0; diff --git a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf index d5e4a8f04..85918d541 100644 --- a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf @@ -4,10 +4,10 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:39 UTC 2025 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:30 UTC 2025 ### Bad Referrer Count: 7104 -### Bad Bot Count: 675 +### Bad Bot Count: 676 ################################################### ### VERSION INFORMATION ## @@ -320,6 +320,7 @@ map $http_user_agent $bad_bot { "~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3; + "~*(?:\b)GeedoProductSearch(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3; diff --git a/dev-tools/test_units/blacklist-ips.conf b/dev-tools/test_units/blacklist-ips.conf index 14289def5..35e9dd624 100644 --- a/dev-tools/test_units/blacklist-ips.conf +++ b/dev-tools/test_units/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 1; +10.1.0.124 1; 127.0.0.1 1; diff --git a/dev-tools/test_units/blacklist-user-agents.conf b/dev-tools/test_units/blacklist-user-agents.conf index d7713a89c..5dc90b421 100644 --- a/dev-tools/test_units/blacklist-user-agents.conf +++ b/dev-tools/test_units/blacklist-user-agents.conf @@ -228,6 +228,7 @@ "~*(?:\b)GPTBot(?:\b|)" 0; "~*(?:\b)GT::WWW(?:\b|)" 0; "~*(?:\b)GalaxyBot(?:\b|)" 0; + "~*(?:\b)GeedoProductSearch(?:\b|)" 0; "~*(?:\b)Genieo(?:\b|)" 0; "~*(?:\b)GermCrawler(?:\b|)" 0; "~*(?:\b)GetRight(?:\b|)" 0; diff --git a/dev-tools/test_units/random-bots-for-test-quick.list b/dev-tools/test_units/random-bots-for-test-quick.list index fbf02b5e5..26c6670c3 100644 --- a/dev-tools/test_units/random-bots-for-test-quick.list +++ b/dev-tools/test_units/random-bots-for-test-quick.list @@ -1,10 +1,10 @@ -Acunetix -Go-Ahead-Got-It -Keybot Translation-Search-Machine -Lipperhey -Turingos -WEBDAV -WebFuck -check1.exe -magpie-crawler -siteripz +Abonti +Alexibot +BlackWidow +Humanlinks +LinkpadBot +MegaIndex.ru +T0PHackTeam +Teleport +V-BOT +WebBandit diff --git a/dev-tools/test_units/random-bots-for-whitelist-test.list b/dev-tools/test_units/random-bots-for-whitelist-test.list index b85aef60a..211367e23 100644 --- a/dev-tools/test_units/random-bots-for-whitelist-test.list +++ b/dev-tools/test_units/random-bots-for-whitelist-test.list @@ -1,100 +1,100 @@ -AIBOT -AfD-Verbotsverfahren -Ankit -Apexoo -Aspiegel +404enemy +AiHitBot +Alligator +AwarioBot BDCbot -BackDoorBot Backlink-Ceck -BacklinkCrawler -Badass -BlackWidow -Blackboard -Blow -CCBot -CensysInspect -Crawling at Home Project -Crescent -DBLBot -Dirbuster -Discobot -DomainCrawler -DomainSigmaCrawler -Domains Project +Battleztar Bazinga +Black Hole +BuzzSumo +CherryPicker +Claritybot +Copyscape +Cosmos +DataCha0s +Demon +Discoverybot +DnyzBot EroCrawler -Exabot -Express WebPictures -EyeNetIE -Ezooms -Fimap -GPTBot -GetRight -GoZilla -GridBot -HEADMasterSEO -HTTP::Lite +Extractor +ExtractorPro +Foobot +Fuzz +GetWeb +Getintent +GrabNet +Grabber +HMView +HTMLparser +HTTrack Harvest -Iblog -Id-search +IRLbot +InternetSeer JennyBot -Jyxobot -Keybot Translation-Search-Machine -LinksManager -MicroMessenger -Microsoft URL Control -Morfeus Fucking Scanner -Name Intelligence -NetZIP -NimbleCrawler -Nmap -Nutch -OrangeSpider -Page Analyzer -PageScorer -Pandalytics -Petalbot -Piepmatz -Pixray -Pockey -ProPowerBot -Pump -PxBroker +JetCar +LinkScan +Linkbot +LinkextractorPro +LinkpadBot +MQQBrowser +MarkMonitor +NPbot +NetSpider +OutfoxBot +Pi-Monster +Picsearch +PleaseCrawl +ProWebWalker +Probethenet +RankActiveLinkBot Rankivabot -ReGet -RealDownload -SEOlyt +RepoMonkey +Rogerbot Scrapy -Screaming -SemrushBot -SemrushBot-BA -SenutoBot -SeobilityBot -SiteExplorer -SmartDownload -Spbot +ScrepyBot +Searchestate +SeekportBot +SemrushBot-SWA +Seomoz +SiteAuditBot +SiteSnagger +Snapbot +Sociscraper +Spider_Bot/3.0 Spinn3r +Sqlworm +Sucker Sucuri -Telesphorep -Trendiction -Twice +SuperBot +SurveyBot +Turnitin +TwengaBot +UnisterBot Voltron -Wallpapers -WeSEE -Web Collage -Web Fuck -WebImageCollector +WWW-Mechanize +Wallpapers/3.0 +Web Enhancer +Web Sucker +WebCopier +WebReaper WebSauger -WebSucker -WinHTTrack -Xenu +WebsiteQuester +Whatweb +YaK Zitebot -cognitiveseo -com.plumanalytics -demandbase-bot +ZmEu +ZumBot +arquivo-web-crawler +awario.com eCatch -evc-batch +internetVista monitor +linkfluence +lwp-request magpie-crawler +meanpathbot openai -polaris version +seobility +seocompany.store sitechecker.pro -sysscan +trendiction.com +ubermetrics-technologies.com diff --git a/dev-tools/test_units/random-referrers-for-test-quick.list b/dev-tools/test_units/random-referrers-for-test-quick.list index 5c8f29211..2f54534ce 100644 --- a/dev-tools/test_units/random-referrers-for-test-quick.list +++ b/dev-tools/test_units/random-referrers-for-test-quick.list @@ -1,10 +1,10 @@ -dekorkeramik.ru -fantasticpixcool.com -fym.com.ru -iplogger.org -medicines-choice.com -mototsikl.org -myfreetutorials.com -odywpjtw.bloger.index.hr -privatamateure.com -solution4u.com +belinka.com.ua +e-poker-2005.com +efkt.jp +elektronischezigarettekaufen2.tumblr.com +gentamicineyedrops.blogspot.com +goldadpremium.com +lifehacĸer.com +moviemail-online.co.uk +onetravelguides.com +pornodojd.ru diff --git a/dev-tools/test_units/random-referrers-for-whitelist-test.list b/dev-tools/test_units/random-referrers-for-whitelist-test.list index c0175e655..61c382e8e 100644 --- a/dev-tools/test_units/random-referrers-for-whitelist-test.list +++ b/dev-tools/test_units/random-referrers-for-whitelist-test.list @@ -1,100 +1,100 @@ -24videos.tv -5kstore.com -5u.com -a.pr-cy.ru -arquivo.pt -automatic-seo.com +12masterov.com +178evakuator178.ru +7fon.ru +academiacsmendoza.org +adnotbad.com +apiluckyleapnet-a.akamaihd.net +aversis.net aviav.ru -azbaseimages.net -besthoro.ru -big-cash.net -binaryoptionscops.info -blackplanet.com -bobinoz.com -bolezniorganov.ru -buqayy0.livejournal.com -buyfriend.ru -casablancamanor.co.za -clipartnew.com -clodo.ru -community.allhiphop.com -compliance-mark.top -cookie-law-enforcement-hh.xyz -diminishedvalueoforegon.com -dogclothing.store -easyukraine.com -evaashop.ru -fetlifeblog.com -fotopop.club -gamerextra.com -genetworx.com +balkanfarma.org +berdasovivan.ru +blogig.org +blogsfunky672.weebly.com +bonky.biz +brainxs.us +brandov.ru +buy-cheap-pills-order-online.com +buynorxx.com +buzzzg.men +bytimedance.ru +candlewooddentalcentre.com.au +cartierreplica.top +celebsopics.com +cenoval.ru +cheapwebsitehoster.com +cialischmrx.com +cigarpass.com +coccoc.com +covetnica.com +danceuniverse.ru +deshevo-nedorogo.ru +detalizaciya-tut.biz +ezigarettenkaufen1.pagina.gr +flex4launch.ru +formseo.com +freetangodownload.com +g33.org +gdebestkupit.ru getmyads24.com -glavtral.ru -graphid.com -havepussy.com -hoverboard360.de -hplaserjetpdriver8y.pen.io -imagine-ex.co -infokonkurs.ru -justucalling32211123456789.tk -kakadu-interior.com.ua -kamen-e.ru -labelwater.se -lafourmiliaire.com -laptoper.net -locimge.pw -marblestyle.ru -merryhouse.co.uk -mobilemedia.md -morefastermac.trade -moskva.nodup.ru -newstudio.tv -nhl17coins.exblog.jp -niroo.info -novodigs.com -office2web.com -perl.dp.ua -pl-top.pl -pl.aasoldes.fr -pliks.pl -podshipniki-ntn.ru -predominant-invent.tk -professionaldieselcare.com -pron.pro -qwertty.net -rangoman.date -rentaremotecomputer.com -rep-am.com -school-diplomat.ru -search.1and1.com -seasonvar.ru -service-core.ru -sex-sex-sex5.com -smadihome.com -sofit-dmd.ru -sotechco.co -spl63.fr -srdrvp.com -starwars.wikia.com -storehouse.ua -svetodiodoff.ru -tabletkinaodchudzanie.com.pl -thebestphotos.eu -thecoral.com.br -theguardlan.com -toonfamilies.net -tracfone.com -trafficjunky.com -txxx.com -uptimechecker.com -venerologiya.com -viagraneggrx.com -vostoktrade.info -vroze.com -walpaperlist.com -whosonmyserver.com -x-stars.ru -xn--b1agm2d.net -yoluxuryevents.com -zigarettenonlinekaufen.tumblr.com -zona-aqua.ru +gq-catalog.gq +gsasearchengineranker.site +hayate.biz +hotgirlhdwallpaper.com +iboss.com +inspiring-desperate.tk +interesnie-faktu.ru +iwanttodeliver.com +james13prix.info +joingames.org +kinotorka.ru +krasnodar.zrus.org +kurwa.win +lampokrat.ws +likrot.com +lookingglassemb.com +magazin-pics.ru +masturbate.co.uk +monsterdivx.com +na-telefon.biz +njkmznnb.ru +npoet.ru +o-o-11-o-o.com +o-o-6-o-o.ru +ok-ua.info +oralsexfilme.net +osnova3.ru +ozas.net +palvira.com.ua +paramountmarble.co.uk +partner-trustworthy.men +pekori.to +refads.pro +restaurantlescampi.com +rniaeba.ga +roll123.com +royalcar-ufa.ru +searchkut.com +shtaketniki.ru +singularwebs.net +start.myplaycity.com +stats-collector.org +thebestweightlosspills.ovh +tizanidinedruginteractions.blogspot.com +tizanidineforopiatewithdrawal.blogspot.com +top-study.work +tovaroboom.vast.ru +trustedhealthtips.com +urzedowski.eu +uvozdeckych.info +vriel.batcave.net +wapsite.me +weclipart.com +worldlovers.ru +xn--80ahvj9e.xn--p1ai +xtrafficplus.com +zacreditom.ru +zaidia.xhost.ro +zarabotat-na-sajte.ru +zeikopay.com +zeroredirect5.com +zigarettenonl.canalblog.com diff --git a/dev-tools/test_units/ratelimittest-master.txt b/dev-tools/test_units/ratelimittest-master.txt index 0dccbaf08..048d0e2ed 100644 --- a/dev-tools/test_units/ratelimittest-master.txt +++ b/dev-tools/test_units/ratelimittest-master.txt @@ -8,6 +8,23 @@

Welcome to the NginX Ultimate Bad Bot Blocker

This is merely used for testing !!!

+ml> +503 Service Temporarily Unavailable + +

503 Service Temporarily Unavailable

+
nginx/1.24.0 (Ubuntu)
+ + + + + +Welcome to NginX + + +
+

Welcome to the NginX Ultimate Bad Bot Blocker

+

This is merely used for testing !!!

+ @@ -878,14 +895,4 @@

Welcome to the NginX Ultimate Bad Bot Blocker

This is merely used for testing !!!

- - - -Welcome to NginX - - -
-

Welcome to the NginX Ultimate Bad Bot Blocker

-

This is merely used for testing !!!

- \ No newline at end of file diff --git a/dev-tools/test_units/whitelist-ips.conf b/dev-tools/test_units/whitelist-ips.conf index 01fd7a80c..200a3f5e1 100644 --- a/dev-tools/test_units/whitelist-ips.conf +++ b/dev-tools/test_units/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.202 0; +10.1.0.124 0; 127.0.0.1 0; diff --git a/dev-tools/tmp/robots.txt b/dev-tools/tmp/robots.txt index 8de2b55c1..a1697d65d 100644 --- a/dev-tools/tmp/robots.txt +++ b/dev-tools/tmp/robots.txt @@ -6,9 +6,9 @@ ### Version Information # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:40 UTC 2025 -### Bad Bot Count: 675 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:32 UTC 2025 +### Bad Bot Count: 676 ################################################### ### Version Information ## @@ -353,6 +353,8 @@ User-agent: GT::WWW Disallow:/ User-agent: GalaxyBot Disallow:/ +User-agent: GeedoProductSearch +Disallow:/ User-agent: Genieo Disallow:/ User-agent: GermCrawler diff --git a/robots.txt/robots.txt b/robots.txt/robots.txt index 8de2b55c1..a1697d65d 100644 --- a/robots.txt/robots.txt +++ b/robots.txt/robots.txt @@ -6,9 +6,9 @@ ### Version Information # ################################################### -### Version: V4.2025.06.5289 -### Updated: Fri Jun 20 22:05:40 UTC 2025 -### Bad Bot Count: 675 +### Version: V4.2025.06.5290 +### Updated: Sat Jun 21 05:55:32 UTC 2025 +### Bad Bot Count: 676 ################################################### ### Version Information ## @@ -353,6 +353,8 @@ User-agent: GT::WWW Disallow:/ User-agent: GalaxyBot Disallow:/ +User-agent: GeedoProductSearch +Disallow:/ User-agent: Genieo Disallow:/ User-agent: GermCrawler