vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2025.06.5290 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2025-06-21 05:59:11 +00:00
parent 4ee66b4854
commit e24aa55b38
38 changed files with 297 additions and 272 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.06.5289 #### Version: V4.2025.06.5290
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.06.5289 #### Version: V4.2025.06.5290
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2025.06.5289 #### Version: V4.2025.06.5290
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_generator_lists/bad-user-agents.list
View file

@ -1,4 +1,3 @@
GeedoProductSearch
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -168,6 +167,7 @@ G-i-g-a-b-o-t
GPTBot GPTBot
GT::WWW GT::WWW
GalaxyBot GalaxyBot
GeedoProductSearch
Genieo Genieo
GermCrawler GermCrawler
GetRight GetRight

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2025.06.5289 #### Version: V4.2025.06.5290
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [675](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [676](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

7
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

7
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.06.5289 ### Version: V3.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:31 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -317,6 +317,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

7
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

1
dev-tools/_robots_input/robots-input.txt
View file

@ -167,6 +167,7 @@ G-i-g-a-b-o-t
GPTBot GPTBot
GT::WWW GT::WWW
GalaxyBot GalaxyBot
GeedoProductSearch
Genieo Genieo
GermCrawler GermCrawler
GetRight GetRight

2
dev-tools/buildnumber
View file

@ -1 +1 @@
5289 5290

7
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.06.5289 ### Version: V3.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:31 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -317,6 +317,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

7
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.236.81.107 0; 20.241.105.67 0;

7
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -228,6 +228,7 @@
"~*(?:\b)GPTBot(?:\b|)" 0; "~*(?:\b)GPTBot(?:\b|)" 0;
"~*(?:\b)GT::WWW(?:\b|)" 0; "~*(?:\b)GT::WWW(?:\b|)" 0;
"~*(?:\b)GalaxyBot(?:\b|)" 0; "~*(?:\b)GalaxyBot(?:\b|)" 0;
"~*(?:\b)GeedoProductSearch(?:\b|)" 0;
"~*(?:\b)Genieo(?:\b|)" 0; "~*(?:\b)Genieo(?:\b|)" 0;
"~*(?:\b)GermCrawler(?:\b|)" 0; "~*(?:\b)GermCrawler(?:\b|)" 0;
"~*(?:\b)GetRight(?:\b|)" 0; "~*(?:\b)GetRight(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.236.81.107 0; 20.241.105.67 0;

7
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.236.81.107 0; 20.241.105.67 0;

7
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:39 UTC 2025 ### Updated: Sat Jun 21 05:55:30 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -320,6 +320,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)GPTBot(?:\b)" 3; "~*(?:\b)GPTBot(?:\b)" 3;
"~*(?:\b)GT::WWW(?:\b)" 3; "~*(?:\b)GT::WWW(?:\b)" 3;
"~*(?:\b)GalaxyBot(?:\b)" 3; "~*(?:\b)GalaxyBot(?:\b)" 3;
"~*(?:\b)GeedoProductSearch(?:\b)" 3;
"~*(?:\b)Genieo(?:\b)" 3; "~*(?:\b)Genieo(?:\b)" 3;
"~*(?:\b)GermCrawler(?:\b)" 3; "~*(?:\b)GermCrawler(?:\b)" 3;
"~*(?:\b)GetRight(?:\b)" 3; "~*(?:\b)GetRight(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 1; 10.1.0.124 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -228,6 +228,7 @@
"~*(?:\b)GPTBot(?:\b|)" 0; "~*(?:\b)GPTBot(?:\b|)" 0;
"~*(?:\b)GT::WWW(?:\b|)" 0; "~*(?:\b)GT::WWW(?:\b|)" 0;
"~*(?:\b)GalaxyBot(?:\b|)" 0; "~*(?:\b)GalaxyBot(?:\b|)" 0;
"~*(?:\b)GeedoProductSearch(?:\b|)" 0;
"~*(?:\b)Genieo(?:\b|)" 0; "~*(?:\b)Genieo(?:\b|)" 0;
"~*(?:\b)GermCrawler(?:\b|)" 0; "~*(?:\b)GermCrawler(?:\b|)" 0;
"~*(?:\b)GetRight(?:\b|)" 0; "~*(?:\b)GetRight(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Acunetix Abonti
Go-Ahead-Got-It Alexibot
Keybot Translation-Search-Machine BlackWidow
Lipperhey Humanlinks
Turingos LinkpadBot
WEBDAV MegaIndex.ru
WebFuck T0PHackTeam
check1.exe Teleport
magpie-crawler V-BOT
siteripz WebBandit

168
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
AIBOT 404enemy
AfD-Verbotsverfahren AiHitBot
Ankit Alligator
Apexoo AwarioBot
Aspiegel
BDCbot BDCbot
BackDoorBot
Backlink-Ceck Backlink-Ceck
BacklinkCrawler Battleztar Bazinga
Badass Black Hole
BlackWidow BuzzSumo
Blackboard CherryPicker
Blow Claritybot
CCBot Copyscape
CensysInspect Cosmos
Crawling at Home Project DataCha0s
Crescent Demon
DBLBot Discoverybot
Dirbuster DnyzBot
Discobot
DomainCrawler
DomainSigmaCrawler
Domains Project
EroCrawler EroCrawler
Exabot Extractor
Express WebPictures ExtractorPro
EyeNetIE Foobot
Ezooms Fuzz
Fimap GetWeb
GPTBot Getintent
GetRight GrabNet
GoZilla Grabber
GridBot HMView
HEADMasterSEO HTMLparser
HTTP::Lite HTTrack
Harvest Harvest
Iblog IRLbot
Id-search InternetSeer
JennyBot JennyBot
Jyxobot JetCar
Keybot Translation-Search-Machine LinkScan
LinksManager Linkbot
MicroMessenger LinkextractorPro
Microsoft URL Control LinkpadBot
Morfeus Fucking Scanner MQQBrowser
Name Intelligence MarkMonitor
NetZIP NPbot
NimbleCrawler NetSpider
Nmap OutfoxBot
Nutch Pi-Monster
OrangeSpider Picsearch
Page Analyzer PleaseCrawl
PageScorer ProWebWalker
Pandalytics Probethenet
Petalbot RankActiveLinkBot
Piepmatz
Pixray
Pockey
ProPowerBot
Pump
PxBroker
Rankivabot Rankivabot
ReGet RepoMonkey
RealDownload Rogerbot
SEOlyt
Scrapy Scrapy
Screaming ScrepyBot
SemrushBot Searchestate
SemrushBot-BA SeekportBot
SenutoBot SemrushBot-SWA
SeobilityBot Seomoz
SiteExplorer SiteAuditBot
SmartDownload SiteSnagger
Spbot Snapbot
Sociscraper
Spider_Bot/3.0
Spinn3r Spinn3r
Sqlworm
Sucker
Sucuri Sucuri
Telesphorep SuperBot
Trendiction SurveyBot
Twice Turnitin
TwengaBot
UnisterBot
Voltron Voltron
Wallpapers WWW-Mechanize
WeSEE Wallpapers/3.0
Web Collage Web Enhancer
Web Fuck Web Sucker
WebImageCollector WebCopier
WebReaper
WebSauger WebSauger
WebSucker WebsiteQuester
WinHTTrack Whatweb
Xenu YaK
Zitebot Zitebot
cognitiveseo ZmEu
com.plumanalytics ZumBot
demandbase-bot arquivo-web-crawler
awario.com
eCatch eCatch
evc-batch internetVista monitor
linkfluence
lwp-request
magpie-crawler magpie-crawler
meanpathbot
openai openai
polaris version seobility
seocompany.store
sitechecker.pro sitechecker.pro
sysscan trendiction.com
ubermetrics-technologies.com

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
dekorkeramik.ru belinka.com.ua
fantasticpixcool.com e-poker-2005.com
fym.com.ru efkt.jp
iplogger.org elektronischezigarettekaufen2.tumblr.com
medicines-choice.com gentamicineyedrops.blogspot.com
mototsikl.org goldadpremium.com
myfreetutorials.com lifehacĸer.com
odywpjtw.bloger.index.hr moviemail-online.co.uk
privatamateure.com onetravelguides.com
solution4u.com pornodojd.ru

196
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
24videos.tv 12masterov.com
5kstore.com 178evakuator178.ru
5u.com 7fon.ru
a.pr-cy.ru academiacsmendoza.org
arquivo.pt adnotbad.com
automatic-seo.com apiluckyleapnet-a.akamaihd.net
aversis.net
aviav.ru aviav.ru
azbaseimages.net balkanfarma.org
besthoro.ru berdasovivan.ru
big-cash.net blogig.org
binaryoptionscops.info blogsfunky672.weebly.com
blackplanet.com bonky.biz
bobinoz.com brainxs.us
bolezniorganov.ru brandov.ru
buqayy0.livejournal.com buy-cheap-pills-order-online.com
buyfriend.ru buynorxx.com
casablancamanor.co.za buzzzg.men
clipartnew.com bytimedance.ru
clodo.ru candlewooddentalcentre.com.au
community.allhiphop.com cartierreplica.top
compliance-mark.top celebsopics.com
cookie-law-enforcement-hh.xyz cenoval.ru
diminishedvalueoforegon.com cheapwebsitehoster.com
dogclothing.store cialischmrx.com
easyukraine.com cigarpass.com
evaashop.ru coccoc.com
fetlifeblog.com covetnica.com
fotopop.club danceuniverse.ru
gamerextra.com deshevo-nedorogo.ru
genetworx.com detalizaciya-tut.biz
ezigarettenkaufen1.pagina.gr
flex4launch.ru
formseo.com
freetangodownload.com
g33.org
gdebestkupit.ru
getmyads24.com getmyads24.com
glavtral.ru gq-catalog.gq
graphid.com gsasearchengineranker.site
havepussy.com hayate.biz
hoverboard360.de hotgirlhdwallpaper.com
hplaserjetpdriver8y.pen.io iboss.com
imagine-ex.co inspiring-desperate.tk
infokonkurs.ru interesnie-faktu.ru
justucalling32211123456789.tk iwanttodeliver.com
kakadu-interior.com.ua james13prix.info
kamen-e.ru joingames.org
labelwater.se kinotorka.ru
lafourmiliaire.com krasnodar.zrus.org
laptoper.net kurwa.win
locimge.pw lampokrat.ws
marblestyle.ru likrot.com
merryhouse.co.uk lookingglassemb.com
mobilemedia.md magazin-pics.ru
morefastermac.trade masturbate.co.uk
moskva.nodup.ru monsterdivx.com
newstudio.tv na-telefon.biz
nhl17coins.exblog.jp njkmznnb.ru
niroo.info npoet.ru
novodigs.com o-o-11-o-o.com
office2web.com o-o-6-o-o.ru
perl.dp.ua ok-ua.info
pl-top.pl oralsexfilme.net
pl.aasoldes.fr osnova3.ru
pliks.pl ozas.net
podshipniki-ntn.ru palvira.com.ua
predominant-invent.tk paramountmarble.co.uk
professionaldieselcare.com partner-trustworthy.men
pron.pro pekori.to
qwertty.net refads.pro
rangoman.date restaurantlescampi.com
rentaremotecomputer.com rniaeba.ga
rep-am.com roll123.com
school-diplomat.ru royalcar-ufa.ru
search.1and1.com searchkut.com
seasonvar.ru shtaketniki.ru
service-core.ru singularwebs.net
sex-sex-sex5.com start.myplaycity.com
smadihome.com stats-collector.org
sofit-dmd.ru thebestweightlosspills.ovh
sotechco.co tizanidinedruginteractions.blogspot.com
spl63.fr tizanidineforopiatewithdrawal.blogspot.com
srdrvp.com top-study.work
starwars.wikia.com tovaroboom.vast.ru
storehouse.ua trustedhealthtips.com
svetodiodoff.ru urzedowski.eu
tabletkinaodchudzanie.com.pl uvozdeckych.info
thebestphotos.eu vriel.batcave.net
thecoral.com.br wapsite.me
theguardlan.com weclipart.com
toonfamilies.net worldlovers.ru
tracfone.com xn--80ahvj9e.xn--p1ai
trafficjunky.com xtrafficplus.com
txxx.com zacreditom.ru
uptimechecker.com zaidia.xhost.ro
venerologiya.com zarabotat-na-sajte.ru
viagraneggrx.com zeikopay.com
vostoktrade.info zeroredirect5.com
vroze.com zigarettenonl.canalblog.com
walpaperlist.com
whosonmyserver.com
x-stars.ru
xn--b1agm2d.net
yoluxuryevents.com
zigarettenonlinekaufen.tumblr.com
zona-aqua.ru

27
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,6 +8,23 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.24.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
@ -878,14 +895,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.202 0; 10.1.0.124 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:40 UTC 2025 ### Updated: Sat Jun 21 05:55:32 UTC 2025
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -353,6 +353,8 @@ User-agent: GT::WWW
Disallow:/ Disallow:/
User-agent: GalaxyBot User-agent: GalaxyBot
Disallow:/ Disallow:/
User-agent: GeedoProductSearch
Disallow:/
User-agent: Genieo User-agent: Genieo
Disallow:/ Disallow:/
User-agent: GermCrawler User-agent: GermCrawler

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.06.5289 ### Version: V4.2025.06.5290
### Updated: Fri Jun 20 22:05:40 UTC 2025 ### Updated: Sat Jun 21 05:55:32 UTC 2025
### Bad Bot Count: 675 ### Bad Bot Count: 676
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -353,6 +353,8 @@ User-agent: GT::WWW
Disallow:/ Disallow:/
User-agent: GalaxyBot User-agent: GalaxyBot
Disallow:/ Disallow:/
User-agent: GeedoProductSearch
Disallow:/
User-agent: Genieo User-agent: Genieo
Disallow:/ Disallow:/
User-agent: GermCrawler User-agent: GermCrawler