vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-11 15:54:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2025.07.5374 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2025-07-31 05:41:09 +00:00
parent 3f029437c5
commit 0f7509e2c6
45 changed files with 280 additions and 264 deletions
Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.07.5373 #### Version: V4.2025.07.5374
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.07.5373 #### Version: V4.2025.07.5374
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,8 +14,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2025.07.5373 #### Version: V4.2025.07.5374
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_generator_lists/bad-referrers.list
View file

@ -1,4 +1,3 @@
Dataprovider.com
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -155,6 +154,7 @@ Dataprovider.com
999webdesign.com 999webdesign.com
9icmzvn6.website 9icmzvn6.website
9med.net 9med.net
Dataprovider.com
DomainStatsBot DomainStatsBot
a.frcls.fr a.frcls.fr
a.pr-cy.ru a.pr-cy.ru

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2025.07.5373 #### Version: V4.2025.07.5374
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-01.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-02.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-03.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-05.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -154,6 +154,7 @@ domain:991mostfm.co.id
domain:999webdesign.com domain:999webdesign.com
domain:9icmzvn6.website domain:9icmzvn6.website
domain:9med.net domain:9med.net
domain:Dataprovider.com
domain:DomainStatsBot domain:DomainStatsBot
domain:a.frcls.fr domain:a.frcls.fr
domain:a.pr-cy.ru domain:a.pr-cy.ru

7
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

7
conf.d/globalblacklist-testing-version.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.07.5373 ### Version: V3.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:29 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1264,6 +1264,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

7
conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
5373 5374

7
dev-tools/globalblacklist-testing.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.07.5373 ### Version: V3.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:29 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1264,6 +1264,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

7
dev-tools/globalblacklist.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

1
dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -154,6 +154,7 @@
"~*(?:\b)999webdesign\.com(?:\b)" 0; "~*(?:\b)999webdesign\.com(?:\b)" 0;
"~*(?:\b)9icmzvn6\.website(?:\b)" 0; "~*(?:\b)9icmzvn6\.website(?:\b)" 0;
"~*(?:\b)9med\.net(?:\b)" 0; "~*(?:\b)9med\.net(?:\b)" 0;
"~*(?:\b)Dataprovider\.com(?:\b)" 0;
"~*(?:\b)DomainStatsBot(?:\b)" 0; "~*(?:\b)DomainStatsBot(?:\b)" 0;
"~*(?:\b)a\.frcls\.fr(?:\b)" 0; "~*(?:\b)a\.frcls\.fr(?:\b)" 0;
"~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0; "~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0;

1
dev-tools/referrers-regex-format.txt
View file

@ -154,6 +154,7 @@
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.225.73.162 0; 52.225.29.98 0;

7
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.184 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.184 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.184 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.184 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.184 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -201,6 +201,7 @@
"~*(?:\b)999webdesign\.com(?:\b)" 0; "~*(?:\b)999webdesign\.com(?:\b)" 0;
"~*(?:\b)9icmzvn6\.website(?:\b)" 0; "~*(?:\b)9icmzvn6\.website(?:\b)" 0;
"~*(?:\b)9med\.net(?:\b)" 0; "~*(?:\b)9med\.net(?:\b)" 0;
"~*(?:\b)Dataprovider\.com(?:\b)" 0;
"~*(?:\b)DomainStatsBot(?:\b)" 0; "~*(?:\b)DomainStatsBot(?:\b)" 0;
"~*(?:\b)a\.frcls\.fr(?:\b)" 0; "~*(?:\b)a\.frcls\.fr(?:\b)" 0;
"~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0; "~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.184 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.225.73.162 0; 52.225.29.98 0;

7
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.225.73.162 0; 52.225.29.98 0;

7
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:54 UTC 2025 ### Updated: Thu Jul 31 05:37:28 UTC 2025
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -1267,6 +1267,7 @@ map $http_referer $bad_referer {
"~*(?:\b)999webdesign\.com(?:\b)" 1; "~*(?:\b)999webdesign\.com(?:\b)" 1;
"~*(?:\b)9icmzvn6\.website(?:\b)" 1; "~*(?:\b)9icmzvn6\.website(?:\b)" 1;
"~*(?:\b)9med\.net(?:\b)" 1; "~*(?:\b)9med\.net(?:\b)" 1;
"~*(?:\b)Dataprovider\.com(?:\b)" 1;
"~*(?:\b)DomainStatsBot(?:\b)" 1; "~*(?:\b)DomainStatsBot(?:\b)" 1;
"~*(?:\b)a14download\.com(?:\b)" 1; "~*(?:\b)a14download\.com(?:\b)" 1;
"~*(?:\b)a1security\.com\.ua(?:\b)" 1; "~*(?:\b)a1security\.com\.ua(?:\b)" 1;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 1; 10.1.0.184 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/custom-bad-referrers.conf
View file

@ -201,6 +201,7 @@
"~*(?:\b)999webdesign\.com(?:\b)" 0; "~*(?:\b)999webdesign\.com(?:\b)" 0;
"~*(?:\b)9icmzvn6\.website(?:\b)" 0; "~*(?:\b)9icmzvn6\.website(?:\b)" 0;
"~*(?:\b)9med\.net(?:\b)" 0; "~*(?:\b)9med\.net(?:\b)" 0;
"~*(?:\b)Dataprovider\.com(?:\b)" 0;
"~*(?:\b)DomainStatsBot(?:\b)" 0; "~*(?:\b)DomainStatsBot(?:\b)" 0;
"~*(?:\b)a\.frcls\.fr(?:\b)" 0; "~*(?:\b)a\.frcls\.fr(?:\b)" 0;
"~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0; "~*(?:\b)a\.pr\-cy\.ru(?:\b)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Drip CheTeam
LexiBot Deusu
Picscout IlseBot
Rainbot MolokaiBot
ScanAlert Offline Navigator
Steeler SEOstats
V-BOT SiteSnagger
Web Enhancer VoidEYE
Zade Web Sucker
meanpathbot everyfeed-spider

160
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
ADmantX
ALittle Client
Acunetix Acunetix
Aliyun Aliyun
AwarioSmartBot AliyunSecBot
BBBike Anarchy
BDCbot Aspiegel
Battleztar Bazinga BetaBot
Black Hole BotALot
Blow Buddy
ClaudeBot Cegbfeieh
Cogentbot CensysInspect
Copier ChatGPT-User
Copyscape Copyscape
DatabaseDriverMysqli DBLBot
Demon
Digincore
Dispatch
DomainAppender DomainAppender
Drip
EMail Wolf EMail Wolf
Ebingbong Evil
EirGrabber ExtLinksBot
Extractor Extractor
FemtosearchBot FlashGet
Firefox/7.0
FrontPage
FyberSpider
GPTBot GPTBot
GetRight Getintent
GrabNet Gotit
Haansoft HTTrack
HaosouSpider Harvest
HybridBot Havij
IDBot HonoluluBot
Id-search IRLbot
IndeedBot InfoNaviRobot
Intelliseek InfoTekies
IstellaBot JennyBot
Keybot Translation-Search-Machine Jyxobot
Kenjin Spider
Lanshanbot Lanshanbot
MIIxpc Larbin
MQQBrowser LinkScan
MSIECrawler Lipperhey Spider
Mail.RU_Bot Lmspider
Majestic SEO Ltx71
MSFrontPage
Majestic-SEO Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot MeanPath Bot
MicroMessenger Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mozlila Mozlila
Nameprotect Net Vampire
NetMechanic NextGenSearchBot
Netvibes Ninja
Niki-bot Octopus
Nutch Page Analyzer
POE-Component-Client-HTTP Picsearch
Pandalytics ProWebWalker
Petalbot Pu_iN
Pimonster
ProPowerBot
Re-re
Reaper Reaper
ScanAlert RedesScrapy
SearchmetricsBot SEOkicks
SemrushBot-BA SISTRIX
Scrapy
SeekportBot
SeoSiteCheckup
Seomoz
Site Sucker Site Sucker
Sitevigil Sitevigil
SmartDownload Snapbot
SocialRankIOBot
Spbot
Spider_Bot/3.0 Spider_Bot/3.0
Spinn3r T0PHackTeam
Sqworm T8Abot
Stripper
Teleport Teleport
Telesphorep
TheNomad
TinyTestBot
Titan
True_Robot
TurnitinBot
V-BOT
VB Project
Vagabondo Vagabondo
Voltron WPScan
WASALive-Bot WWW-Collector-E
WBSearchBot
WEBDAV
WWW-Mechanize WWW-Mechanize
WebCopier WWW::Mechanize
Widow Web Fetch
Wprecon Web Pix
YaK WebBandit
Zeus Webalta
Whack
Whatweb
Woobot
Zauba
ZmEu ZmEu
ZoomBot awario.com
eCatch cah.io.community
heritrix cognitiveseo
linkdexbot internetVista monitor
lwp-request plumanalytics
lwp-trivial probe-image-size
satoristudio.net seocompany.store
scan.lol siteripz
zauba.io sysscan
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
anti-virus-removal.info 20pascals.nl
detsky-nabytek.info bkgr.se
frcls.fr ibb.com.ua
gay-file.com oakleyglassesonline.us
liquimondo.com onetravelguides.com
mojowhois.com oyster-green.com
mototsikl.org pinkduck.ga
outclicks.net scanner-ivan.top
xvideosporn.biz tattoo33.ru
your-bearings.com zoosexart.com

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
1stat.ru 70casino.online
2nt.ru 7xc4n.com
5elementov.ru aa9bd78f328a6a41279d0fad0a88df1901.com
7fon.ru aab94f698f36684c5a852a2ef272e031bb.com
abcguru.xyz alot.com
agadelha.com.br atofilms.com
aliexpresscashback.club autorn.ru
android4fun.org autotop.com.ua
asscenihotosidea.blogspot.com autovideobroadcast.com
automatic-seo.com azarttoto.com
avitocars.ru beyan.host.sk
bank.uz biznesschat.net
belsetirehafi.tk bizru.info
bestcalovebracelet.cn brg8.com
bif-ru.info bvlgaribracelet.xyz
biznesrealnost.ru cfcl.co.uk
brillianty.info coldfilm.ru
capsderfudd.tk contextualyield.com
carina-sy.de crynet.cc
cenokos.ru daisye.top
chiptuninger.com dev78.dioniqlabb.se
clean-start.net dogoimage.com
coindirect.io domaincrawler.com
counterbot.com duawitchrarato.tk
customergrowthsystems.com elektroniksigaraankara.info
detsky-nabytek.info elkacentr.ru
dmmspy.com europeanwatches.ru
dvervmoskvu.ru euroskat.ru
elektrozigarette2.wordpressy.pl ezigaretteshop2.mywapblog.com
epicbrogaming.com fatfasts-4tmz.com
ezigarettenshop2.myblog.de flex4launch.ru
fandlr.com frighteningremain.cf
fitness-video.net fungirlsgames.net
foto-sisek.porngalleries.top gdzkurokam.ru
ghazel.ru gg-arena.ru
gkvector.ru go2album.com
glall.ru golden-praga.ru
globetrotting-culture.ru gta-top.ru
homeart.space guildebzh.info
hotloans.ru herehloadibs.cf
i-service.kz hop.clickbank.net
iccornacircri.cf hotenergy.ru
imediadesk.com infektsii.com
infazavr.ru inome.com.ua
instakink.com intimshop-fantasy.ru
intellektmedia.at investzalog.ru
ivoiretechnocom.ci irunfar.com
kabbalah-red-bracelets.com itservicesthatworkforyou.com
kambasoft.com javspace.net
keywordteam.net kenaba.su
krassh.ru kinomaniatv.pl
languagecode.com kovrenok.ru
law-check-two.xyz likesdesign.com
laxdrills.com livejasmin.com
liveinternet.ro lovasszovetseg.hu
map028.com lyngdalhudterapi.no
marktforschung-stuttgart.com manifestation.betteroffers.review
marwer.info midst.eu
medanestesia.ru mielec.pl
mikozstop.com minegam.com
myblogregistercm.tk miniads.ca
pensplan.com mjchamonix.org
pokerniydom.ru neks.info
porndroids.com netfacet.net
pornohub.me ohmyrings.com
pravoholding.ru onlinemeetingnow.com
reeyanaturopathy.com ooomeru.ru
refererx.com partner-print.men
remedyotc.com pic-re.blogspot.com
roznica.com.ua picturesboss.com
seoheap.com pinwallpaper.xyz
soochi.co porndl.org
sovetogorod.ru projectforte.ru
stoki.ru rank-checker.online
students-cheapskate.ml sanatorrii.ru
sugarlyflex.pw seoboxes.com
surflinksmedical.com sexad.net
theautoprofit.ml sisi-go.ru
thebestphotos.eu sisiynas.ru
theguardlan.com sitevalued.com
thenetinfo.com slavkokacunko.de
torrents.life softwaretrend.net
track.deriv.com speeddream.xyz
traffmonster.info spinnerco.ca
videojam.tv thenews-today.info
volume-pills.biz timetorelax.biz
web.cvut.cz tizanidinehclsideeffects.blogspot.com
weblo.com tizanidinestreetprice.blogspot.com
wholinkstome.com tizanidinestreetvalue.blogspot.com
wma-x.com unpredictable.ga
wordkeyhelper.com urll.eu
xn----9sbebi2bvzr7h.xn--p1ai vekzdorov.ru
xnxx-n.com vertaform.com
videonsk.com
vip2ch.com
waterefficiency.co
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xxxtubesafari.com
youbrainboost.asia youbrainboost.asia
yourothersite.com zog.link
yousense.info
youtoner.it
zaimite.ru
zajm-pod-zalog-nedvizhimosti.ru
zscaler.net

2
dev-tools/test_units/ratelimittest-master.txt
View file

@ -8,7 +8,7 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>OCTYPE html> </html><!DOCTYPE html>
<html> <html>
<head> <head>
<title>Welcome to NginX</title> <title>Welcome to NginX</title>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.160 0; 10.1.0.184 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:55 UTC 2025 ### Updated: Thu Jul 31 05:37:30 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.07.5373 ### Version: V4.2025.07.5374
### Updated: Thu Jul 31 05:29:55 UTC 2025 ### Updated: Thu Jul 31 05:37:30 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 679
################################################### ###################################################
### Version Information ## ### Version Information ##