vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2023.11.4122 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2023-11-16 10:53:08 +00:00
parent 2cc48c9818
commit 23402eb5d6
36 changed files with 264 additions and 254 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.11.4121 #### Version: V4.2023.11.4122
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.11.4121 #### Version: V4.2023.11.4122
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2023.11.4121 #### Version: V4.2023.11.4122
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2023.11.4121 #### Version: V4.2023.11.4122
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [647](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

6
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

6
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2023.11.4121 ### Version: V3.2023.11.4122
### Updated: Thu Nov 16 10:03:25 UTC 2023 ### Updated: Thu Nov 16 10:49:21 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

6
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4121 4122

6
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2023.11.4121 ### Version: V3.2023.11.4122
### Updated: Thu Nov 16 10:03:25 UTC 2023 ### Updated: Thu Nov 16 10:49:21 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

6
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.97.191.54 0; 20.172.6.162 0;

6
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.0.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.0.87 0;
127.0.0.1 0; 127.0.0.1 0;

6
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.0.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.0.87 0;
127.0.0.1 0; 127.0.0.1 0;

6
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.0.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -347,7 +347,7 @@
"~*(?:\b)Microsoft\ URL\ Control(?:\b|)" 0; "~*(?:\b)Microsoft\ URL\ Control(?:\b|)" 0;
"~*(?:\b)Minefield(?:\b|)" 0; "~*(?:\b)Minefield(?:\b|)" 0;
"~*(?:\b)Mister\ PiX(?:\b|)" 0; "~*(?:\b)Mister\ PiX(?:\b|)" 0;
"~*(?:\b)Moblie Safari(?:\b|)" 0; "~*(?:\b)Moblie\ Safari(?:\b|)" 0;
"~*(?:\b)Mojeek(?:\b|)" 0; "~*(?:\b)Mojeek(?:\b|)" 0;
"~*(?:\b)Mojolicious(?:\b|)" 0; "~*(?:\b)Mojolicious(?:\b|)" 0;
"~*(?:\b)MolokaiBot(?:\b|)" 0; "~*(?:\b)MolokaiBot(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.0.87 0;
127.0.0.1 0; 127.0.0.1 0;

6
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.97.191.54 0; 20.172.6.162 0;

6
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.97.191.54 0; 20.172.6.162 0;

6
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:24 UTC 2023 ### Updated: Thu Nov 16 10:49:20 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
@ -435,7 +435,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3; "~*(?:\b)Microsoft\ URL\ Control(?:\b)" 3;
"~*(?:\b)Minefield(?:\b)" 3; "~*(?:\b)Minefield(?:\b)" 3;
"~*(?:\b)Mister\ PiX(?:\b)" 3; "~*(?:\b)Mister\ PiX(?:\b)" 3;
"~*(?:\b)Moblie Safari(?:\b)" 3; "~*(?:\b)Moblie\ Safari(?:\b)" 3;
"~*(?:\b)Mojeek(?:\b)" 3; "~*(?:\b)Mojeek(?:\b)" 3;
"~*(?:\b)Mojolicious(?:\b)" 3; "~*(?:\b)Mojolicious(?:\b)" 3;
"~*(?:\b)MolokaiBot(?:\b)" 3; "~*(?:\b)MolokaiBot(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 1; 10.1.0.87 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -347,7 +347,7 @@
"~*(?:\b)Microsoft\ URL\ Control(?:\b|)" 0; "~*(?:\b)Microsoft\ URL\ Control(?:\b|)" 0;
"~*(?:\b)Minefield(?:\b|)" 0; "~*(?:\b)Minefield(?:\b|)" 0;
"~*(?:\b)Mister\ PiX(?:\b|)" 0; "~*(?:\b)Mister\ PiX(?:\b|)" 0;
"~*(?:\b)Moblie Safari(?:\b|)" 0; "~*(?:\b)Moblie\ Safari(?:\b|)" 0;
"~*(?:\b)Mojeek(?:\b|)" 0; "~*(?:\b)Mojeek(?:\b|)" 0;
"~*(?:\b)Mojolicious(?:\b|)" 0; "~*(?:\b)Mojolicious(?:\b|)" 0;
"~*(?:\b)MolokaiBot(?:\b|)" 0; "~*(?:\b)MolokaiBot(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Attach Abonti
BacklinkCrawler AlphaBot
CyotekWebCopy Ankit
Foobot LNSpiderguy
GT::WWW MFC_Tear_Sample
PageThing.com MeanPath Bot
VCI SiteSucker
com.plumanalytics Szukacz
crawler4j TinyTestBot
webmeup-crawler x22Mozilla

164
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
Alligator ALittle Client
Anarchy99 AllSubmitter
Barkrowler Apexoo
Bitacle Blackboard
BlowFish Blow
Boardreader Brandwatch
BunnySlippers BuiltBotTough
CazoodleBot Bullseye
Cegbfeieh BuzzSumo
Collector Calculon
Crawling at Home Project CheeseBot
CrazyWebCrawler Citoid
Crescent Cogentbot
Custo DIIbot
Ecxi Discoverybot
DnyzBot
Download Wonder
EasyDL
Evil Evil
Exabot ExtractorPro
ExtLinksBot
Extractor
Ezooms
Fimap
Foobot Foobot
FrontPage GetWeb
Genieo Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
Gotit
GrapeFX
HTTrack
Haansoft Haansoft
Havij Humanlinks
IRLbot
IlseBot IlseBot
IndeedBot Image Sucker
InfoNaviRobot Indy Library
JustView
Kinza Kinza
Lanshanbot LNSpiderguy
Leap LWP::Simple
LeechGet LeechGet
Likse MIIxpc
Lmspider MSFrontPage
MSIECrawler Mail.RU_Bot
Majestic SEO Minefield
Metauri Msrabot
MicroMessenger NPbot
Moblie Safari
Musobot
Name Intelligence
Nameprotect
Navroad Navroad
Nessus
Nibbler
Offline Navigator Offline Navigator
Openvas OrangeBot
Page Analyzer PageAnalyzer
Piepmatz PageThing.com
Psbot Pandalytics
Pixray
Pu_iN
QueryN Metasearch QueryN Metasearch
RankFlex RankFlex
RankingBot RankurBot
Re-re
Recorder Recorder
RedesScrapy Rogerbot
RocketCrawler SISTRIX
SBIder SMTBot
Seekport Scanbot
SentiBot Semrush
Siphon SeoSiteCheckup
SputnikBot SeobilityBot
Sucuri SiteLockSpider
SiteSnagger
Sitevigil
SpaceBison
SurveyBot
Suzuran Suzuran
T8Abot
Toata Toata
Toweyabot Turingos
Trendiction
True_Robot
TwengaBot TwengaBot
UnisterBot Upflow
VCI VoidEYE
Virusdie WWWOFFLE
Voil Web Auto
WWW-Collector-E WebCopier
WWW::Mechanize WebGo IS
WeSEE Website Quester
Web Fuck
WebEnhancer
WebFuck
WebSauger
WebsiteExtractor WebsiteExtractor
Whatweb WebsiteQuester
WiseGuys Robot WinHTTrack
Wonderbot Woobot
Zermelo Wprecon
ZmEu
ZoominfoBot
ZumBot ZumBot
check1.exe backlink-check
demandbase-bot clark-crawler
openai coccocbot
ripz cognitiveseo
seocompany.store crawler4j
sp_auditbot heritrix
lwp-trivial
openai.com
probe-image-size
spyfu
trendiction.com
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot x09Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
gfaq.ru ahhjf.com
hitmuzik.ru bioscorp.ru
krynica.info breastaugmentation.co.za
mrcsa.com.au darkbooks.org
o-o-6-o-o.com estelight.ru
piulatte.cz gwagka.com
polytopesexempt.com impresagaia.it
swingerseiten.com journeydownthescale.info
trafaret74.ru ledpolice.ru
zero1.it quickchange.cc

194
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
100dollars-seo.com a1security.com.ua
404.mn adtech.fr
991mostfm.co.id amehdaily.com
a14download.com appmsr.org
abtasty.com azartmsl.com
academiacsmendoza.org bannerbank.ru
alloysteel.ru bet-prognoz.com
apartment.ru canzoni.ru
approved.su cardiosport.com.ua
asacopaco.tk cognitiveseo.com
atovh.local-finders.com covetnica.com
baikaleminer.com dailyrank.net
beauty-clinic.ru digital-video-processing.com
bestprofits-there.com dominateforex.ml
bio-japan.net dominterior.org
bookmark4you.com.biz eas-seo.com
bupropion-sr-150-mg.us elexies.info
buzzonclick.com etenininrade.ga
cah.io.community forex-procto.ru
catalogs-parts.com free-floating-buttons.com
chatroulette.life frighteningremain.cf
concealthyself.com geile-lelly.eu
connectionstrenth.com globalscam.ga
covid-schutzmasken.de hermesbelts.xyz
davebestdeals.com
destinationrealestate.com
downloadeer.net
dtm-spain.com
efkt.jp
electricwheelchairsarea.com
eleimgo.pw
elektroniksigaraankara.info
essayservicewriting.org
filesmonster.porn
gamedayhouse.com
gay.adultgalls.com
gcup.ru
gotcher.us
gotorussia.com
graphicwe.org
haikuware.com
helicalpile.us
hildinghr.se hildinghr.se
historichometeam.com homeart.space
holidaypics.org hoterika.com
homemature.net ideawheel.com
hydropump.su infowarcraft.ru
hystersister.com instasexyblog.com
infobabki.ru
infoupdate.org
investsuccess.org investsuccess.org
javlibrary.cc izhevsk.zrus.org
jrcigars.com jerseyssportsshop.com
komputers-best.ru justprofit.xyz
lookingglassemb.com kabbalah-red-bracelets.com
lyngdalhudterapi.no keywords-monitoring-success.com
mackeeper-land-672695126.us-east-1.elb.amazonaws.com khafre.us
maranbrinfo.com.br lancheck.net
martlinker.com letto.by
michaelkorsoutletstore.net lumb.co
makenahartlin.com
mebel-alait.ru
mebel-vstroika.ru
menetie.ru
meteocast.net
middlerush-a.akamaihd.net middlerush-a.akamaihd.net
mobplayer.net moesonce.com
monclerboots.xyz money-for-placing-articles.com
morlat.altervista.org moneyzzz.ru
nonews.co mouselink.co
online-templatestore.com my-cash-bot.co
ossmalta.com networkad.net
patterntrader-en.com noscrapleftbehind.co
pix-hd.com oren-cats.ru
pornogig.com parajumpersjakkesalgnorge.info
pornowarp.info partner-pop.men
puzzleweb.ru pastaleads.com
realting-moscow.ru pattersonsweb.com
rockprogblog.com pestomou.info
sammlungfotos.online phobia.us
scanner-barak.top piter.xrus.org
searchinterneat-a.akamaihd.net plastgran.com
searchlock.com powenlite24.ru
seasaltwithfood.com privacyassistant.net
seo-2-0.com qwesa.ru
siteheart.net rabot.host.sk
small-games.biz rangoman.date
soietvousmaime.fr rebuildermedical.com
streetfooduncovered.com resultshub-a.akamaihd.net
tizanidinehcl4mgisitanarcotic.blogspot.com retailwith.com
tk-assortiment.ru rightenergysolutions.com.au
truebeauty.cc sa-rewards.co.za
trustedmaccleaner.com saveindex.xyz
ucoz.ru scanmyphones.com
uggsale.online sell-fb-group-here.com
urlcut.ru seoexperimenty.ru
uroffer.link sex-sex-sex5.com
viteonlusarezzo.it sharebutton.org
webmonetizer.net sherlock.se
westen-z.life slimcdn.com
williamrobsonproperty.com social-button.xyz
yourserverisdown.com spywarebegone.com
zebradudka.com statistici.ro
zeroredirect12.com stoki.ru
zoogdisany.com thejournal.ru
timdreby.com
tizanidinezanaflex.blogspot.com
topvidos.ru
torrentgamer.net
tula.mdverey.ru
ussearche.cf
velpanex.ru
video-hollywood.ru
vita.com.hr
voloo.ru
witherrom55.eklablog.fr
xgftnlrt.bloger.index.hr
yellowproxy.net
zapiszto.pl
zocaparj.kz

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.200 0; 10.1.0.87 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:25 UTC 2023 ### Updated: Thu Nov 16 10:49:22 UTC 2023
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.11.4121 ### Version: V4.2023.11.4122
### Updated: Thu Nov 16 10:03:25 UTC 2023 ### Updated: Thu Nov 16 10:49:22 UTC 2023
### Bad Bot Count: 647 ### Bad Bot Count: 647
################################################### ###################################################
### Version Information ## ### Version Information ##