vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2023.06.3802 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2023-06-11 06:28:15 +00:00
parent f0b90767b1
commit 1d8319409b
37 changed files with 283 additions and 265 deletions
Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.06.3801 #### Version: V4.2023.06.3802
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [641](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [642](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2023.06.3801 #### Version: V4.2023.06.3802
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [641](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [642](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2023.06.3801 #### Version: V4.2023.06.3802
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [641](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [642](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_generator_lists/bad-user-agents.list
View file

@ -1,4 +1,3 @@
Bytespider
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -67,6 +66,7 @@ BuiltWith
Bullseye Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
Bytespider
CATExplorador CATExplorador
CCBot CCBot
CODE87 CODE87

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2023.06.3801 #### Version: V4.2023.06.3802
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [641](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [642](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

7
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

7
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2023.06.3801 ### Version: V3.2023.06.3802
### Updated: Sat Jun 10 22:01:16 UTC 2023 ### Updated: Sun Jun 11 06:24:24 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

7
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

1
dev-tools/_robots_input/robots-input.txt
View file

@ -66,6 +66,7 @@ BuiltWith
Bullseye Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
Bytespider
CATExplorador CATExplorador
CCBot CCBot
CODE87 CODE87

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3801 3802

7
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2023.06.3801 ### Version: V3.2023.06.3802
### Updated: Sat Jun 10 22:01:16 UTC 2023 ### Updated: Sun Jun 11 06:24:24 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

7
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.31 0; 52.185.204.69 0;

7
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -127,6 +127,7 @@
"~*(?:\b)Bullseye(?:\b|)" 0; "~*(?:\b)Bullseye(?:\b|)" 0;
"~*(?:\b)BunnySlippers(?:\b|)" 0; "~*(?:\b)BunnySlippers(?:\b|)" 0;
"~*(?:\b)BuzzSumo(?:\b|)" 0; "~*(?:\b)BuzzSumo(?:\b|)" 0;
"~*(?:\b)Bytespider(?:\b|)" 0;
"~*(?:\b)CATExplorador(?:\b|)" 0; "~*(?:\b)CATExplorador(?:\b|)" 0;
"~*(?:\b)CCBot(?:\b|)" 0; "~*(?:\b)CCBot(?:\b|)" 0;
"~*(?:\b)CODE87(?:\b|)" 0; "~*(?:\b)CODE87(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.31 0; 52.185.204.69 0;

7
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.84.170.31 0; 52.185.204.69 0;

7
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:15 UTC 2023 ### Updated: Sun Jun 11 06:24:23 UTC 2023
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -215,6 +215,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Bullseye(?:\b)" 3; "~*(?:\b)Bullseye(?:\b)" 3;
"~*(?:\b)BunnySlippers(?:\b)" 3; "~*(?:\b)BunnySlippers(?:\b)" 3;
"~*(?:\b)BuzzSumo(?:\b)" 3; "~*(?:\b)BuzzSumo(?:\b)" 3;
"~*(?:\b)Bytespider(?:\b)" 3;
"~*(?:\b)CATExplorador(?:\b)" 3; "~*(?:\b)CATExplorador(?:\b)" 3;
"~*(?:\b)CCBot(?:\b)" 3; "~*(?:\b)CCBot(?:\b)" 3;
"~*(?:\b)CODE87(?:\b)" 3; "~*(?:\b)CODE87(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 1; 10.1.0.31 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -127,6 +127,7 @@
"~*(?:\b)Bullseye(?:\b|)" 0; "~*(?:\b)Bullseye(?:\b|)" 0;
"~*(?:\b)BunnySlippers(?:\b|)" 0; "~*(?:\b)BunnySlippers(?:\b|)" 0;
"~*(?:\b)BuzzSumo(?:\b|)" 0; "~*(?:\b)BuzzSumo(?:\b|)" 0;
"~*(?:\b)Bytespider(?:\b|)" 0;
"~*(?:\b)CATExplorador(?:\b|)" 0; "~*(?:\b)CATExplorador(?:\b|)" 0;
"~*(?:\b)CCBot(?:\b|)" 0; "~*(?:\b)CCBot(?:\b|)" 0;
"~*(?:\b)CODE87(?:\b|)" 0; "~*(?:\b)CODE87(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 CheTeam
Discobot Genieo
FyberSpider Jetty
LinqiaMetadataDownloaderBot Majestic12
Microsoft Data Access Mozlila
Moblie Safari Pandalytics
POE-Component-Client-HTTP ScreenerBot
WPScan SemanticJuice
autoemailspider Web Auto
mediawords muhstik-scan

172
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
404checker
ADmantX ADmantX
AIBOT ASPSeek
AdsTxtCrawlerTP AllSubmitter
Anarchy Atomseobot
Ankit BDCbot
Attach Bandit
BatchFTP BlowFish
Battleztar Bazinga Boardreader
BetaBot BotALot
Blackboard Buck
BuiltWith BuiltBotTough
BunnySlippers BuzzSumo
CATExplorador CATExplorador
Calculon CODE87
CazoodleBot ChinaClaw
Citoid Claritybot
DIIbot Cloud mapping
Disco Cocolyzebot
DnBCrawler-Analytics Cogentbot
Copier
Cosmos
Crawling at Home Project
DBLBot
DTS Agent
Dragonfly Dragonfly
EasyDL EMail Wolf
Evil Extreme Picture Finder
Express WebPictures Firefox/7.0
ExtractorPro FlashGet
FDM Heritrix
Flunky
Genieo
GetRight
Gigabot
GrabNet
Grafula
GridBot
HEADMasterSEO
HTTrack
Harvest
Hloader Hloader
Humanlinks
HybridBot HybridBot
Iblog Image Sucker
IndeedBot InfoNaviRobot
InfoTekies Intelliseek
JamesBOT IstellaBot
JikeSpider Jbrofuzz
JustView Jetty
Libwhisker Keybot Translation-Search-Machine
LinkextractorPro LWP::Simple
LinkpadBot LieBaoFast
LinksManager Likse
Majestic-SEO Lipperhey Spider
Mb2345Browser Litemage_walker
Minefield MSFrontPage
Mail.RU_Bot
Majestic12
Masscan
Metauri
Mojeek Mojeek
Msrabot Morfeus Fucking Scanner
Net Vampire NPbot
NetAnts NetMechanic
Offline Explorer Nettrack
PECL::HTTP Openfind
Pimonster POE-Component-Client-HTTP
ProWebWalker Papa Foto
RankFlex Picsearch
Rogerbot RankingBot
SEOkicks SEOprofiler
SEOstats SalesIntelligent
SentiBot Scrapy
SenutoBot Screaming
SiteExplorer ScreenerBot
Sitevigil SearchmetricsBot
SmartDownload SemanticJuice
Snake SocialRankIOBot
Snapbot Sqlmap
Spbot Stripper
Sqlworm Sucker
TheNomad SurveyBot
Toweyabot Swiftbot
Trendiction TwengaBot
Turingos
Twice
VB Project
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE VoidEYE
Wallpapers/3.0 WBSearchBot
Web Enhancer WPScan
Web Fuck Web Fuck
Web Pix WebAuto
WebGo IS WebReaper
WebZIP Wotbox
WebmasterWorldForumBot Xaldon WebSpider
Website Quester Xaldon_WebSpider
Whack ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
cognitiveseo
eCatch
evc-batch
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot
mediawords
muhstik-scan muhstik-scan
s1z.ru
seobility seobility
sexsearcher seoscanners
spyfu siteripz
sogouspider
webgains-bot webgains-bot

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
12bet.com casite-513049.cloudaccess.net
273-fz.ru forums.toucharcade.com
aa8b68101d388c446389283820863176e7.com ledpolice.ru
blog.koorg.ru mensandals.xyz
cv.wallhade.co mncrftpcs.com
finejewelryshop.ru sindragosa.comxa.com
itag.pw solnplast.ru
popander.mobi trackzapper.com
tagil.zrus.org vegascosmetics.ru
warning.or.kr zigarettenonlinekaufen2.drupalgardens.com

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
10bet.com 28n2gl3wfyb0.ru
13tabs.com 45en.ru
1stat.ru 5elementov.ru
3th.co.in absolute-s.ru
4inn.ru anaseracresar.tk
5000-cotydzien.com animalia-life.club
aac500b7a15b2646968f6bd8c6305869d7.com apiappenableinfo-a.akamaihd.net
allblogroll.com arenda-avtoprokat-krasnodar.ru
alphahoverboards.com aruplighting.com
ampower.me c-gainsbourg.com
ausmepa.org.au carapics.com
autonew.biz cartierlovestore.xyz
avkzarabotok.info chatroulette.video
beachfix.co cheapjerseysa.com
best-businessman.ru cherrypointplace.ca
bestmarriages.com cialiswithoutadoctor.net
bet365.com compliance-jess.top
bgviagrachrx.com costablue.xyz
bosman.pluto.ro cougfan.info
brateg.xyz country-chic.ru
bugshoot.cn creativehutindia.com
check-host.net darmebel.com.ua
compliance-ivan.top dear-diary.ru
destinationrealestate.com deniven.1bb.ru
detskie-konstruktory.ru dscaas.website
dichvuvesinhhanoi.com electronicadirect.com
dtm-spain.com elektrischezi.canalblog.com
e-buyeasy.com eropho.com
elektroniksigaraankara.info exoclick.com
extremepornos.net fikasound.tk
femmesdenudees.com filmi-onlain.info
fickluder69.com flipper.top
filesclub.net foto-weinberger.at
gavuer.ru friendflnder.com
gigixo.com golden-catalog.pro
greatidea.marketing groupmoney.ru
hd720kino.ru healthcarestore.info
headpharmacy.com helicalpile.us
hildinghr.se housediz.com
iloveitaly.ru hunthillfarmtrust.org
interferencer.ru i4track.net
jofucipiku.tk intelhdgraphicsgtdrive6w.metroblog.com
kareliatobacco.ru jagg.info
kinobest.pl kerch.site
kinogolos.ru keywordsdoctor.com
kupiproday.com.ua konoplisemena.com
lapolis.it koversite.info
malwareremovalcenter.com linkwithin.com
master-muznachas.ru lombardfinder.ru
meddesk.ru lyngdalhudterapi.no
mnogolok.info mensandals.xyz
morepoweronmac.trade mirmedinfo.ru
mototsikl.org misandesign.se
myblogregistercm.tk moncleronline.xyz
mygameplus.ru money-for-placing-articles.com
nfljerseyscheapbiz.us nacap.ru
o-o-8-o-o.com naj-filmy24.pl
openlibrary.org nfljerseysforsalewholesaler.com
park.above.com offtopic.biz
pattersonsweb.com okroshki.ru
pb-dv.ru omoikiri-japan.ru
picsearch.com ostrovtaxi.ru
pk-pomosch.ru oxotl.com
pekori.to
penisvergrotendepillennl.ovh
photostudiolightings.com
pills24h.com
pixgood.com
plastgranar.nu plastgranar.nu
play.leadzupc.com porngalleries.top
pons-presse.com porno-raskazy.ru
pornhub-forum.ga privatefx.all4invest.info
prizesbook.online prohoster.info
rasteniya-vs-zombi.ru r-e-f-e-r-e-r.com
rcb101.ru randalljhoward.com
reversing.cc realmonte.net
scenicmissouri.us research.ifmo.ru
semaltmedia.com respublica-otel.ru
servicecenter.co.ua royal-investments.net
sextracker.de sbtdesign.co.uk
sneakyboy.com sims-sims.ru
stats-public.grammarly.io siteheart.net
stroydetali.ru sladkoevideo.com
suralink.com smichovbike.cz
t3chtonic.com sofit-dmd.ru
tanieaukcje.com.pl souvenirua.com
tetracsaudi.com spamnuker.com
tizanidinehcl2mgsideeffects.blogspot.com special-porn.com
toproadrunner5.info sudexpert66.ru
tripper.de sukarame.net
uggsale.online taqywu51.soup.io
vbikse.com tizanidinewithdrawalsymptoms.blogspot.com
viagra.pp.ua trumpetedextremes.com
virtuagirl.com undergroundcityphoto.com
vk-mus.ru x-lime.com
voltrknc1.com xgftnlrt.bloger.index.hr
vuclip.com yellowfootprints.com
wallpaperaccess.com youdesigner.kz
woman-h.ru zebradudka.com
ww2awards.info zeroredirect7.com
y8games-free.com
zaimhelp.ru
zarenica.net
zhongwenlink.com
zlatnajesen.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.38 0; 10.1.0.31 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:16 UTC 2023 ### Updated: Sun Jun 11 06:24:25 UTC 2023
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -151,6 +151,8 @@ User-agent: BunnySlippers
Disallow:/ Disallow:/
User-agent: BuzzSumo User-agent: BuzzSumo
Disallow:/ Disallow:/
User-agent: Bytespider
Disallow:/
User-agent: CATExplorador User-agent: CATExplorador
Disallow:/ Disallow:/
User-agent: CCBot User-agent: CCBot

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2023.06.3801 ### Version: V4.2023.06.3802
### Updated: Sat Jun 10 22:01:16 UTC 2023 ### Updated: Sun Jun 11 06:24:25 UTC 2023
### Bad Bot Count: 641 ### Bad Bot Count: 642
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -151,6 +151,8 @@ User-agent: BunnySlippers
Disallow:/ Disallow:/
User-agent: BuzzSumo User-agent: BuzzSumo
Disallow:/ Disallow:/
User-agent: Bytespider
Disallow:/
User-agent: CATExplorador User-agent: CATExplorador
Disallow:/ Disallow:/
User-agent: CCBot User-agent: CCBot