vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-01 01:59:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.03.4341 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-03-02 05:55:23 +00:00
parent a3e89b8816
commit 752cf7fd0c
41 changed files with 264 additions and 280 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4340 #### Version: V4.2024.03.4341
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4340 #### Version: V4.2024.03.4341
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,8 +14,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.03.4340 #### Version: V4.2024.03.4341
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_generator_lists/bad-referrers.list
View file

@ -7102,4 +7102,4 @@ zygophyceous.womanstars.site
zynax.ua zynax.ua
zytpirwai.net zytpirwai.net
zzbroya.com.ua zzbroya.com.ua
zzlgxh.com zzlgxh.com

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.03.4340 #### Version: V4.2024.03.4341
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-05.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -5949,7 +5949,6 @@ domain:thenetinfo.com
domain:thenews-today.info domain:thenews-today.info
domain:thepantonpractice.co.uk domain:thepantonpractice.co.uk
domain:theplacetoupdating.pw domain:theplacetoupdating.pw
domain:thepokertimer.com
domain:theporndude.com domain:theporndude.com
domain:thepornsex.org domain:thepornsex.org
domain:theprofitsmaker.net domain:theprofitsmaker.net

7
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

7
conf.d/globalblacklist-testing-version.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.03.4340 ### Version: V3.2024.03.4341
### Updated: Sat Mar 2 05:04:44 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

7
conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4340 4341

7
dev-tools/globalblacklist-testing.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.03.4340 ### Version: V3.2024.03.4341
### Updated: Sat Mar 2 05:04:44 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

7
dev-tools/globalblacklist.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

1
dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -5949,7 +5949,6 @@
"~*(?:\b)thenews\-today\.info(?:\b)" 0; "~*(?:\b)thenews\-today\.info(?:\b)" 0;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 0; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 0;
"~*(?:\b)thepokertimer\.com(?:\b)" 0;
"~*(?:\b)theporndude\.com(?:\b)" 0; "~*(?:\b)theporndude\.com(?:\b)" 0;
"~*(?:\b)thepornsex\.org(?:\b)" 0; "~*(?:\b)thepornsex\.org(?:\b)" 0;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 0; "~*(?:\b)theprofitsmaker\.net(?:\b)" 0;

1
dev-tools/referrers-regex-format.txt
View file

@ -5949,7 +5949,6 @@
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.51.126 0; 52.159.136.155 0;

7
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 1; 10.1.0.152 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 0; 10.1.0.152 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 1; 10.1.0.152 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 0; 10.1.0.152 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 1; 10.1.0.152 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -5996,7 +5996,6 @@
"~*(?:\b)thenews\-today\.info(?:\b)" 0; "~*(?:\b)thenews\-today\.info(?:\b)" 0;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 0; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 0;
"~*(?:\b)thepokertimer\.com(?:\b)" 0;
"~*(?:\b)theporndude\.com(?:\b)" 0; "~*(?:\b)theporndude\.com(?:\b)" 0;
"~*(?:\b)thepornsex\.org(?:\b)" 0; "~*(?:\b)thepornsex\.org(?:\b)" 0;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 0; "~*(?:\b)theprofitsmaker\.net(?:\b)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 0; 10.1.0.152 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.51.126 0; 52.159.136.155 0;

7
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.51.126 0; 52.159.136.155 0;

7
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:43 UTC 2024 ### Updated: Sat Mar 2 05:51:42 UTC 2024
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7104
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -7035,7 +7035,6 @@ map $http_referer $bad_referer {
"~*(?:\b)thenews\-today\.info(?:\b)" 1; "~*(?:\b)thenews\-today\.info(?:\b)" 1;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 1;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 1; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 1;
"~*(?:\b)thepokertimer\.com(?:\b)" 1;
"~*(?:\b)theporndude\.com(?:\b)" 1; "~*(?:\b)theporndude\.com(?:\b)" 1;
"~*(?:\b)thepornsex\.org(?:\b)" 1; "~*(?:\b)thepornsex\.org(?:\b)" 1;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 1; "~*(?:\b)theprofitsmaker\.net(?:\b)" 1;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 1; 10.1.0.152 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/custom-bad-referrers.conf
View file

@ -5996,7 +5996,6 @@
"~*(?:\b)thenews\-today\.info(?:\b)" 0; "~*(?:\b)thenews\-today\.info(?:\b)" 0;
"~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0; "~*(?:\b)thepantonpractice\.co\.uk(?:\b)" 0;
"~*(?:\b)theplacetoupdating\.pw(?:\b)" 0; "~*(?:\b)theplacetoupdating\.pw(?:\b)" 0;
"~*(?:\b)thepokertimer\.com(?:\b)" 0;
"~*(?:\b)theporndude\.com(?:\b)" 0; "~*(?:\b)theporndude\.com(?:\b)" 0;
"~*(?:\b)thepornsex\.org(?:\b)" 0; "~*(?:\b)thepornsex\.org(?:\b)" 0;
"~*(?:\b)theprofitsmaker\.net(?:\b)" 0; "~*(?:\b)theprofitsmaker\.net(?:\b)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Badass AllSubmitter
BuiltBotTough GT::WWW
Cocolyzebot IDBot
DomainSigmaCrawler Name Intelligence
Fuzz OutclicksBot
GridBot Pavuk
Mojolicious ZmEu
Papa Foto eCatch
PyCurl mediawords
SenutoBot openai

170
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
360Spider 80legs
404enemy AfD-Verbotsverfahren
AIBOT Alligator
ALittle Client Anarchie
AhrefsBot Anarchy
Ankit Apexoo
BBBike BLEXBot
BatchFTP BacklinkCrawler
Battleztar Bazinga Bandit
BuiltBotTough Bolt
BunnySlippers Chlooe
Bytespider
CATExplorador
Claritybot Claritybot
Cocolyzebot Cliqzbot
Cogentbot Crawling at Home Project
Copier DataCha0s
Craftbot DomCopBot
DTS Agent DomainAppender
Demon DomainCrawler
DomainSigmaCrawler DomainStatsBot
Domains Project
EirGrabber EirGrabber
Express WebPictures Express WebPictures
Extreme Picture Finder
FDM FDM
Genieo FacebookBot
GoZilla
Google-Extended Google-Extended
IRLbot HEADMasterSEO
Iblog HMView
Hloader
IlseBot IlseBot
ImagesiftBot
Iskanie Iskanie
Keybot Translation-Search-Machine Jetty
Jorgee
LNSpiderguy
Lanshanbot Lanshanbot
LeechFTP Larbin
LeechGet Libwhisker
Mail.RU_Bot LinksManager
Majestic12 LinqiaMetadataDownloaderBot
MarkWatch Ltx71
Mass Downloader MSIECrawler
Meanpathbot Masscan
MegaIndex.ru Mata Hari
Microsoft Data Access Microsoft URL Control
Minefield Moblie Safari
Mister PiX
MolokaiBot
Mr.4x3 Mr.4x3
Nettrack Nessus
Nibbler Netvibes
Nikto NimbleCrawler
OpenVAS OnCrawl
PECL::HTTP Openfind
Page Analyzer Pandalytics
PageScorer Papa Foto
Pi-Monster PleaseCrawl
Pockey
PxBroker PxBroker
PyCurl RankFlex
ReGet Recorder
RebelMouse
RedesScrapy
RocketCrawler RocketCrawler
SEOkicks-Robot SBIder
SEOlyticsCrawler SEOkicks
SEOprofiler
Scanbot Scanbot
SearchmetricsBot Scrapy
SeoSiteCheckup SeobilityBot
SiteSnagger Seomoz
SiteSucker SiteExplorer
Snake Snapbot
Sociscraper Sottopop
Sosospider SpaceBison
Spammen
Spbot Spbot
Stripper
SuperBot
T0PHackTeam T0PHackTeam
Turingos The Intraformant
VCI TightTwatBot
WWW::Mechanize Titan
Wallpapers Trendiction
Web Enhancer Trendictionbot
WebAuto Turnitin
WebStripper V-BOT
Wprecon WISENutbot
Xaldon WebSpider Web Sauger
Xenu WebEnhancer
Zade WebLeacher
arquivo-web-crawler Webalta
arquivo.pt Website Quester
dataforseobot WebsiteExtractor
gopher Woobot
heritrix YoudaoBot
lwp-request Zermelo
magpie-crawler Zitebot
omgili archive.org_bot
autoemailspider
crawler.feedback
internetVista monitor
oBot
scan.lol
seobility
seocompany.store
seoscanners seoscanners
webpros.com seostar
x22Mozilla serpstatbot
sp_auditbot

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
allkrim.com board.f00d.de
bracketsmackdown.com fakehandbags.xyz
gallerily.com gaytube.com
kimcurlrvsms.com jestr.org
laexotic.com makedo.ru
sanjosestartups.com styro.ru
tizanidinevsvalium.blogspot.com valmetrundan.se
todohr.com win-spy.com
yellowstonesafaritours.com xn--80ajbshivpvn2i.xn--p1ai
zetmaster.ru xtube.com

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
100dollars-seo.com absolute-s.ru
alldubai.biz adserver-e7.com
amazingpic.net adservme.com
anlimebel.kiev.ua advertex.info
arkartex.ru anatomiy.com
apparel-offer.com
automobile-spec.com
avek.ru
bank.uz
bcmp.org bcmp.org
bestbrainprod.win beauty-b0x.pl
bestofupload.info beauty-clinic.ru
bestwrinklecreamnow.com bestmobilityscooterstoday.com
bloglag.com biznesrealnost.ru
bmsco.co bryansk.zrus.org
buyscabiescream.com buybest1.biz
checkm8.com castingbank.ru
compliance-elena.xyz cinemaenergy-hd.ru
coolbar.pro clayvasedesigns.tk
coolingoods.com com-cleaner.systems
crazyprotocol.com com-onlinesupport.site
crest3d.ru compliance-jack.top
culmimg.pw conocer-sanabria.com
deanmoore.ie daisye.top
depositfiles-porn.ga darodar.com
deutschland123.de datract.com
drugspowerstore.com dentalpearls.com.au
easyshoppermac.com diusyawiga.tk
eets.net domain.webkeyit.com
elektrischezi.canalblog.com droidlook.net
elektrozigaretten1.postbit.com eachdayisagift.review
elvenar.com fiuxy.com
fanrto.com ge0ip.net
foxjuegos.com geilehausfrauen.net
gearcraft.us greendream.com.ua
getoutofdebtfree.org hkladys.com
guitar-master.org huimin764128.com
hotenergy.ru igadgetsworld.com
ibb.com.ua infodocsportal.com
informatiecentro.be insurple.com
inspiring-desperate.tk je7.us
interior-stickers.ru junglenet-a.akamaihd.net
iplogger.org keywesthideaways.co
kadashihotel.com kino-filmi.com
kinobaks.com kinogonew.ru
letslowbefast.site kinohall.ru
linkredirect.biz kladrus.ru
linksharingt.com kustanay.kz
lowephotos.info linkdebrideur.xyz
luckyshop.net.ua lionking-1994.blogspot.com
lunchrock.co louisvuittonoutletstore.net
mnogabukaff.net magda-gadalka.ru
moetomnenie.com marwer.info
mp3s.club microsearch.ru
nacap.ru mojpregled.com
naturalbreakthroughsresearch.com myindospace.com
nelc.edu.eg negral.pluto.ro
nomuos.it newhairstylesformen2014.com
obiavo.kz o-o-6-o-o.ru
odesproperty.com offers.bycontext.com
owathemes.com ops.picscout.com
palvira.com.ua ownshop.win
pdamods.ru photostudiolightings.com
picsfair.com picturesfrom.com
piuminiita.com pintattoos.com
pr0fit-b0x.com pk-pomosch.ru
profitwithalex.info platezhka.net
prosperent.com pornonik.com
pxhdwsm.com pp-budpostach.com.ua
rcb101.ru pricheskaonline.ru
rep-am.com promoforum.ru
resultshub-a.akamaihd.net recordpage-a.akamaihd.net
rockma.se remote-dba.de
s8-nowy-wygraj.comli.com rentaremotecomputer.com
sakhboard.ru rentehno.ru
sbdl.no sanidumps.com
scanner-irvin.top sdelatmebel.ru
screentoolkit.com simplesite.com
sex-tracker.de srdrvp.com
smartpet.ru surffoundation.nl
softlinesolutions.me surflinksmedical.com
stats-collector.org sweepstakes.rewardit.com
streha-metalko.si technika-remont.ru
stroyplus.ru telefonsexkostenlos.tk
success-seo.com telegraf.by
swingerseiten.com tizanidinecost.blogspot.com
tabakur77.com tksn.ru
thecoral.com.br traffic2money.com
thiegs.reco.ws uamtrk.com
tizanidinedruginteractions.blogspot.com ucoz.ru
traffmonster.info vandrie-ict.nl
usswrite.com viveresaniesnelli.it
velpanex.ru webcamdevochka.com
versaut.xxx-cam.webcam webjam.com
video-woman.com whos.amung.us
vipromoffers.com wineration.com
website-speed-up.top wtsindia.in
wellcome2slovenia.ru xn----7sbaphztdjeboffeiof6c.xn--p1ai
ww1943.ru yhit.press
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai zeroredirect11.com
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xxxmania.top
youporn-forum.ga
zebramart.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.9 0; 10.1.0.152 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:44 UTC 2024 ### Updated: Sat Mar 2 05:51:43 UTC 2024
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4340 ### Version: V4.2024.03.4341
### Updated: Sat Mar 2 05:04:44 UTC 2024 ### Updated: Sat Mar 2 05:51:43 UTC 2024
### Bad Bot Count: 656 ### Bad Bot Count: 656
################################################### ###################################################
### Version Information ## ### Version Information ##