vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.07.4643 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-07-24 15:10:00 +00:00
parent 5d11d74665
commit 76064319eb
38 changed files with 307 additions and 281 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4642 #### Version: V4.2024.07.4643
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [663](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [665](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4642 #### Version: V4.2024.07.4643
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [663](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [665](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.07.4642 #### Version: V4.2024.07.4643
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [663](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [665](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
_generator_lists/bad-user-agents.list
View file

@ -1,5 +1,3 @@
BacklinksExtendedBot
GoogleOther
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -44,6 +42,7 @@ BackStreet
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BacklinksExtendedBot
Badass Badass
Bandit Bandit
Barkrowler Barkrowler
@ -178,6 +177,7 @@ Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GoZilla
Google-Extended Google-Extended
GoogleOther
Gotit Gotit
GrabNet GrabNet
Grabber Grabber

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.07.4642 #### Version: V4.2024.07.4643
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [663](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [665](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

8
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4642 ### Version: V3.2024.07.4643
### Updated: Wed Jul 24 10:03:27 UTC 2024 ### Updated: Wed Jul 24 15:06:18 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -192,6 +192,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -326,6 +327,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

8
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/_robots_input/robots-input.txt
View file

@ -42,6 +42,7 @@ BackStreet
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BacklinksExtendedBot
Badass Badass
Bandit Bandit
Barkrowler Barkrowler
@ -176,6 +177,7 @@ Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla GoZilla
Google-Extended Google-Extended
GoogleOther
Gotit Gotit
GrabNet GrabNet
Grabber Grabber

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4642 4643

8
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4642 ### Version: V3.2024.07.4643
### Updated: Wed Jul 24 10:03:27 UTC 2024 ### Updated: Wed Jul 24 15:06:18 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -192,6 +192,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -326,6 +327,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

8
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.84.127.16 0; 172.183.98.103 0;

8
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 1; 10.1.0.207 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 0; 10.1.0.207 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 1; 10.1.0.207 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 0; 10.1.0.207 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 1; 10.1.0.207 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -103,6 +103,7 @@
"~*(?:\b)BackWeb(?:\b|)" 0; "~*(?:\b)BackWeb(?:\b|)" 0;
"~*(?:\b)Backlink-Ceck(?:\b|)" 0; "~*(?:\b)Backlink-Ceck(?:\b|)" 0;
"~*(?:\b)BacklinkCrawler(?:\b|)" 0; "~*(?:\b)BacklinkCrawler(?:\b|)" 0;
"~*(?:\b)BacklinksExtendedBot(?:\b|)" 0;
"~*(?:\b)Badass(?:\b|)" 0; "~*(?:\b)Badass(?:\b|)" 0;
"~*(?:\b)Bandit(?:\b|)" 0; "~*(?:\b)Bandit(?:\b|)" 0;
"~*(?:\b)Barkrowler(?:\b|)" 0; "~*(?:\b)Barkrowler(?:\b|)" 0;
@ -237,6 +238,7 @@
"~*(?:\b)Go-Ahead-Got-It(?:\b|)" 0; "~*(?:\b)Go-Ahead-Got-It(?:\b|)" 0;
"~*(?:\b)GoZilla(?:\b|)" 0; "~*(?:\b)GoZilla(?:\b|)" 0;
"~*(?:\b)Google-Extended(?:\b|)" 0; "~*(?:\b)Google-Extended(?:\b|)" 0;
"~*(?:\b)GoogleOther(?:\b|)" 0;
"~*(?:\b)Gotit(?:\b|)" 0; "~*(?:\b)Gotit(?:\b|)" 0;
"~*(?:\b)GrabNet(?:\b|)" 0; "~*(?:\b)GrabNet(?:\b|)" 0;
"~*(?:\b)Grabber(?:\b|)" 0; "~*(?:\b)Grabber(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 0; 10.1.0.207 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.84.127.16 0; 172.183.98.103 0;

8
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.84.127.16 0; 172.183.98.103 0;

8
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:26 UTC 2024 ### Updated: Wed Jul 24 15:06:17 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -195,6 +195,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)BackWeb(?:\b)" 3; "~*(?:\b)BackWeb(?:\b)" 3;
"~*(?:\b)Backlink-Ceck(?:\b)" 3; "~*(?:\b)Backlink-Ceck(?:\b)" 3;
"~*(?:\b)BacklinkCrawler(?:\b)" 3; "~*(?:\b)BacklinkCrawler(?:\b)" 3;
"~*(?:\b)BacklinksExtendedBot(?:\b)" 3;
"~*(?:\b)Badass(?:\b)" 3; "~*(?:\b)Badass(?:\b)" 3;
"~*(?:\b)Bandit(?:\b)" 3; "~*(?:\b)Bandit(?:\b)" 3;
"~*(?:\b)Barkrowler(?:\b)" 3; "~*(?:\b)Barkrowler(?:\b)" 3;
@ -329,6 +330,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Go-Ahead-Got-It(?:\b)" 3; "~*(?:\b)Go-Ahead-Got-It(?:\b)" 3;
"~*(?:\b)GoZilla(?:\b)" 3; "~*(?:\b)GoZilla(?:\b)" 3;
"~*(?:\b)Google-Extended(?:\b)" 3; "~*(?:\b)Google-Extended(?:\b)" 3;
"~*(?:\b)GoogleOther(?:\b)" 3;
"~*(?:\b)Gotit(?:\b)" 3; "~*(?:\b)Gotit(?:\b)" 3;
"~*(?:\b)GrabNet(?:\b)" 3; "~*(?:\b)GrabNet(?:\b)" 3;
"~*(?:\b)Grabber(?:\b)" 3; "~*(?:\b)Grabber(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 1; 10.1.0.207 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -103,6 +103,7 @@
"~*(?:\b)BackWeb(?:\b|)" 0; "~*(?:\b)BackWeb(?:\b|)" 0;
"~*(?:\b)Backlink-Ceck(?:\b|)" 0; "~*(?:\b)Backlink-Ceck(?:\b|)" 0;
"~*(?:\b)BacklinkCrawler(?:\b|)" 0; "~*(?:\b)BacklinkCrawler(?:\b|)" 0;
"~*(?:\b)BacklinksExtendedBot(?:\b|)" 0;
"~*(?:\b)Badass(?:\b|)" 0; "~*(?:\b)Badass(?:\b|)" 0;
"~*(?:\b)Bandit(?:\b|)" 0; "~*(?:\b)Bandit(?:\b|)" 0;
"~*(?:\b)Barkrowler(?:\b|)" 0; "~*(?:\b)Barkrowler(?:\b|)" 0;
@ -237,6 +238,7 @@
"~*(?:\b)Go-Ahead-Got-It(?:\b|)" 0; "~*(?:\b)Go-Ahead-Got-It(?:\b|)" 0;
"~*(?:\b)GoZilla(?:\b|)" 0; "~*(?:\b)GoZilla(?:\b|)" 0;
"~*(?:\b)Google-Extended(?:\b|)" 0; "~*(?:\b)Google-Extended(?:\b|)" 0;
"~*(?:\b)GoogleOther(?:\b|)" 0;
"~*(?:\b)Gotit(?:\b|)" 0; "~*(?:\b)Gotit(?:\b|)" 0;
"~*(?:\b)GrabNet(?:\b|)" 0; "~*(?:\b)GrabNet(?:\b|)" 0;
"~*(?:\b)Grabber(?:\b|)" 0; "~*(?:\b)Grabber(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AdsTxtCrawlerTP Image Sucker
AlphaBot Joomla
Asterias Mail.RU_Bot
CazoodleBot Majestic12
Kozmosbot OpenLinkProfiler
Mozlila PxBroker
PictureFinder RocketCrawler
Pump Snake
Spammen Vagabondo
Swiftbot WWW::Mechanize

182
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
ALittle Client Aboundexbot
BackDoorBot Apexoo
BackStreet BacklinkCrawler
BackWeb Bandit
Bitacle Battleztar Bazinga
Black Hole Blow
BlackWidow Bolt
Boardreader
Buddy
BuiltBotTough BuiltBotTough
BuiltWith Bullseye
CCBot Collector
CSHttp Copyscape
ChatGPT-User Crescent
CheeseBot DBLBot
Citoid Devil
Cogentbot DomCopBot
Cosmos DomainCrawler
Curious Ebingbong
DomainStatsBot EirGrabber
Dragonfly Exabot
EMail Siphon Extractor
EroCrawler ExtractorPro
Evil Ezooms
Express WebPictures
Fimap Fimap
GetWeb
Google-Extended Google-Extended
GridBot GrapeshotCrawler
HMView HMView
HTTrack HonoluluBot
Harvest IDBTE4M
IDBot InfoNaviRobot
JOC Web Spider Internet Ninja
JetCar InternetMeasurement
Joomla Jbrofuzz
Lanshanbot Jetty
LeechGet Keybot Translation-Search-Machine
Lightspeedsystems LNSpiderguy
Linkbot LieBaoFast
LinksManager LinkWalker
Ltx71 LinkpadBot
MFC_Tear_Sample LinqiaMetadataDownloaderBot
Majestic-SEO LinqiaScrapeBot
Mediatoolkitbot Lipperhey
Moblie Safari MQQBrowser
Morfeus Fucking Scanner Mata Hari
Navroad Mozlila
Net Vampire Msrabot
Netvibes NimbleCrawler
Ninja Nmap
Offline Navigator Nutch
OrangeBot Offline Explorer
OutclicksBot POE-Component-Client-HTTP
Petalbot PageGrabber
ProWebWalker Pi-Monster
Probethenet ProPowerBot
PyCurl Pu_iN
Rainbot Quick-Crawler
RedesScrapy RSSingBot
SBIder RankActiveLinkBot
SEOprofiler RepoMonkey
Scanbot SEOkicks
ScreenerBot SEOkicks-Robot
SearchmetricsBot SEOstats
SeekportBot Searchestate
SemanticJuice
SenutoBot
Site Sucker Site Sucker
SputnikBot SiteLockSpider
SurveyBot SlySearch
Szukacz Spanner
T8Abot T8Abot
TinyTestBot TheNomad
Toweyabot Twice
Trendiction Voltron
VidibleScraper
Virusdie
Voil
WEBDAV
WPScan
WeSEE
WebPix WebPix
WebReaper
WebSauger WebSauger
WebZIP WebsiteExtractor
Woobot Whack
YaK Widow
Zauba WinHTTrack
adscanner Xaldon_WebSpider
autoemailspider Zermelo
dataforseobot Zeus
eCatch ZyBorg
heritrix cohere-ai
instabid crawler.feedback
lwp-request demandbase-bot
page scorer evc-batch
scalaj-http gopher
seobility internetVista monitor
serpstatbot isitwp.com
sexsearcher meanpathbot
openai
s1z.ru
seoscanners
spyfu
ubermetrics-technologies.com ubermetrics-technologies.com
zauba.io webgains-bot
webpros.com
x09Mozilla
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
acads.net anti-virus-removal.info
erotische-geschichten-xxl.com bjanshee.ru
headpharmacy.com countbertwistdisp26.soup.io
medictube.ru creditmoney.com.ua
pavlodar.xkaz.org earl-brown.info
sbtdesign.co.uk homeandhealth.ru
sexytrend.ru lion.conboy.us
spb.afora.ru smartadserver.com
videokrik.net spyfu.com
yuweng.info stuff-about-money.com

196
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
2rich4bitches.com academia-nsk.org
7minuteworkout.com ahrefs.com
admanaerofoil.com amehdaily.com
adtech.us anatomiy.com
alfabot.xyz apartamentwroclaw.eu
android-vsem.org arquivo.pt
autoseo-traffic.com asia-forum.ru
awaybird.ru bestwebsiteawards.com
bet-prognoz.com biographiya.com
bloke.com blavia.00author.com
bwlx.prepedu.cn blpmovies.com
callejondelpozo.es burkesales.com
camel-beach.com buyessaynow.biz
cartierlovestore.com cartierwatch.xyz
cbozhe.com chinaelitecheapjerseys.com
check-host.net clicksor.net
clickpapa.com compliance-barak.xyz
com-secure.download crirussian.ru
compliance-ivan.xyz danschawbel.com
continent-e.tv darodar.com
dalavia.ru dfiles.me
ddsoldes.fr dostavka-v-krym.com
domini.cat download-of-the-warez.blogspot.com
dominterior.org drillsaw.ru
ecommerce-seo.com drunkmoms.net
elektrischezigaretten1.blogse.nl elektrozigaretten1.webs.com
epngo.bz evening-dating-club.info
fatmaelgarny.com exportshop.us
filmci.pro fashionindeed.ml
fr.netlog.com filmgo.ru
freefoto.ca forpostlock.ru
freshberry.com.ua freakycheats.com
hoterika.com hazardky.net
images-free.net heygidday.biz
imguramx.pw impisr.edunsk.ru
investingclub.ru incep.imagine-ex.co
iqupdatetmz.win itis4you.com
itbc.kiev.ua jo24news.com
javidol.site kihi.gdn
kaac.ru kinoplen.ru
larutti.ru kostenlos-sexvideos.com
lernur.net kotaku.com
lineshops.biz krasivye-devushki.net
liver-chintai.org ktotut.net
lkbennettoutlet.online laexotic.com
lol-smurfs.com landinez.co
makedo.ru laparfumotec.com
marinetraffic.com lexixxx.com
mobile.ok.ru lsp-awak-perikanan.com
musicdaddy.net meccadumps.net
mwtpludn.review moesen-ficken.com
myperiod.club mole.pluto.ro
news-speaker.com monarchfind-a.akamaihd.net
nhl09.ru morlat.altervista.org
okmusic.jp mototsikl.org
ostrovtaxi.ru mp3ritm.top
paidonlinesites.com mydownloadengine.com
pc-services.ru mylesosibirsk.ru
pdn-4.com myxdate.info
pertlocogasilk.tk nastroyke.net
picanalyzer.data-ox.com nbsproject.ru
pornosemki.info negociosdasha.com
pornosmola.info nextbackgroundcheck.gq
privetsochi.ru npoet.ru
promgirldresses.xyz offergroup.info
prostitutki-kiev.org onlineporno.site
pukaporn.com oops-cinema.ru
razvratnoe.org panicatack.com
registrysweeper.com phuketscreen.com
remont-fridge-tv.ru picurams.pw
resellerclub.com pixelrz.com
reversing.cc potolokelekor.ru
ruf777.com pozdravleniya-c.ru
sale-japan.com presleycollectibles.com
privatefx-in.ru
profitsport.club
profitwithalex.info
putitin.me
rniaeba.ga
scanner-alexa.top scanner-alexa.top
scottbywater.com seokicks.de
sexad.net sexyteens.hol.es
slkrm.ru sk.golden-praga.ru
spinazdrav.ru snip.to
sport-video-obzor.ru
star61.de star61.de
swingerseiten.com stats-public.grammarly.io
syndicate.fun sticken.co
tizanidineusedfor.blogspot.com tds-advert002.info
top-study.work tobeyouday.win
torrentdownloadhub.com torture.ml
traffic2cash.org vipms.ru
trafficmonetize.org vote-up.ru
tula.mdverey.ru vucms.com
uhod-za-sobakoj.ru weburok.com
vacuumcleanerguru.com whiteelephantwellington.com
validccseller.com xn----ctbigni3aj4h.xn--p1ai
viagraneggrx.com yougetsignal.com
vita.com.hr zaloadi.ru
vysigy.su zrizvtrnpale.tk
website-stealer.nufaq.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xnxx-n.com
yottos.com
youporn-ru.com
zeroredirect7.com

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -878,14 +878,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.14 0; 10.1.0.207 0;
127.0.0.1 0; 127.0.0.1 0;

10
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:28 UTC 2024 ### Updated: Wed Jul 24 15:06:19 UTC 2024
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -103,6 +103,8 @@ User-agent: Backlink-Ceck
Disallow:/ Disallow:/
User-agent: BacklinkCrawler User-agent: BacklinkCrawler
Disallow:/ Disallow:/
User-agent: BacklinksExtendedBot
Disallow:/
User-agent: Badass User-agent: Badass
Disallow:/ Disallow:/
User-agent: Bandit User-agent: Bandit
@ -371,6 +373,8 @@ User-agent: GoZilla
Disallow:/ Disallow:/
User-agent: Google-Extended User-agent: Google-Extended
Disallow:/ Disallow:/
User-agent: GoogleOther
Disallow:/
User-agent: Gotit User-agent: Gotit
Disallow:/ Disallow:/
User-agent: GrabNet User-agent: GrabNet

10
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4642 ### Version: V4.2024.07.4643
### Updated: Wed Jul 24 10:03:28 UTC 2024 ### Updated: Wed Jul 24 15:06:19 UTC 2024
### Bad Bot Count: 663 ### Bad Bot Count: 665
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -103,6 +103,8 @@ User-agent: Backlink-Ceck
Disallow:/ Disallow:/
User-agent: BacklinkCrawler User-agent: BacklinkCrawler
Disallow:/ Disallow:/
User-agent: BacklinksExtendedBot
Disallow:/
User-agent: Badass User-agent: Badass
Disallow:/ Disallow:/
User-agent: Bandit User-agent: Bandit
@ -371,6 +373,8 @@ User-agent: GoZilla
Disallow:/ Disallow:/
User-agent: Google-Extended User-agent: Google-Extended
Disallow:/ Disallow:/
User-agent: GoogleOther
Disallow:/
User-agent: Gotit User-agent: Gotit
Disallow:/ Disallow:/
User-agent: GrabNet User-agent: GrabNet