vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 11:10:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.04.4425 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-04-10 12:29:41 +00:00
parent e27d080862
commit 010015c5e4
37 changed files with 304 additions and 268 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4424 #### Version: V4.2024.04.4425
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [657](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4424 #### Version: V4.2024.04.4425
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [657](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.04.4424 #### Version: V4.2024.04.4425
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [657](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
_generator_lists/bad-user-agents.list
View file

@ -1,5 +1,3 @@
YaK
linkfluence
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -565,6 +563,7 @@ Wprecon
Xaldon\ WebSpider Xaldon\ WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
YaK
YoudaoBot YoudaoBot
Zade Zade
Zauba Zauba
@ -610,6 +609,7 @@ ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
linkdexbot linkdexbot
linkfluence
lwp-request lwp-request
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.04.4424 #### Version: V4.2024.04.4425
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [657](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

8
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4424 ### Version: V3.2024.04.4425
### Updated: Wed Apr 10 12:20:09 UTC 2024 ### Updated: Wed Apr 10 12:25:58 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

8
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/_robots_input/robots-input.txt
View file

@ -563,6 +563,7 @@ Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
YaK
YoudaoBot YoudaoBot
Zade Zade
Zauba Zauba
@ -608,6 +609,7 @@ ips-agent
isitwp.com isitwp.com
iubenda-radar iubenda-radar
linkdexbot linkdexbot
linkfluence
lwp-request lwp-request
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4424 4425

8
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4424 ### Version: V3.2024.04.4425
### Updated: Wed Apr 10 12:20:09 UTC 2024 ### Updated: Wed Apr 10 12:25:58 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

8
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.46.193 0; 20.109.38.155 0;

8
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.129 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.129 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.129 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.129 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.129 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -624,6 +624,7 @@
"~*(?:\b)Xaldon\ WebSpider(?:\b|)" 0; "~*(?:\b)Xaldon\ WebSpider(?:\b|)" 0;
"~*(?:\b)Xaldon_WebSpider(?:\b|)" 0; "~*(?:\b)Xaldon_WebSpider(?:\b|)" 0;
"~*(?:\b)Xenu(?:\b|)" 0; "~*(?:\b)Xenu(?:\b|)" 0;
"~*(?:\b)YaK(?:\b|)" 0;
"~*(?:\b)YoudaoBot(?:\b|)" 0; "~*(?:\b)YoudaoBot(?:\b|)" 0;
"~*(?:\b)Zade(?:\b|)" 0; "~*(?:\b)Zade(?:\b|)" 0;
"~*(?:\b)Zauba(?:\b|)" 0; "~*(?:\b)Zauba(?:\b|)" 0;
@ -669,6 +670,7 @@
"~*(?:\b)isitwp.com(?:\b|)" 0; "~*(?:\b)isitwp.com(?:\b|)" 0;
"~*(?:\b)iubenda-radar(?:\b|)" 0; "~*(?:\b)iubenda-radar(?:\b|)" 0;
"~*(?:\b)linkdexbot(?:\b|)" 0; "~*(?:\b)linkdexbot(?:\b|)" 0;
"~*(?:\b)linkfluence(?:\b|)" 0;
"~*(?:\b)lwp-request(?:\b|)" 0; "~*(?:\b)lwp-request(?:\b|)" 0;
"~*(?:\b)lwp-trivial(?:\b|)" 0; "~*(?:\b)lwp-trivial(?:\b|)" 0;
"~*(?:\b)magpie-crawler(?:\b|)" 0; "~*(?:\b)magpie-crawler(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.129 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.46.193 0; 20.109.38.155 0;

8
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.46.193 0; 20.109.38.155 0;

8
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:08 UTC 2024 ### Updated: Wed Apr 10 12:25:57 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -712,6 +712,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)Xaldon\ WebSpider(?:\b)" 3; "~*(?:\b)Xaldon\ WebSpider(?:\b)" 3;
"~*(?:\b)Xaldon_WebSpider(?:\b)" 3; "~*(?:\b)Xaldon_WebSpider(?:\b)" 3;
"~*(?:\b)Xenu(?:\b)" 3; "~*(?:\b)Xenu(?:\b)" 3;
"~*(?:\b)YaK(?:\b)" 3;
"~*(?:\b)YoudaoBot(?:\b)" 3; "~*(?:\b)YoudaoBot(?:\b)" 3;
"~*(?:\b)Zade(?:\b)" 3; "~*(?:\b)Zade(?:\b)" 3;
"~*(?:\b)Zauba(?:\b)" 3; "~*(?:\b)Zauba(?:\b)" 3;
@ -757,6 +758,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)isitwp.com(?:\b)" 3; "~*(?:\b)isitwp.com(?:\b)" 3;
"~*(?:\b)iubenda-radar(?:\b)" 3; "~*(?:\b)iubenda-radar(?:\b)" 3;
"~*(?:\b)linkdexbot(?:\b)" 3; "~*(?:\b)linkdexbot(?:\b)" 3;
"~*(?:\b)linkfluence(?:\b)" 3;
"~*(?:\b)lwp-request(?:\b)" 3; "~*(?:\b)lwp-request(?:\b)" 3;
"~*(?:\b)lwp-trivial(?:\b)" 3; "~*(?:\b)lwp-trivial(?:\b)" 3;
"~*(?:\b)magpie-crawler(?:\b)" 3; "~*(?:\b)magpie-crawler(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 1; 10.1.1.129 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -624,6 +624,7 @@
"~*(?:\b)Xaldon\ WebSpider(?:\b|)" 0; "~*(?:\b)Xaldon\ WebSpider(?:\b|)" 0;
"~*(?:\b)Xaldon_WebSpider(?:\b|)" 0; "~*(?:\b)Xaldon_WebSpider(?:\b|)" 0;
"~*(?:\b)Xenu(?:\b|)" 0; "~*(?:\b)Xenu(?:\b|)" 0;
"~*(?:\b)YaK(?:\b|)" 0;
"~*(?:\b)YoudaoBot(?:\b|)" 0; "~*(?:\b)YoudaoBot(?:\b|)" 0;
"~*(?:\b)Zade(?:\b|)" 0; "~*(?:\b)Zade(?:\b|)" 0;
"~*(?:\b)Zauba(?:\b|)" 0; "~*(?:\b)Zauba(?:\b|)" 0;
@ -669,6 +670,7 @@
"~*(?:\b)isitwp.com(?:\b|)" 0; "~*(?:\b)isitwp.com(?:\b|)" 0;
"~*(?:\b)iubenda-radar(?:\b|)" 0; "~*(?:\b)iubenda-radar(?:\b|)" 0;
"~*(?:\b)linkdexbot(?:\b|)" 0; "~*(?:\b)linkdexbot(?:\b|)" 0;
"~*(?:\b)linkfluence(?:\b|)" 0;
"~*(?:\b)lwp-request(?:\b|)" 0; "~*(?:\b)lwp-request(?:\b|)" 0;
"~*(?:\b)lwp-trivial(?:\b|)" 0; "~*(?:\b)lwp-trivial(?:\b|)" 0;
"~*(?:\b)magpie-crawler(?:\b|)" 0; "~*(?:\b)magpie-crawler(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BDCbot BBBike
BLEXBot Cosmos
NearSite DittoSpyder
Nmap HEADMasterSEO
ProWebWalker IndeedBot
Quick-Crawler ScrepyBot
Sucker Spbot
Suzuran iubenda-radar
TwengaBot openai.com
x09Mozilla satoristudio.net

176
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
Acunetix 01h4x.com
AhrefsBot 404enemy
Anarchy
Ankit
Aspiegel
AwarioBot AwarioBot
BackWeb BBBike
Backlink-Ceck BDFetch
BlowFish BLEXBot
BuiltBotTough BacklinkCrawler
Bytespider Barkrowler
CheeseBot BotALot
Citoid Buddy
Copier BuzzSumo
Cosmos Claritybot
Craftbot Collector
Crescent CrunchBot
DSearch Custo
DatabaseDriverMysqli DataCha0s
Demon Digincore
Disco DigitalPebble
DomainCrawler DittoSpyder
DomainSigmaCrawler DnBCrawler-Analytics
Domains Project Ezooms
EasyDL FlashGet
Grabber GetRight
HTTP::Lite Gotit
HTTrack GrapeFX
Harvest Havij
HonoluluBot Humanlinks
Id-search InfoTekies
IndeedBot InternetSeer
IstellaBot Joomla
JamesBOT Keyword Density
JennyBot Kozmosbot
Jorgee LeechFTP
JustView LinkWalker
Lightspeedsystems Linkbot
LinksManager LinqiaMetadataDownloaderBot
Lmspider Lmspider
Minefield Majestic12
Mojolicious MeanPath Bot
Musobot MegaIndex.ru
NearSite Mozlila
NetMechanic Msrabot
Nessus
NetSpider
Netvibes
NextGenSearchBot NextGenSearchBot
NimbleCrawler Niki-bot
Nimbostratus Openfind
Nutch Openvas
OrangeBot OrangeBot
OutclicksBot OutfoxBot
POE-Component-Client-HTTP PHPCrawl
PageAnalyzer
PageGrabber PageGrabber
PageThing.com Pandalytics
Proximic Pavuk
Psbot ProPowerBot
RankFlex Probethenet
Rankivabot Quick-Crawler
SemanticJuice RankActive
Re-re
ReGet
SenutoBot SenutoBot
Seomoz Seomoz
SiteSucker Siphon
Sitevigil SiteCheckerBotCrawler
SmartDownload Snake
Sosospider Snoopy
Szukacz SpaceBison
T0PHackTeam Spbot
Thumbor SuperBot
Titan SuperHTTP
Toata TinyTestBot
Trendictionbot Trendictionbot
TwengaBot
Twice Twice
VidibleScraper VCI
WPScan Vagabondo
Wallpapers/3.0 WBSearchBot
WallpapersHD WallpapersHD
WebCollage WeSEE
WebEnhancer WebLeacher
WebFuck WebsiteExtractor
WebZIP
Website Quester
Whack Whack
Wprecon Whatweb
YoudaoBot WinHTTrack
Zitebot Wonderbot
archive.org_bot ZoomBot
arquivo-web-crawler ZumBot
autoemailspider
awario.com
check1.exe
clark-crawler
cohere-ai
domainsproject.org domainsproject.org
heritrix muhstik-scan
ips-agent netEstate NE Crawler
iubenda-radar page scorer
lwp-trivial pcBrowser
openai.com sysscan
polaris version tAkeOut
spyfu webpros.com
webmeup-crawler zgrab
x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
76brighton.co.uk creativehutindia.com
cinemaflix.website dev.citetick.com
druzhininevgeniy63.blogspot.com ege-essay.ru
greendream.com.ua ezigarettenshop2.postbit.com
lion.bolegapakistan.com freetangodownload.com
luxup.ru kamagragelusa.net
millionare.com offer.camp
morpicert.pw tattomedia.com
producm.ru vladimir.xrus.org
referencemoi.com zapiszto.pl

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
3xforum.ro 999webdesign.com
70casino.online admatic.com.tr
8jn.dating-app.ru adultnet.in
adktrailmap.com aerogo.com
adpremium.org alphavisions.net
adverster.com amateurgalls.com
allpdfmags.net asscenihotosidea.blogspot.com
amazingpic.net azbuka-mo.ru
appearance-cool.com bagcionderlab.com
autobrennero.it bmw.afora.ru
automatic-seo.com bvlgariwallet.xyz
back.dog cheapmoncler.pw
brainzpod.win cialischstgerts.com
buyfriend.ru coin-hive.com
buzzonclick.com comissionka.net
bytimedance.ru compliance-andrew.top
chelyabinsk.xrus.org copypaste.traderzplanet.in
cinemaflix.website cyse.tk
clickso.com dealwifi.com
clipartnew.com
compliance-margo.top
crystalslot.com
customerguru.in
daretodonate.co
dbmkfhqk.bloger.index.hr
defenderxtactical.com defenderxtactical.com
diminishedvalueoforegon.com deutschland123.de
domaincrawler.com dev78.dioniqlabb.se
downloadmefiranaratb1972.xpg.com.br diegolopezcastan.com
elvenmachine.com div.as
eshop4u.jp dostavka-v-ukrainu.ru
ewebarticle.info dprtb.com
failingmarriege.blogspot.com eloconcream.blogspot.com
fatmaelgarny.com emergencyneeds.org
feel-planet.com fashion-mk.net
fetroshok.ru free-share-buttons.top
figuringmoneyout.com free-today.com
filkhbr.com galeria-zdjec.com
floridamhca.org goatse.ru
forum-engineering.ru greatgrace.ru
freejabs.com guigyverpo.cf
freemags.cc herokuapp.com
funponsel.com hexpilot.com
futbolkisales.ru hotdl.in
fyl.com.ru hunthillfarmtrust.org
glicol.kz ie.57883.net
hdxnxxtube.mobi ilovevitaly.ru
highstairs-a.akamaihd.net importchinacoach-teach.com
hptwaakw.blog.fc2.com intellekt21.ru
ibb.com.ua interesnie-faktu.ru
iboss.com iomoio.net
interior-stickers.ru james13prix.info
investzalog.ru kaidalibor.de
jolic2.com kashubadesign.ru
katushka.net krasivoe-hd.com
kinosed.net kredit-pod-zalog-krasnodar.ru
knowsitall.info leftofcentrist.com
koptims.tiu.ru lflash.ru
maranbrinfo.com.br linerdrilling.com
middlerush-a.akamaihd.net lion.conboy.us
mobilemedia.md liveu.infoteka.hu
mompussy.net maximilitary.ru
partnerads.men mcadamssupplyco.com
peugeot-club.org medkritika.ru
photochki.com members.ghanaweb.com
privatov-zapisi.ru metabar.ru
pufip.com mirobuvi.com.ua
pussysaga.com mostantikor.ru
revistaindustria.com myblogregistercm.tk
santechnik.jimdo.com nhl17coinsforps3.gratisblog.biz
searchwebknow-a.akamaihd.net nowtorrents.com
seeingmeerkat.com nrv.co.za
sendearnings.com picswe.com
seo18.su picture-group.com
seoprofiler.com pinapchik.com
sexpartygirls.net pipki.r.acdnpro.com
sibtest.ru pornoforadult.com
sideeffectsoftizanidine.blogspot.com progonrumarket.ru
siteimprove.com proprostatit.com
sloopyjoes.com putitin.me
socialbuttons.xyz registrysweeper.com
telemetryverification.net remontgruzovik.ru
thin.me.pn riders.ro
titan-cloud.life scanspyware.net
tizanidinewithdrawal.blogspot.com slonechka.ru
toloka.hurtom.com sonata-arctica.wz.cz
top-deal.com.pl space4updating.win
torrentdownloadhub.com special-porn.com
trafficmania.com squidoo.com
trahvid.com stroicol.net
uggsale.online szucs.ru
utrolive.ru takethatad.com
viel.su tam-gde-more.ru
welcomeauto.ru tizanidineorflexeril.blogspot.com
winterclassichockeyjerseys.com trumpetedextremes.com
www.ehscloud.cn uroki.net
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai vclicks.net
xn--80ab4aa2g.xn--p1ai viagra.pp.ua
xnxx-n.com villacoloniale.com
xxx-treker.ru waterpurifier.club
webix.me
wemarketing.se
xwatt.ru
zajm-zalog-krasnodar.ru
zixizop.net.ru
zvooq.eu

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.42 0; 10.1.1.129 0;
127.0.0.1 0; 127.0.0.1 0;

10
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:09 UTC 2024 ### Updated: Wed Apr 10 12:25:58 UTC 2024
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1145,6 +1145,8 @@ User-agent: Xaldon_WebSpider
Disallow:/ Disallow:/
User-agent: Xenu User-agent: Xenu
Disallow:/ Disallow:/
User-agent: YaK
Disallow:/
User-agent: YoudaoBot User-agent: YoudaoBot
Disallow:/ Disallow:/
User-agent: Zade User-agent: Zade
@ -1235,6 +1237,8 @@ User-agent: iubenda-radar
Disallow:/ Disallow:/
User-agent: linkdexbot User-agent: linkdexbot
Disallow:/ Disallow:/
User-agent: linkfluence
Disallow:/
User-agent: lwp-request User-agent: lwp-request
Disallow:/ Disallow:/
User-agent: lwp-trivial User-agent: lwp-trivial

10
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4424 ### Version: V4.2024.04.4425
### Updated: Wed Apr 10 12:20:09 UTC 2024 ### Updated: Wed Apr 10 12:25:58 UTC 2024
### Bad Bot Count: 657 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1145,6 +1145,8 @@ User-agent: Xaldon_WebSpider
Disallow:/ Disallow:/
User-agent: Xenu User-agent: Xenu
Disallow:/ Disallow:/
User-agent: YaK
Disallow:/
User-agent: YoudaoBot User-agent: YoudaoBot
Disallow:/ Disallow:/
User-agent: Zade User-agent: Zade
@ -1235,6 +1237,8 @@ User-agent: iubenda-radar
Disallow:/ Disallow:/
User-agent: linkdexbot User-agent: linkdexbot
Disallow:/ Disallow:/
User-agent: linkfluence
Disallow:/
User-agent: lwp-request User-agent: lwp-request
Disallow:/ Disallow:/
User-agent: lwp-trivial User-agent: lwp-trivial