vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2025.08.5429 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2025-08-27 09:05:19 +00:00
parent 14e4f059f1
commit 5cbac6516f
38 changed files with 1194 additions and 1162 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.08.5428 #### Version: V4.2025.08.5429
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [681](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2025.08.5428 #### Version: V4.2025.08.5429
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [681](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2025.08.5428 #### Version: V4.2025.08.5429
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [681](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
_generator_lists/bad-user-agents.list
View file

@ -1,5 +1,3 @@
Ai2Bot
allenai.org
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -16,6 +14,7 @@ Acunetix
AdsTxtCrawlerTP AdsTxtCrawlerTP
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Ai2Bot
AiHitBot AiHitBot
Aipbot Aipbot
Alexibot Alexibot
@ -596,6 +595,7 @@ ZoominfoBot
ZumBot ZumBot
ZyBorg ZyBorg
adscanner adscanner
allenai.org
anthropic-ai anthropic-ai
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2025.08.5428 #### Version: V4.2025.08.5429
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [679](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [681](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

8
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.08.5428 ### Version: V3.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:39 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -164,6 +164,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -744,6 +745,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

8
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/_robots_input/robots-input.txt
View file

@ -14,6 +14,7 @@ Acunetix
AdsTxtCrawlerTP AdsTxtCrawlerTP
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Ai2Bot
AiHitBot AiHitBot
Aipbot Aipbot
Alexibot Alexibot
@ -594,6 +595,7 @@ ZoominfoBot
ZumBot ZumBot
ZyBorg ZyBorg
adscanner adscanner
allenai.org
anthropic-ai anthropic-ai
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler

2
dev-tools/buildnumber
View file

@ -1 +1 @@
5428 5429

8
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2025.08.5428 ### Version: V3.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:39 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -164,6 +164,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -744,6 +745,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

8
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
48.214.55.37 0; 172.184.211.117 0;

8
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 1; 10.1.0.39 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 0; 10.1.0.39 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 1; 10.1.0.39 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 0; 10.1.0.39 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 1; 10.1.0.39 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -75,6 +75,7 @@
"~*(?:\b)AdsTxtCrawlerTP(?:\b|)" 0; "~*(?:\b)AdsTxtCrawlerTP(?:\b|)" 0;
"~*(?:\b)AfD-Verbotsverfahren(?:\b|)" 0; "~*(?:\b)AfD-Verbotsverfahren(?:\b|)" 0;
"~*(?:\b)AhrefsBot(?:\b|)" 0; "~*(?:\b)AhrefsBot(?:\b|)" 0;
"~*(?:\b)Ai2Bot(?:\b|)" 0;
"~*(?:\b)AiHitBot(?:\b|)" 0; "~*(?:\b)AiHitBot(?:\b|)" 0;
"~*(?:\b)Aipbot(?:\b|)" 0; "~*(?:\b)Aipbot(?:\b|)" 0;
"~*(?:\b)Alexibot(?:\b|)" 0; "~*(?:\b)Alexibot(?:\b|)" 0;
@ -655,6 +656,7 @@
"~*(?:\b)ZumBot(?:\b|)" 0; "~*(?:\b)ZumBot(?:\b|)" 0;
"~*(?:\b)ZyBorg(?:\b|)" 0; "~*(?:\b)ZyBorg(?:\b|)" 0;
"~*(?:\b)adscanner(?:\b|)" 0; "~*(?:\b)adscanner(?:\b|)" 0;
"~*(?:\b)allenai.org(?:\b|)" 0;
"~*(?:\b)anthropic-ai(?:\b|)" 0; "~*(?:\b)anthropic-ai(?:\b|)" 0;
"~*(?:\b)archive.org_bot(?:\b|)" 0; "~*(?:\b)archive.org_bot(?:\b|)" 0;
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 0; 10.1.0.39 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
48.214.55.37 0; 172.184.211.117 0;

8
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
48.214.55.37 0; 172.184.211.117 0;

8
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:28 UTC 2025 ### Updated: Wed Aug 27 09:01:38 UTC 2025
### Bad Referrer Count: 7105 ### Bad Referrer Count: 7105
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -167,6 +167,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3; "~*(?:\b)AdsTxtCrawlerTP(?:\b)" 3;
"~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3; "~*(?:\b)AfD-Verbotsverfahren(?:\b)" 3;
"~*(?:\b)AhrefsBot(?:\b)" 3; "~*(?:\b)AhrefsBot(?:\b)" 3;
"~*(?:\b)Ai2Bot(?:\b)" 3;
"~*(?:\b)AiHitBot(?:\b)" 3; "~*(?:\b)AiHitBot(?:\b)" 3;
"~*(?:\b)Aipbot(?:\b)" 3; "~*(?:\b)Aipbot(?:\b)" 3;
"~*(?:\b)Alexibot(?:\b)" 3; "~*(?:\b)Alexibot(?:\b)" 3;
@ -747,6 +748,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ZumBot(?:\b)" 3; "~*(?:\b)ZumBot(?:\b)" 3;
"~*(?:\b)ZyBorg(?:\b)" 3; "~*(?:\b)ZyBorg(?:\b)" 3;
"~*(?:\b)adscanner(?:\b)" 3; "~*(?:\b)adscanner(?:\b)" 3;
"~*(?:\b)allenai.org(?:\b)" 3;
"~*(?:\b)anthropic-ai(?:\b)" 3; "~*(?:\b)anthropic-ai(?:\b)" 3;
"~*(?:\b)archive.org_bot(?:\b)" 3; "~*(?:\b)archive.org_bot(?:\b)" 3;
"~*(?:\b)arquivo-web-crawler(?:\b)" 3; "~*(?:\b)arquivo-web-crawler(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 1; 10.1.0.39 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -75,6 +75,7 @@
"~*(?:\b)AdsTxtCrawlerTP(?:\b|)" 0; "~*(?:\b)AdsTxtCrawlerTP(?:\b|)" 0;
"~*(?:\b)AfD-Verbotsverfahren(?:\b|)" 0; "~*(?:\b)AfD-Verbotsverfahren(?:\b|)" 0;
"~*(?:\b)AhrefsBot(?:\b|)" 0; "~*(?:\b)AhrefsBot(?:\b|)" 0;
"~*(?:\b)Ai2Bot(?:\b|)" 0;
"~*(?:\b)AiHitBot(?:\b|)" 0; "~*(?:\b)AiHitBot(?:\b|)" 0;
"~*(?:\b)Aipbot(?:\b|)" 0; "~*(?:\b)Aipbot(?:\b|)" 0;
"~*(?:\b)Alexibot(?:\b|)" 0; "~*(?:\b)Alexibot(?:\b|)" 0;
@ -655,6 +656,7 @@
"~*(?:\b)ZumBot(?:\b|)" 0; "~*(?:\b)ZumBot(?:\b|)" 0;
"~*(?:\b)ZyBorg(?:\b|)" 0; "~*(?:\b)ZyBorg(?:\b|)" 0;
"~*(?:\b)adscanner(?:\b|)" 0; "~*(?:\b)adscanner(?:\b|)" 0;
"~*(?:\b)allenai.org(?:\b|)" 0;
"~*(?:\b)anthropic-ai(?:\b|)" 0; "~*(?:\b)anthropic-ai(?:\b|)" 0;
"~*(?:\b)archive.org_bot(?:\b|)" 0; "~*(?:\b)archive.org_bot(?:\b|)" 0;
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Black Hole ALittle Client
Bytespider EroCrawler
CyotekWebCopy Extreme Picture Finder
DSearch Niki-bot
SEOkicks-Robot SemrushBot-FT
Sqlworm VoidEYE
Suzuran Voil
TeleportPro WebBandit
WEBDAV Wprecon
Website Quester Zitebot

166
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
01h4x.com 404checker
360Spider AdsTxtCrawlerTP
AfD-Verbotsverfahren AllSubmitter
Alligator Anarchie
Aspiegel BackStreet
Attach BackWeb
AwarioSmartBot
Black Hole
Blackboard
BlowFish BlowFish
BotALot Buddy
Brandwatch
BuiltBotTough BuiltBotTough
CCBot Cegbfeieh
CensysInspect
ChatGPT-User ChatGPT-User
CheTeam CheTeam
Claritybot Claritybot
Custo
Disco Disco
EMail Wolf DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainSigmaCrawler
Download Wonder
Drip
Ecxi Ecxi
EroCrawler FDM
Express WebPictures Gigabot
Extractor HTMLparser
Extreme Picture Finder IlseBot
Fuzz Information Security Team InfraSec Scanner
GPTBot InterGET
Harvest Internet Ninja
Intelliseek InternetMeasurement
Iria Iskanie
JetCar
Jorgee
JustView
Keyword Density
Kozmosbot
Larbin Larbin
Lightspeedsystems LieBaoFast
LinkScan Likse
LinkextractorPro LinkextractorPro
Ltx71 LinqiaRSSBot
MJ12bot Lipperhey
MSIECrawler Lipperhey Spider
Magnet MFC_Tear_Sample
Mail.RU_Bot MIIxpc
Mediatoolkitbot Mag-Net
Microsoft URL Control Mb2345Browser
MeanPath Bot
MicroMessenger
Moblie Safari Moblie Safari
NPbot NearSite
Navroad NetSpider
Nibbler Nuclei
OnCrawl Nutch
PageScorer Octopus
Pandalytics OpenVAS
Pavuk Openfind
PeoplePal OutclicksBot
PxBroker QueryN Metasearch
RankActiveLinkBot Rainbot
RebelMouse Rankivabot
SEOlyticsCrawler Re-re
SISTRIX RealDownload
Seekport SEOkicks
SEOstats
SemrushBot-BA
Siphon Siphon
SiteExplorer
Siteimprove
Snake
Snapbot
Snoopy
SocialRankIOBot
Sosospider Sosospider
Sottopop SputnikBot
SpaceBison Sucker
Steeler
SuperBot SuperBot
T0PHackTeam SurveyBot
Teleport Suzuran
Telesoft T8Abot
Telesphoreo
TightTwatBot
True_Robot True_Robot
Turnitin VelenPublicWebCrawler
TwengaBot VidibleScraper
Twice
VoidEYE VoidEYE
Voil WBSearchBot
Web Pix WWW::Mechanize
WebGo IS WeSEE
WebSauger WebAuto
WebCollage
WebImageCollector
WebmasterWorldForumBot WebmasterWorldForumBot
WebsiteQuester Webshag
WiseGuys Robot Website Quester
ZmEu Whatweb
arquivo.pt YoudaoBot
coccocbot Zeus
linkdexbot ZoomBot
openai.com adscanner
plumanalytics autoemailspider
seocompany.store awario.com
seoscanners clark-crawler
sexsearcher crawler.feedback
voyagerx.com domainsproject.org
lwp-trivial
s1z.ru
trendiction.com
webgains-bot webgains-bot
xpymep1.exe webmeup-crawler
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
alta-realestate.com date-withme.com
dangphoto.trade extener.org
javxxx18.com mb140.ru
lernur.net mrcsa.com.au
meetlocalchicks.com photostudiolightings.com
mundoaberrante.com playmsn.com
pics-group.com quality-traffic.com
thegamerznetwork.com sindragosa.comxa.com
tuckpointingmasonrysystems.com thfox.com
yougotanewdomain.com xn----itbkqkfiq.xn--p1ai

196
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
000free.us 123kuma.com
1stat.ru 202ch.com
2itech.ru all-streaming-media.com
7fon.ru ample-awards-today.us
aa8780bb28a1de4eb5bff33c28a218a930.com apidigidocketnet-a.akamaihd.net
adpremium.org arenda-avtoprokat-krasnodar.ru
analnoeporno.tv backuperwebcam.weebly.com
anaseracresar.tk beachfix.co
animal36.com bestmobilityscooterstoday.com
apioasisspacenet-a.akamaihd.net bfz.biz
apiwebwebgetcom-a.akamaihd.net
asrvrep-a.akamaihd.net
bala.getenjoyment.net
berrymall.ru
best-coupon-offer.com
beztuberkuleza.ru
boleznikogi.com boleznikogi.com
bonanza-fortune.men budpost.com.ua
brandov.ru bugshoot.cn
buyk.host.sk carloans.com
bvlgaribracelet.xyz compliance-brian.xyz
bwlx.prepedu.cn cornomase.win
cakesplus.com.au covadhosting.biz
carson.getenjoyment.net data-mining.tk
cashonads.com dating-app.ru
chatroulette.life detskie-zabavi.ru
chatroulette.online digitalfaq.com
cialgenisrx.com djstools.com
classiquebijoux.ru ekspresihati.info
cosmetic.donna7753191.ru englishdictionaryfree.com
data-ox.com excitacion.info
dfwu1019.info expresstoplivo.ru
doctissimo.fr filefilter.weebly.com
doeco.ru flash4fun.com
domznaniy.ru froggytube.com
download-wallpaper.net goldadpremium.com
downloadkakaotalk.com hayate.biz
draniki.org himgaws.pw
drupa.com hit-kino.ru
earthmagic.info homegardenlova.com
elektrischezigarette2.onsugar.com howlongdoestizanidinestayinyoursystem.blogspot.com
ezigarettekaufen2.blox.pl husky-shop.cz
fatmaelgarny.com hyiphunter.org
findpik.com idc.com.ua
foodgid.net iframe-toloka.com
foxjuegos.com intelhdgraphicsgtdrive6w.metroblog.com
franecki.net ipornox.xxx
get-seo-domain.com javcoast.com
grand-chlen.ru konkursov.net
i-midias.net.br koversite.info
ifmo.ru ladsup.com
images.gyffu.com landoftracking.com
iomoio.net lechtaczka.net
istizanidineacontrolledsubstance.blogspot.com limads.men
izoll.ru liran-locks.com
kalandranis.gr lkbennettstore.online
laexotic.com m0r0zk0-krava.ru
lenvred.org methodsmarketing.com
lietaer.com mir-betting.ru
likesdesign.com mp3s.club
long-beach-air-conditioning.com mycaf.it
lyngdalhudterapi.no no-fuel.org
meet-flirt-dating.com novosibirsk.xrus.org
mojowhois.com obiavo.by
narco24.me owathemes.com
notebook-pro.ru ownshop.cf
obiavo.uz pila.pl
ofanda.com pliks.pl
pk-services.ru poisk-zakona.ru
pshare.biz pornohd1080.online
rank-checker.online portside.xyz
rankings-analytics.com radiodigital.co
redirectme.net ranking2017.ga
remont-fridge-tv.ru renecaovilla.online
remontgruzovik.ru rep-am.com
renecaovillasale.online responsinator.com
roofers.org.uk russintv.fr
runstocks.com scanner-jessica.top
sbf441.com seonetwizard.com
snjatie-geroinovoy-lomki.ru seorussian.ru
space-worry.ml service.adtech.fr
strigkaomsk.ru sexphoto.site
stroiminsk.org shama-rc.net
swimpool.ca simul.co
syvertsen-da.no softwaretrend.net
tnaionline.org solicita.info
torrents-tracker.com specialfinanceoffers.com
twittruth.com spitfiremusic.com
ucoz.ru sterva.cc
uggsale.online subj.ukr-lit.com
undergroundcityphoto.com sudexpert66.ru
userequip.com support.nopeas.sk
vostoktrade.info surgut.zrus.org
word-vorlagen.net svetlotorg.ru
xboxster.ru top-study.work
xmladserver.com top10-way.com
u555u.info
vacuumcleanerguru.com
viteonlusarezzo.it
wanker.us
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn--80aanaardaperhcem4a6i.com
xn--80ajbshivpvn2i.xn--p1ai xn--80ajbshivpvn2i.xn--p1ai
yaoguangdj.com your-bearings.com
yebocasino.com yoursite.com
ytmnd.com zapatosenventa.info

1796
dev-tools/test_units/ratelimittest-master.txt
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.30 0; 10.1.0.39 0;
127.0.0.1 0; 127.0.0.1 0;

10
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:29 UTC 2025 ### Updated: Wed Aug 27 09:01:39 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -47,6 +47,8 @@ User-agent: AfD-Verbotsverfahren
Disallow:/ Disallow:/
User-agent: AhrefsBot User-agent: AhrefsBot
Disallow:/ Disallow:/
User-agent: Ai2Bot
Disallow:/
User-agent: AiHitBot User-agent: AiHitBot
Disallow:/ Disallow:/
User-agent: Aipbot User-agent: Aipbot
@ -1207,6 +1209,8 @@ User-agent: ZyBorg
Disallow:/ Disallow:/
User-agent: adscanner User-agent: adscanner
Disallow:/ Disallow:/
User-agent: allenai.org
Disallow:/
User-agent: anthropic-ai User-agent: anthropic-ai
Disallow:/ Disallow:/
User-agent: archive.org_bot User-agent: archive.org_bot

10
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2025.08.5428 ### Version: V4.2025.08.5429
### Updated: Tue Aug 26 22:04:29 UTC 2025 ### Updated: Wed Aug 27 09:01:39 UTC 2025
### Bad Bot Count: 679 ### Bad Bot Count: 681
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -47,6 +47,8 @@ User-agent: AfD-Verbotsverfahren
Disallow:/ Disallow:/
User-agent: AhrefsBot User-agent: AhrefsBot
Disallow:/ Disallow:/
User-agent: Ai2Bot
Disallow:/
User-agent: AiHitBot User-agent: AiHitBot
Disallow:/ Disallow:/
User-agent: Aipbot User-agent: Aipbot
@ -1207,6 +1209,8 @@ User-agent: ZyBorg
Disallow:/ Disallow:/
User-agent: adscanner User-agent: adscanner
Disallow:/ Disallow:/
User-agent: allenai.org
Disallow:/
User-agent: anthropic-ai User-agent: anthropic-ai
Disallow:/ Disallow:/
User-agent: archive.org_bot User-agent: archive.org_bot