vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.04.4471 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-04-30 12:55:32 +00:00
parent 9744ae972b
commit ab29a8bd34
38 changed files with 599 additions and 261 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4470 #### Version: V4.2024.04.4471
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [660](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4470 #### Version: V4.2024.04.4471
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [660](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.04.4470 #### Version: V4.2024.04.4471
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [660](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_generator_lists/bad-user-agents.list
View file

@ -1,4 +1,3 @@
InternetMeasurement
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -212,6 +211,7 @@ InfoNaviRobot
InfoTekies InfoTekies
Intelliseek Intelliseek
InterGET InterGET
InternetMeasurement
InternetSeer InternetSeer
Internet\ Ninja Internet\ Ninja
Iria Iria

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.04.4470 #### Version: V4.2024.04.4471
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [660](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

7
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

7
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4470 ### Version: V3.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -361,6 +361,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

7
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

1
dev-tools/_robots_input/robots-input.txt
View file

@ -211,6 +211,7 @@ InfoNaviRobot
InfoTekies InfoTekies
Intelliseek Intelliseek
InterGET InterGET
InternetMeasurement
InternetSeer InternetSeer
Internet Ninja Internet Ninja
Iria Iria

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4470 4471

7
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.04.4470 ### Version: V3.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -361,6 +361,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

7
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.118 0; 4.242.241.141 0;

7
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 1; 10.1.1.99 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 0; 10.1.1.99 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 1; 10.1.1.99 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 0; 10.1.1.99 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 1; 10.1.1.99 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -272,6 +272,7 @@
"~*(?:\b)InfoTekies(?:\b|)" 0; "~*(?:\b)InfoTekies(?:\b|)" 0;
"~*(?:\b)Intelliseek(?:\b|)" 0; "~*(?:\b)Intelliseek(?:\b|)" 0;
"~*(?:\b)InterGET(?:\b|)" 0; "~*(?:\b)InterGET(?:\b|)" 0;
"~*(?:\b)InternetMeasurement(?:\b|)" 0;
"~*(?:\b)InternetSeer(?:\b|)" 0; "~*(?:\b)InternetSeer(?:\b|)" 0;
"~*(?:\b)Internet\ Ninja(?:\b|)" 0; "~*(?:\b)Internet\ Ninja(?:\b|)" 0;
"~*(?:\b)Iria(?:\b|)" 0; "~*(?:\b)Iria(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 0; 10.1.1.99 0;
127.0.0.1 0; 127.0.0.1 0;

7
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.118 0; 4.242.241.141 0;

7
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.118 0; 4.242.241.141 0;

7
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:06 UTC 2024 ### Updated: Tue Apr 30 12:51:47 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -364,6 +364,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)InfoTekies(?:\b)" 3; "~*(?:\b)InfoTekies(?:\b)" 3;
"~*(?:\b)Intelliseek(?:\b)" 3; "~*(?:\b)Intelliseek(?:\b)" 3;
"~*(?:\b)InterGET(?:\b)" 3; "~*(?:\b)InterGET(?:\b)" 3;
"~*(?:\b)InternetMeasurement(?:\b)" 3;
"~*(?:\b)InternetSeer(?:\b)" 3; "~*(?:\b)InternetSeer(?:\b)" 3;
"~*(?:\b)Internet\ Ninja(?:\b)" 3; "~*(?:\b)Internet\ Ninja(?:\b)" 3;
"~*(?:\b)Iria(?:\b)" 3; "~*(?:\b)Iria(?:\b)" 3;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 1; 10.1.1.99 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -272,6 +272,7 @@
"~*(?:\b)InfoTekies(?:\b|)" 0; "~*(?:\b)InfoTekies(?:\b|)" 0;
"~*(?:\b)Intelliseek(?:\b|)" 0; "~*(?:\b)Intelliseek(?:\b|)" 0;
"~*(?:\b)InterGET(?:\b|)" 0; "~*(?:\b)InterGET(?:\b|)" 0;
"~*(?:\b)InternetMeasurement(?:\b|)" 0;
"~*(?:\b)InternetSeer(?:\b|)" 0; "~*(?:\b)InternetSeer(?:\b|)" 0;
"~*(?:\b)Internet\ Ninja(?:\b|)" 0; "~*(?:\b)Internet\ Ninja(?:\b|)" 0;
"~*(?:\b)Iria(?:\b|)" 0; "~*(?:\b)Iria(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Dispatch Image Sucker
DomCopBot LNSpiderguy
Indy Library LieBaoFast
Pump Quick-Crawler
ReGet ScreenerBot
Spammen Sucker
Sqworm SuperHTTP
T0PHackTeam Webshag
Web Auto WiseGuys Robot
Web Fuck adscanner

162
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
01h4x.com 01h4x.com
80legs ALittle Client
ADmantX AdsTxtCrawlerTP
AhrefsBot Anarchy99
AiHitBot
Anthill Anthill
AwarioRssBot Apexoo
BackWeb BackDoorBot
BetaBot BackStreet
BuiltBotTough Bolt
Chlooe Brandwatch
BuzzSumo
Calculon
ChatGPT-User
CheeseBot
ChinaClaw
Citoid Citoid
Cliqzbot Cocolyzebot
Copier Copyscape
Craftbot
Dirbuster Dirbuster
DnBCrawler-Analytics Disco
DomainCrawler Discoverybot
Dragonfly DittoSpyder
Ebingbong Download Wonder
EirGrabber EMail Siphon
Extreme Picture Finder Extractor
FDM FemtosearchBot
Fyrebot
Genieo
GetWeb GetWeb
Go!Zilla GrabNet
Google-Extended Grabber
GrapeshotCrawler HMView
HTTP::Lite HTMLparser
HTTrack HybridBot
HaosouSpider IDBot
Havij IRLbot
Hloader
IDBTE4M
Iblog
Image Fetch Image Fetch
Image Sucker Image Sucker
InfoNaviRobot InfoNaviRobot
JetCar InternetSeer
Jyxobot JikeSpider
Kenjin Spider Keyword Density
Kinza LWP::Simple
Lanshanbot Larbin
Linkbot LinkpadBot
Lipperhey Spider MIIxpc
Lmspider MJ12bot
Mail.RU_Bot Moblie Safari
Majestic SEO MolokaiBot
Mb2345Browser Musobot
NetMechanic NetLyzer
NetZIP
Nettrack Nettrack
Nuclei
Offline Explorer Offline Explorer
Offline Navigator OpenLinkProfiler
Openfind Openvas
OrangeSpider OrangeSpider
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
Papa Foto Papa Foto
Pump Petalbot
RankingBot2 Picscout
Rankivabot RankurBot
RealDownload SEOstats
SEOkicks-Robot Seekport
ScanAlert Semrush
SemanticJuice Sitebeam
Shodan Siteimprove
SiteSucker Sitevigil
SmartDownload Snake
Snoopy Sucker
Sociscraper Surfbot
SpaceBison
Spanner
Spinn3r
SuperBot
SuperHTTP
T8Abot
Telesoft Telesoft
Telesphoreo The Intraformant
TheNomad
Thumbor
Toata Toata
Upflow Turingos
V-BOT Typhoeus
VeriCiteCrawler VB Project
Virusdie VelenPublicWebCrawler
Voil
Web Enhancer Web Enhancer
WebZIP WebCopier
Webalta WebImageCollector
WebsiteExtractor WebStripper
Xaldon_WebSpider Webster
Widow
Wotbox
Zade
ZoominfoBot ZoominfoBot
adscanner
archive.org_bot archive.org_bot
crawler4j awario.com
dataforseo.com cah.io.community
clark-crawler
domainsproject.org domainsproject.org
isitwp.com internetVista monitor
spyfu oBot
ubermetrics-technologies.com omgili
webmeup-crawler polaris version
x09Mozilla serpstatbot
webprosbot

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
androids-store.com 20pascals.nl
camel-beach.com ameblo.jp
compliance-elena.xyz blogos.kz
gemara.com editors.choice6912650.hulfingtonpost.com
huhn.altervista.org fellowshipoftheminds.com
inclk.com jerseychinabizwholesale.us
kmd-pto.ru jyvopys.com
nudepatch.net patterntrader-en.com
sel-hoz.com ratemodels.net
xportvusbdriver8i.snack.ws tds-advert002.info

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
03e.info 007angels.com
4senses.co 123movies.love
aa14ab57a3339c4064bd9ae6fad7495b5f.com 3-letter-domains.net
acheterviagrafr24.com abcdeg.xyz
adtech.us absolutelyanalog.com
agecheckadult.com adclickthru.net
alert-jdh.xyz add-add.men
alot.com apartment.ru
apiadanaknet-a.akamaihd.net apiitsthirteende-a.akamaihd.net
astrochicks.com apishops.ru
arenda-yeisk.ru
autoplate.info
avirasecureserver.com avirasecureserver.com
bamo.xsl.pt ayeartoforget.com
banan.tv bazaronline24.ru
beget.tech bedandbreakfast.com
bestserials.com biglistofwebsites.com
brus-vsem.ru bigpenisguide.com
cartierreplica.pw blog.f00kclan.de
chatroulette.online blogqpot.com
cheapjerseysa.com brendbutik.ru
circlesl.com buyessayonline19.blogspot.ru
corta.co cartierreplica.top
dawlenie.com check-host.net
dinkolove.ya.ru chelnytruck.ru
docsportal.net coindirect.io
drivotracker.com compliance-george.top
dyt.net diminishedvalueoforegon.com
efkt.jp distver.ru
elektronischezi.livejournal.com doeco.ru
elmifarhangi.com downloadme.life
energy-ua.com edge.sharethis.com
eropho.net electronicadirect.com
erotiktreff24.info elektronischezigarettekaufen1.myblog.de
f0815.de enskedesquashclub.se
findpics.pw eropornosex.ru
fitness-video.net genetworx.com
footballfarrago.com googlsucks.com
forex21.ru graphicwe.org
forum-engineering.ru gsasearchenginerankerdiscount.com
forums.d2jsp.org gungamesz.com
freeseedsonline.com gwebtools.com.br
freeuploader.com hermesreplica.win
funcrushgames.com hol.es
glogow.pl hopeonthestreet.co.uk
googglet.com hostingclub.lk
handicapbathtubarea.com ikearugs.xyz
hotenergy.ru inboxdollars.com
hoztorg-opt.ru istmira.ru
impresagaia.it iwanttodeliver.com
intim-uslugi.info jerseywholesalebizchina.com
javxxx18.com khadastoafarde.tk
keywordglobal.co.za lafourmiliaire.com
keywordhouse.com linkbux.ru
kinocccp.net lostaruban.com
kinopolet.net manualterap.roleforum.ru
kit-opt.ru marblestyle.ru
kolotiloff.ru meddesk.ru
laapp.com mobicover.com.ua
languagecode.com mrcsa.com.au
lashstudia.ru mrsdalloways.com
lider-zhaluzi.kiev.ua msk.afora.ru
marcogrup.com myra.top
maximilitary.ru panchro.co.uk
mustat.com playtap.us
muznachas-service.ru pontiacsolstice.info
offers.bycontext.com pornodojd.ru
outclicks.net pr-ten.de
photokitchendesign.com printie.com
piski.top projefrio.com.br
pornhub-ru.com remontbiz.ru
prodess.ru ruex.org.ua
profitfx.online russia-today-video.ru
profitwithalex.info sadaholding.com
purplesphere.in savingsslider-a.akamaihd.net
qld10000.net semxiu.com
quangcaons.com sethrollins.net
rybalka-opt.ru shopvilleroyboch.com.ua
sale-japan.com smartadserver.com
scanner-don.top stroyplus.ru
scanner-walter.top supermodni.com.ua
seinterface.com svarbit.com
seonetwizard.com thecounter.com
spinazdrav.ru thruport.com
sps-shop.com tizanidinefibromyalgia.blogspot.com
spylog.com twiclub.in
talant-factory.ru vezuviy.su
theendivechronicles.com vielporno.net
topflownews.com vonradio.com
torrent-newgames.com westsextube.com
traffic-club.info wtsindia.in
umg-stroy.ru x-diesel.biz
ussearche.cf xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
valkiria-tk.ru xn--e1afanlbnfckd7c3d.xn--p1ai
videonsk.com yun56.co
vip2ch.com zaimite.ru
vvon.co.uk zaobao.com.sg
vzglyadriv.kg zebramart.ru
websites-reviews.com zerocash.msk.ru
yougame.biz zrus.org
zeg-distribution.com
zeroredirect10.com

320
dev-tools/test_units/ratelimittest-master.txt
View file

@ -568,4 +568,324 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.55 0; 10.1.1.99 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:07 UTC 2024 ### Updated: Tue Apr 30 12:51:48 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -441,6 +441,8 @@ User-agent: Intelliseek
Disallow:/ Disallow:/
User-agent: InterGET User-agent: InterGET
Disallow:/ Disallow:/
User-agent: InternetMeasurement
Disallow:/
User-agent: InternetSeer User-agent: InternetSeer
Disallow:/ Disallow:/
User-agent: Internet Ninja User-agent: Internet Ninja

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4470 ### Version: V4.2024.04.4471
### Updated: Tue Apr 30 11:03:07 UTC 2024 ### Updated: Tue Apr 30 12:51:48 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 660
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -441,6 +441,8 @@ User-agent: Intelliseek
Disallow:/ Disallow:/
User-agent: InterGET User-agent: InterGET
Disallow:/ Disallow:/
User-agent: InternetMeasurement
Disallow:/
User-agent: InternetSeer User-agent: InternetSeer
Disallow:/ Disallow:/
User-agent: Internet Ninja User-agent: Internet Ninja