From eee6fd42afe4858195436d039d488be15d64e422 Mon Sep 17 00:00:00 2001 From: mitchellkrogza Date: Tue, 6 Sep 2022 22:07:46 +0000 Subject: [PATCH] V4.2022.09.3335 [ci skip] --- AUTO-CONFIGURATION.md | 2 +- MANUAL-CONFIGURATION.md | 2 +- README.md | 2 +- _google_analytics_ghost_spam/README.md | 2 +- .../etc/nginx/conf.d/globalblacklist.conf | 4 +- conf.d/globalblacklist-testing-version.conf | 4 +- conf.d/globalblacklist.conf | 4 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- dev-tools/buildnumber | 2 +- dev-tools/globalblacklist-testing.template | 4 +- dev-tools/globalblacklist.template | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- dev-tools/test_units/blacklist-ips.conf | 2 +- .../random-bots-for-test-quick.list | 20 +- .../test_units/random-bots-for-test.list | 304 +++--- .../random-bots-for-whitelist-test.list | 290 +++--- .../random-referrers-for-test-quick.list | 20 +- .../test_units/random-referrers-for-test.list | 918 +++++++++--------- .../random-referrers-for-whitelist-test.list | 486 +++++----- dev-tools/test_units/ratelimittest-beta.txt | 10 + dev-tools/test_units/ratelimittest-master.txt | 10 - dev-tools/test_units/whitelist-ips.conf | 2 +- dev-tools/tmp/robots.txt | 4 +- robots.txt/robots.txt | 4 +- 47 files changed, 1085 insertions(+), 1085 deletions(-) diff --git a/AUTO-CONFIGURATION.md b/AUTO-CONFIGURATION.md index bb801feea..c3030a070 100755 --- a/AUTO-CONFIGURATION.md +++ b/AUTO-CONFIGURATION.md @@ -4,7 +4,7 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2022.09.3334 +#### Version: V4.2022.09.3335 #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/MANUAL-CONFIGURATION.md b/MANUAL-CONFIGURATION.md index 84decdd4a..afee73f42 100755 --- a/MANUAL-CONFIGURATION.md +++ b/MANUAL-CONFIGURATION.md @@ -4,7 +4,7 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2022.09.3334 +#### Version: V4.2022.09.3335 #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/README.md b/README.md index 95522381c..d14f9cc18 100755 --- a/README.md +++ b/README.md @@ -14,7 +14,7 @@ ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) _______________ -#### Version: V4.2022.09.3334 +#### Version: V4.2022.09.3335 #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/_google_analytics_ghost_spam/README.md b/_google_analytics_ghost_spam/README.md index 0fc73a047..20dd1ac5f 100644 --- a/_google_analytics_ghost_spam/README.md +++ b/_google_analytics_ghost_spam/README.md @@ -3,7 +3,7 @@ # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM _______________ -#### Version: V4.2022.09.3334 +#### Version: V4.2022.09.3335 #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100755 --- a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf +++ b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/conf.d/globalblacklist-testing-version.conf b/conf.d/globalblacklist-testing-version.conf index ff9815c12..af575f326 100644 --- a/conf.d/globalblacklist-testing-version.conf +++ b/conf.d/globalblacklist-testing-version.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/conf.d/globalblacklist.conf b/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100644 --- a/conf.d/globalblacklist.conf +++ b/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/beta_conf_files/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files/conf.d/globalblacklist.conf index ff9815c12..af575f326 100644 --- a/dev-tools/beta_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf index ff9815c12..af575f326 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf index ff9815c12..af575f326 100644 --- a/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf index ff9815c12..af575f326 100644 --- a/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/buildnumber b/dev-tools/buildnumber index c50711584..0c9e1aff5 100644 --- a/dev-tools/buildnumber +++ b/dev-tools/buildnumber @@ -1 +1 @@ -3334 +3335 diff --git a/dev-tools/globalblacklist-testing.template b/dev-tools/globalblacklist-testing.template index ff9815c12..af575f326 100644 --- a/dev-tools/globalblacklist-testing.template +++ b/dev-tools/globalblacklist-testing.template @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2022.09.3334 -### Updated: Tue Sep 6 10:03:35 UTC 2022 +### Version: V3.2022.09.3335 +### Updated: Tue Sep 6 22:01:52 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/globalblacklist.template b/dev-tools/globalblacklist.template index 91ceebfbe..c70422233 100755 --- a/dev-tools/globalblacklist.template +++ b/dev-tools/globalblacklist.template @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf index 4d2389d87..e3f79423f 100644 --- a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -104.214.79.107 0; +20.66.12.14 0; diff --git a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100644 --- a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100644 --- a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf index 91ceebfbe..c70422233 100644 --- a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf index 4d2389d87..e3f79423f 100644 --- a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -104.214.79.107 0; +20.66.12.14 0; diff --git a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf index 29d9ce644..e7c481ab7 100644 --- a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf index 4d2389d87..e3f79423f 100644 --- a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -104.214.79.107 0; +20.66.12.14 0; diff --git a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf index fa6f12da6..b84bdb706 100644 --- a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:34 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:51 UTC 2022 ### Bad Referrer Count: 7097 ### Bad Bot Count: 637 ################################################### diff --git a/dev-tools/test_units/blacklist-ips.conf b/dev-tools/test_units/blacklist-ips.conf index 311f9c8f7..afac70c46 100644 --- a/dev-tools/test_units/blacklist-ips.conf +++ b/dev-tools/test_units/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 1; +10.1.0.163 1; 127.0.0.1 1; diff --git a/dev-tools/test_units/random-bots-for-test-quick.list b/dev-tools/test_units/random-bots-for-test-quick.list index b9821ef31..0953cea49 100644 --- a/dev-tools/test_units/random-bots-for-test-quick.list +++ b/dev-tools/test_units/random-bots-for-test-quick.list @@ -1,10 +1,10 @@ -CATExplorador -CSHttp -CensysInspect -GrabNet -Humanlinks -Kinza -NextGenSearchBot -Piepmatz -Spammen -Stripper +Alligator +BlackWidow +Extractor +Heritrix +MeanPath Bot +MegaIndex.ru +Suzuran +Wallpapers/3.0 +Whatweb +autoemailspider diff --git a/dev-tools/test_units/random-bots-for-test.list b/dev-tools/test_units/random-bots-for-test.list index e41ec0664..31a4ad02a 100644 --- a/dev-tools/test_units/random-bots-for-test.list +++ b/dev-tools/test_units/random-bots-for-test.list @@ -1,250 +1,250 @@ 01h4x.com -360Spider 404checker +404enemy ADmantX +AIBOT +ALittle Client ASPSeek -Abonti Aboundex -AiHitBot -Aipbot AlphaBot -Apexoo +Aspiegel +Atomseobot AwarioSmartBot -BDCbot BDFetch -BLEXBot +BackWeb Backlink-Ceck -BacklinkCrawler -Bandit -BatchFTP Battleztar Bazinga -Bigfoot +BetaBot +Black Hole BlackWidow -Blackboard -BlowFish Boardreader -BotALot -Brandprotect -BuiltBotTough +Buddy BuiltWith Bullseye +BunnySlippers CATExplorador -CCBot -Calculon -CazoodleBot -CensysInspect -ChinaClaw +Cegbfeieh +CheeseBot +CherryPicker +Chlooe Citoid +Claritybot Cliqzbot +Cloud mapping Cocolyzebot Cogentbot +Collector Copier +CopyRightCheck +Copyscape Cosmos -CrazyWebCrawler +Craftbot Crescent -DBLBot -DIIbot -DTS Agent +Custo +Demon Deusu +Disco Discoverybot -DomCopBot -DomainAppender +Dispatch +DnyzBot DomainCrawler -Domains Project -Download Wonder -Dragonfly -ECCP/1.0 EMail Siphon -EasyDL Ebingbong -EirGrabber EroCrawler -Express WebPictures -Extreme Picture Finder -EyeNetIE -Firefox/7.0 +ExtLinksBot +FemtosearchBot FlashGet -G-i-g-a-b-o-t -GetWeb -Go-Ahead-Got-It +FrontPage +Fuzz +Fyrebot +GT::WWW +GalaxyBot +Genieo GoZilla -GrapeFX -GrapeshotCrawler +Gotit +GrabNet +Grabber HTMLparser -HTTP::Lite -HTTrack Haansoft +HaosouSpider Havij -Heritrix -IDBTE4M -IlseBot -Image Sucker +Humanlinks +IDBot +Id-search +IndeedBot +Indy Library InfoNaviRobot +Intelliseek +InterGET +Internet Ninja Iria -Iskanie -IstellaBot -JamesBOT +JOC Web Spider +Jbrofuzz +JennyBot +JikeSpider Jorgee -Jyxobot -Kenjin Spider -Keybot Translation-Search-Machine -Keyword Density -Kozmosbot +Kinza LNSpiderguy -Leap -LeechFTP +Lanshanbot LeechGet +LexiBot +Lftp +LibWeb +LieBaoFast +Lightspeedsystems +LinkScan LinkWalker -LinkextractorPro -LinksManager -LinqiaScrapeBot -MFC_Tear_Sample -MIDown tool +Linkbot +LinkpadBot +LinqiaMetadataDownloaderBot +Lmspider +Ltx71 MIIxpc -MJ12bot -MQQBrowser Mag-Net -Magnet -Mail.RU_Bot -Majestic SEO +Majestic-SEO MarkWatch -MauiBot Mb2345Browser -Mediatoolkitbot +MeanPath Bot +Meanpathbot +Microsoft Data Access Minefield Mister PiX Moblie Safari +Mojeek +Mojolicious Morfeus Fucking Scanner +Mozlila +Msrabot NPbot -NearSite +Name Intelligence +Nameprotect +Needle +Net Vampire NetAnts NetMechanic NetSpider -Netcraft +NetZIP Nettrack +Netvibes NextGenSearchBot -Nikto +Nibbler +Niki-bot +Ninja +Nmap Not Nutch -Offline Explorer -Openvas -OutclicksBot -OutfoxBot +Octopus +OnCrawl +OrangeBot PHPCrawl -POE-Component-Client-HTTP -PageScorer -Panscient -Petalbot +PageGrabber +Pandalytics Pi-Monster -Pimonster +Picscout ProPowerBot Pu_iN -PxBroker -PyCurl +Pump QueryN Metasearch -RSSingBot -RankActive RankFlex RankurBot -ReGet +Re-re RealDownload -Reaper -Ripper +Recorder RocketCrawler -Rogerbot -SBIder -SEOkicks-Robot -SEOlyticsCrawler -SEOstats +SEOprofiler +SMTBot SalesIntelligent Scrapy ScreenerBot -Searchestate +SearchmetricsBot Seekport -SemanticJuice -Shodan +Semrush +SemrushBot +SentiBot +Siphon +Site Sucker +SiteCheckerBotCrawler SiteExplorer -SiteLockSpider -SiteSucker +Sitebeam Sitevigil -SmartDownload -Snapbot +Snake Snoopy +SocialRankIOBot Sogou web spider -Spammen -SpankBot -Spanner +Sosospider +SpaceBison +Spbot +Spinn3r +Sqlmap SuperBot +SuperHTTP +SurveyBot +Suzuran +Swiftbot +Szukacz T8Abot -Teleport -Telesphoreo -The Intraformant +TeleportPro Thumbor -Titan -Toweyabot Trendiction -True_Robot +Turnitin TurnitinBot -TwengaBot -Typhoeus -URLy.Warning -Upflow -VCI +VB Project +Vagabondo VeriCiteCrawler Virusdie -WASALive-Bot -WPScan -WWW-Collector-E -Wallpapers -Wallpapers/3.0 -WallpapersHD -WeSEE +VoidEYE +WBSearchBot +WEBDAV +Web Auto Web Collage Web Enhancer -Web Fetch Web Fuck -WebAuto -WebBandit -WebCollage +Web Pix +Web Sucker WebEnhancer -WebFuck -WebGo IS -WebImageCollector -WebLeacher WebPix -WebSucker -WebmasterWorldForumBot +WebReaper +WebWhacker +Webshag WebsiteExtractor -WebsiteQuester -Webster Whack Whatweb +Widow Wonderbot Wotbox -Wprecon Xaldon WebSpider -Xenu -YoudaoBot -Zauba +Xaldon_WebSpider Zermelo -ZmEu -ZumBot +Zeus +Zitebot ZyBorg -archive.org_bot -arquivo.pt autoemailspider -evc-batch -gopher +backlink-check +cah.io.community +check1.exe +cognitiveseo +com.plumanalytics +crawl.sogou.com +dataforseo.com +facebookscraper +heritrix +iubenda-radar +lwp-request lwp-trivial -meanpathbot +magpie-crawler mediawords -page scorer -plumanalytics polaris version -sogouspider -trendiction.de +probe-image-size +ripz +s1z.ru +scan.lol +seobility +seostar +sitechecker.pro +ubermetrics-technologies.com +voyagerx.com +webgains-bot +webpros.com webprosbot -x09Mozilla x22Mozilla -xpymep1.exe -zgrab +zauba.io diff --git a/dev-tools/test_units/random-bots-for-whitelist-test.list b/dev-tools/test_units/random-bots-for-whitelist-test.list index de8658cf7..c470c7597 100644 --- a/dev-tools/test_units/random-bots-for-whitelist-test.list +++ b/dev-tools/test_units/random-bots-for-whitelist-test.list @@ -1,250 +1,250 @@ 404checker -80legs -ALittle Client +404enemy +ADmantX +ASPSeek Abonti AiHitBot -Anarchie +Aipbot +AllSubmitter +Alligator Anarchy -Attach +Anarchy99 +Anthill +Aspiegel +AwarioRssBot AwarioSmartBot +BDCbot BDFetch -Backlink-Ceck +BLEXBot +BackDoorBot +BackWeb Bandit -Bitacle -Blackboard -BotALot -Buck +Barkrowler +BetaBot +Bigfoot +Blow +Bolt Buddy -CATExplorador -CODE87 +BuiltBotTough +Bullseye +CCBot CSHttp Cegbfeieh +CheeseBot Chlooe Claritybot -Copyscape +Cloud mapping +Cogentbot +Cosmos Craftbot Crawling at Home Project -CrazyWebCrawler -CrunchBot +Crescent CyotekWebCopy -DIIbot -DataCha0s +DSearch +DTS Agent +Demon Deusu -DigitalPebble -Discobot -Dispatch -DittoSpyder -DomCopBot +Digincore DomainAppender -DomainStatsBot +Dotbot +Dragonfly +Drip ECCP/1.0 EMail Siphon -EMail Wolf -EasyDL +Ebingbong +Ecxi EroCrawler -Evil -FDM -FHscan +Express WebPictures +ExtLinksBot +ExtractorPro FemtosearchBot -Firefox/7.0 -FlashGet -Flunky -Foobot -Freeuploader FrontPage -Fyrebot +FyberSpider G-i-g-a-b-o-t -Genieo GetRight -GetWeb -Gigabot -Go-Ahead-Got-It -Grafula -HEADMasterSEO +Getintent +GoZilla +Gotit +HTTP::Lite HTTrack Haansoft -HaosouSpider +Harvest Havij +Heritrix +Hloader HonoluluBot -HybridBot +Iblog Id-search -IlseBot -InterGET +IndeedBot Internet Ninja -InternetSeer Iskanie +JOC Web Spider JamesBOT +JennyBot JetCar JikeSpider -Joomla -JustView -Jyxobot -Keybot Translation-Search-Machine +Jorgee +Keyword Density LWP::Simple -Leap -LeechFTP +Lanshanbot +Larbin LexiBot LieBaoFast -Lightspeedsystems -LinkScan LinkWalker -LinkextractorPro LinkpadBot LinksManager LinqiaScrapeBot +Lipperhey Spider Ltx71 -MIDown tool MJ12bot -MQQBrowser -MarkMonitor -Mass Downloader +Majestic SEO +Majestic-SEO +MarkWatch Masscan MauiBot -MeanPath Bot -Meanpathbot -Mediatoolkitbot MicroMessenger -Microsoft Data Access +Microsoft URL Control Minefield Mister PiX +Moblie Safari Mojolicious -Mozlila Musobot +NICErsPRO Name Intelligence Nameprotect +NearSite +Needle +Nessus Net Vampire NetAnts -NetLyzer -NetMechanic -NetSpider -NetZIP -Netcraft -Nettrack NextGenSearchBot Niki-bot -Nimbostratus +Nikto +NimbleCrawler Ninja Nmap -Not Nutch -OnCrawl -OpenVAS -Openvas -OutfoxBot +Offline Explorer +Offline Navigator +OpenLinkProfiler +Openfind +OrangeBot +OrangeSpider +OutclicksBot +PECL::HTTP +POE-Component-Client-HTTP +PageAnalyzer PageScorer -PageThing.com -Panscient -Picscout -Picsearch -Pimonster +PeoplePal +Petalbot +Piepmatz Pixray +PleaseCrawl Probethenet -Psbot -PxBroker +Pu_iN +Pump QueryN Metasearch +RankActive RankActiveLinkBot -RankingBot -RankingBot2 -Rankivabot +RankFlex +RankurBot Re-re RealDownload -Recorder -RepoMonkey -SEOkicks-Robot +Ripper +RocketCrawler +Rogerbot +SEOlyticsCrawler SEOprofiler -SEOstats -SISTRIX SalesIntelligent +ScanAlert ScoutJet -Screaming +ScreenerBot ScrepyBot SemanticJuice -Semrush -SemrushBot -SeobilityBot -Shodan +Site Sucker SiteCheckerBotCrawler SiteLockSpider +SiteSucker Sitebeam +Sitevigil SmartDownload +Snake Snoopy -Sosospider +SocialRankIOBot SpaceBison Spammen Spanner +Spbot Sqlworm -Stripper -Sucuri -Surfbot -Szukacz -T0PHackTeam -TeleportPro -TightTwatBot -Titan -Toweyabot -Tracemyfile -Turnitin -TurnitinBot -Twice -Typhoeus -Upflow -VCI -VelenPublicWebCrawler -Virusdie -VoidEYE -WASALive-Bot -WWWOFFLE -Wallpapers/3.0 +Sucker +SuperBot +Suzuran +Swiftbot +T8Abot +Telesphorep +Toata +Trendiction +True_Robot +Turingos +TwengaBot +URLy Warning +VB Project +Voltron +WBSearchBot +WPScan WallpapersHD WeSEE Web Auto +Web Enhancer Web Sucker -WebFuck -WebGo IS +WebCopier +WebFetch WebLeacher -WebPix WebSauger +WebWhacker +WebZIP +Webalta Website Quester +WebsiteExtractor WebsiteQuester Webster Whatweb -Widow +Who.is Bot WiseGuys Robot -Woobot -Xenu -YoudaoBot -Zauba +Wonderbot +Xaldon WebSpider Zermelo -Zeus -Zitebot ZmEu -ZoominfoBot +ZoomBot ZumBot -archive.org_bot +ZyBorg +adscanner +arquivo-web-crawler arquivo.pt -autoemailspider -coccocbot -crawl.sogou.com -dataforseo.com -domainsproject.org +backlink-check +check1.exe +clark-crawler +eCatch +gopher heritrix -ips-agent +internetVista monitor linkdexbot lwp-request -magpie-crawler +lwp-trivial +netEstate NE Crawler oBot -pcBrowser -plumanalytics -ripz -s1z.ru -scan.lol -seobility +page scorer +polaris version +scalaj-http seocompany.store -sexsearcher sitechecker.pro -spyfu +siteripz +sogouspider +sp_auditbot sysscan -tAkeOut ubermetrics-technologies.com +voyagerx.com webprosbot +x09Mozilla +x22Mozilla zgrab diff --git a/dev-tools/test_units/random-referrers-for-test-quick.list b/dev-tools/test_units/random-referrers-for-test-quick.list index 8cbac6d6d..07cd134a9 100644 --- a/dev-tools/test_units/random-referrers-for-test-quick.list +++ b/dev-tools/test_units/random-referrers-for-test-quick.list @@ -1,10 +1,10 @@ -briomotor.co -demian.kz -doreenblog.online -efkt.jp -gdcentre.ru -gov.yanao.ru -hobbyhuren24.net -htmlcorner.com -seoanalyses.com -webnode.me +1bet.com +amateurgalls.com +dellalimov.com +f-loaded.de +gallerily.com +gameonasia.com +realitykings.com +realresultslist.com +xlovecam.com +zigarettenonl.canalblog.com diff --git a/dev-tools/test_units/random-referrers-for-test.list b/dev-tools/test_units/random-referrers-for-test.list index 87036ed4b..60beb7e5a 100644 --- a/dev-tools/test_units/random-referrers-for-test.list +++ b/dev-tools/test_units/random-referrers-for-test.list @@ -1,500 +1,500 @@ -00author.com -03p.info -100searchengines.com -123any.com -123movies.love -1kinobig.ru -1millionusd.xyz -2itech.ru -4inn.ru -4kepics.com -4rent.ru -5-steps-to-start-business.com -7fon.ru -8558l.jobs.net -888.com +03e.info +1001desert.com +12masterov.com +2nt.ru +2pxg8bcf.top +76brighton.co.uk +7wind.ru +a1security.com.ua +a96527gi.beget.tech +aa9bd78f328a6a41279d0fad0a88df1901.com +aab94f698f36684c5a852a2ef272e031bb.com abovetherivernc.com -ad-words.ru -adamoads.com -adclickthru.net -adconscious.com -addray.pro -adservme.com -adtech.fr -advocatemsk.ru -albuteroli.com -alert-hgd.xyz -all-number.com -all-streaming-media.com +abwa.tk +academiacsmendoza.org +acunetix-referrer.com +addbin.men +adman.se +adnotbad.com +advokateg.xyz +aerogo.com +agahinameh.com +agroeconom.kz +aihelen.net +airmaxshoes-2016.com +aktivator-windows10.blogspot.com +alert-jdh.xyz +alessandraleone.com +alienwheels.de +allbizne.co.ua alldownload.pw -alldubai.biz -alpinism.ru -ameblo.jp -android-systems.ru -anti-virus-removal.info -aosexkontakte.net -apiallgeniusinfo-a.akamaihd.net -apilinkswiftco-a.akamaihd.net -app-ready.xyz -apper.de -aproposde.com +alphacarolinas.com +alta-realestate.com +amigobulls.com +amospalla.es +anal-acrobats.hol.es +analytics-ads.xyz +androids-store.com +anniemation.com +anonymousfox.co +apartamentwroclaw.eu +apiwebwebgetcom-a.akamaihd.net +appfastplay.com +appfixing.space +arendas.net artefakct.com -asacopaco.tk -asdfg.pro -asrv-a.akamoihd.net -asrvvv-a.akamaihd.net -autoblogger24.info -aviav.co -avitocars.ru -avon-novosib.ru -ayerbo.xhost.ro -azlex.uz -backlink4u.net -bad-stars.net -baikaleminer.com +artpicso.com +astrochicks.com +atlant-auto.info +auto.rusvile.lt +autochoixspinelli.com +autovideobroadcast.com +azartmix.com +baersaratov.ru +bagcionderlab.com +balois.worldbreak.com bank.uz -bard-real.com.ua +battle.net bbsoldes.fr -beachdriveblog.com -beachpics.com +begalka.xyz +beget.tech benchmarkcommunications.co.uk -betterscooter.com -bfz.biz -bibys.com -bidbuy.co.kr -bikini-image.com -bildsuche.ru -billiard-classic.com.ua -bioscorp.ru -blog.yam.com -bmwhighperformers.com -bolegapakistan.com -bonvillan.com -browsepulse-a.akamaihd.net -buckspar.gq -businescoop.men -buyparajumpers.online -buzzurl.jp -buzzzg.men +berdasovivan.ru +bestchoice.cf +bet365.com +betterhdporn.com +bio-optomarket.ru +blackhatworth.com +blackplanet.com +blog.koreadaily.com +bloggers.nl +blogsfunky672.weebly.com +bloke.com +bluejays-jerseys.us +bluesalt.co +bmsco.co +bookmaker-bet.com +bristolhostel.com +bristolhotel.com +brothers-smaller.ru +burger-tycoon.com +buybest1.biz cardsdumps.com -cartierreplica.win -catalogs-parts.com -cdncash.net -cenokos.ru -chatroulette.si -cheapmoncler.win -checktext.org +carmuffler.net +cartierbraceletsreplica.pw +cascadelink.org +cashkitten-a.akamaihd.net +casinopinup-wins.com +ccbill.com +cdncash.org +cellfun.mobi +cheapestjerseys-wholesale.com +cheatcode-lita12.rhcloud.com +check-this-out-now.online +checkhit.com +chelnytruck.ru cherrypointplace.ca -chorus.terakeet.com +chidporn.com +christianlouboutinsaleonline.us cialisovercounteratwalmartusa.com -cialiswithoutadoctor.net -clickbank.net -clksite.com -com-secure.download -compliance-don.xyz -compliance-jack.top -compliance-jane.top -compliance-julia.top -concordexoticrentals.com -confib.ifmo.ru -contentsexpress.com -craftburg.ru -crystalslot.com -cs-passion.pl -customergrowthsystems.com -dame-ns.kz -darkbooks.org -dear-diary.ru -dev.citetick.com -dignitasdata.se -dimfour.com -doeco.ru -dogoimage.com -dojki365.online -domainsphoto.com -domcran.net +cibpenonptib.flu.cc +cienum.fr +clarithromycin500mg.com +cmd.kz +coinsspb.com +community.allhiphop.com +compliance-irvin.xyz +compliance-jess.top +compliance-josh.top +counter.yadro.ru +cpabegins.ru +creditnation.ru +customcatchcan.com +cutt.us +cyprusbuyproperties.com +daisye.top +damasarenai.info +daneshetabiat.com +daptravel.com +daretodonate.co +darmebel.com.ua +darodar.com +dawlenie.com +decenttools.com +delfin-aqua.com.ua +deniven.1bb.ru +detalizaciya-tut.biz +detective01.ru +detskie-zabavi.ru +detsky-nabytek.info +dfiles.me +diarioaconcagua.com +dikx.gdn +divku.ru +dmmspy.com +dneprsvet.com.ua +doctissimo.fr +domaineaneblanc.com domznaniy.ru -donna7753191.ru -doreenblog.online -dotnetdotcom.org -download-walpaperhd.blogspot.com -downloadkakaotalk.com -drugstoreforyou.com -e-commerce-seo1.com +dwomlink.info +efnor-ac.com ekosmetyki.net.pl -el-nation.com -elektrischezigarette1.onsugar.com -enthuse.computernetworksonline.com +elektrischezigaretten1.blogse.nl +elektrischezigaretten2.beeplog.com +elstal.com.pl +emediate.eu +empirepoker.com +enbersoft.com +enginebay.ru +engines-usa.com +envaseslotusama.com +erotiktreff24.info errorfixing.space -escortplius.com -euronis-free.com -ewebarticle.info -exchangeit.gq -exhibitionplus.eu -extener.org -extrabot.com +essay-edu.biz +europages.com.ru +exmasters.com +eyessurgery.ru +ezigarettenshop2.postbit.com ezigaretteshop2.vefblog.net -farmprofi.net -fashionindeed.ml -fastcrawl.com -feargames.ru -ferretsoft.com -fidelityfunding.com -figuringmoneyout.com -fillmewithhappiness.com -filmi-onlain.info -filmidivx.com -filunika.com.ru -florida-tourism.net -food.dtu.dk -forum20.smailik.org -frankofficial.ru -freelinkbuilding.website.tk +failingmarriege.blogspot.com +farmingworm.com +fettefrauen.net +fikasound.tk +filmania-x.ru +finejewelryshop.ru +fishtauto.ru +fitness-video.net +fix-website-errors.com +flashahead.info +flirt4free.com +flowersbazar.com +fm-upgrade.ru +focalink.com +footballfarrago.com +fortevidyoze.net +forums.d2jsp.org +forums.toucharcade.com +fotosfotos.eu +frbizlist.com +free-stock-illustration.com +freelotto.com freewhatsappload.com -freshmac.space -froggytube.com -fugarif.ga -galeria-zdjec.com -gamewrath.com -gamezblox.com -gate5.co.za -gaytube.com -gayxperience.com -gdcentre.ru -ge0ip.net -gktt.ru -glall.ru +freshsuperbloop.com +funtoonez.com +galleryawesome.com +gay.adultgalls.com +gaypornmovie.net +gazporno.com +ge0ip.com +getdot.ru +getmiro.com +getoutofdebtfree.org +goforexvps.com gogalleryawesome.com +goldenggames.com goodwriterssales.com -gopixdatabase.com -gotcher.us -gpirate.com -gpms.org.my -grand-chlen.ru -gribkovye-zabolevaniya.com -gsasearchengineranker.top -gta-top.ru -guildebzh.info -hard-porn.mobi -hatdc.org -hdwalls.xyz -hdxnxxtube.mobi -healing-dysplasia.ru -herehloadibs.cf -holidaypics.org -homedo.fabpage.com -hotcore.info -housekuba.org -hreade.com -ido3.com -ifmo.ru +gorodservis.ru +gotorussia.com +gowreckdiving.com +gsmtlf.ru +guiadeserraazul.com +guod.me +hao123.com +hd-filmy.net +hdimagelib.com +hdpixent.com +hitcpm.com +hopeonthestreet.co.uk +hotel-mkad.ru +hunthillfarmtrust.org +hvd-store.com +ibmdatamanagement.co ikritikimou.gr -ilbe.club -imagine-ex.co -imperia31.ru -imperiafilm.ru -impisr.edunsk.ru -inclk.com -infobabki.ru -innoslicon.com -insider.pro -investmac.com -istizanidineacontrolledsubstance.blogspot.com -iusstf.org -iweblist.info -iyasimasennka.com -japan-bearings.ru -jerseychinabizwholesale.us -jerseyswholesalechinalimited.com +ilmen.net +iloveitaly.ru +img.wallpaperstock.net +imgarcade.com +inet-traffic.com +iwantmyfreecash.com +jav-idol.com +jerseywholesalechinabiz.com +jetsli.de +jongose.ninja +journalhome.com jrcigars.com -kaidalibor.de -keyword-suggestions.com -keywordsking.com -khadastoafarde.tk -klikbonus.com -konoplisemena.com -kosmetyki.tm.pl -kumuk.info -kupiproday.com.ua -ladsup.com -laptop-4-less.com -law-check-eight.xyz -legalrc.biz -lenvred.org -letmacworkfaster.world -lexixxx.com +kazan.zrus.org +kchaxton.com +keywordbasket.com +kino2018.cc +kinosed.net +kleine-titten.biz +kollesa.ru +kongruan.com +konkursov.net +konteiner24.com +koptims.tiu.ru +kovrenok.ru +lacapilla.info +laparfumotec.com +law-check-seven.xyz +lenpipet.ru +letsart.ru +letsrepair.in life.biz.ua -likesdesign.com -linkdebrideur.xyz -linkwithin.com -lionking-1994.blogspot.com -lirunet.ru -livingcanarias.com +lineavabit.it +linkbuddies.com +livingroomdecor.info llastbuy.ru -locationdesaison.com -lockerz.com -loginduepunti.it -lol-smurfs.com -lollypopgaming.com +locustdesign.co lolnex.us -lombardfinder.ru -losangeles-ads.com -lsex.xyz -madot.onlinewebshop.net -magiadinamibia.blogspot.com -mainhp.net -makis.nu +lotto6888.com +luckyday.world +lunamedia.co +machicon-akihabara.info +macresource.co.uk +magicdiet.gq +maglid.ru +magnetic-bracelets.ru +makemoneyonline.com +mararoom.ru marketingvici.com -massage-info.nl -matematikus.info -matsdale.com -maxxtor.eu -mebel-vstroika.ru -medizinreisen.de -meds-online24.com -megagrabber.ru -metabar.ru -mex-annushka.ru -minecraft-rus.org -missis.top -mmofreegames.online -mnogabukaff.net -mnogolok.info -mobstarr.com -mompussy.net -monclerboots.xyz -monclercoats.xyz -monetizationking.net -monsterdivx.com +masterseek.com +meccadumps.net +medkritika.ru +megavolt.net.ua +menstennisforums.com +mhtr.be +michellblog.online +mir-business-24.ru +mirobuvi.com.ua +mmoguider.ru +mnimmigrantrights.net +mobile.ok.ru +mobsfun.net +montazhnic.ru +morefastermac.trade +moroccosurfadventures.com moscow-region.ru -moscow.online-podarki.com moskva.nodup.ru -moz.com -mrbitsandbytes.com +moviezbonkerssk.cf +moyaterapiya.ru mrcsa.com.au -mtmtv.info -music.utrolive.ru -musirc.com -my-aladin.com -mydownloadengine.com -mygameplus.com -mygameplus.ru -myhealthcare.com -nalogovyykodeks.ru -natali-forex.com -naturalbreakthroughsresearch.com -netallergy.ru +mrmoneymustache.com +mustat.com +muz-shoes.ru +mvpicton.co.uk +mycouponizemac.com +myfreetutorials.com +myindospace.com +myprintscreen.com +nastroyke.net +negral.pluto.ro netfacet.net -newstaffadsshop.club -nhl09.ru -nightvision746.weebly.com -niroo.info -no-fuel.org -nodup.ru +netpics.org nordstar.pro -nottyu.xyz -nufaq.com -nuker.com -obiavo.by -obiavo.ru +nrv.co.za +nudo.ca +o00.in obnal.org -officedocuments.net -olvanto.ru -online-hd.pl -onlinedomains.ru -opinionreelle.com -ops.picscout.com -orion-v.com -osb.se11.ru +offtime.ru +oksrv.com +onemactrckr.com +oneshotdate.com +onlinadverts.com +onthemarch.co +openlibrary.org +optibuymac.com +oranga.host.sk +ordernorxx.com +otbelivanie-zubov.com outshop.ru -owathemes.com -ozas.net -palocco.it +owohho.com +painting-planet.com +parajumpersjakkesalgnorge.info +parajumpersstore.online +partner-cdn.men +partner-print.men +partybunny.ru pateaswing.com -patol01.pw -pdn-4.com -pewit.pw -photokitchendesign.com -pics-group.com -piski.top -piulatte.cz -pixshark.com -pk-services.ru -pontiacsolstice.info -popander.mobi -poptool.net -porno.simple-image.com.ua -pornofiljmi.com -pornonik.com -pornpost.in +pc4download.co +pekori.to +pendelprognos.se +piccshare.com +picturesfrom.com +pigrafix.at +pipki.r.acdnpro.com +pistonclasico.com +pladform.ru +plaff-go.ru +playtap.us +plohaya-kreditnaya-istoriya.ru +pooleroadmedicalcentre.co.uk +popunder.net +pornoklad.ru +pornoslive.net pornzone.tv -prospekt-st.ru -proxyelite.biz -puteshestvennik.com -qexyfu.bugs3.com -qpypcx.com -quickloanbank.com -quizzitch.net -qwertty.net -rangjued.com -rapidsites.pro +porodasobak.net +potoideas.us +pretty-mart.com +profitwithalex.info +prosperent.com +prostitutki-kiev.org +puserving.com +putitin.me +puzo2arbuza.ru +pwwysydh.com +questionmarque.ch +rangoman.date +realnye-otzyvy.info rebrand.ly -recordpage-a.akamaihd.net -redbottomheels.xyz -redhotfreebies.co.uk -referencemoi.com -rff-cfal.info -rimedia.org -rocis.site -royal-investments.net -royalvegascasino.com -roznica.com.ua -ruspdd.com -rutor.vip -s-iwantyou.com -sa-live.com +reckonstat.info +registry-clean-up.net +registrydomainservices.com +remont-comp-pomosh.ru +remybutler.fr +renecaovilla.online +respublica-otel.ru +retreatia.com +reyel1985.webnode.fr +ruex.org.ua +rumamba.com +russkoe-zdorovie.ru +sandhillsonline.com +sankt-peterburg.nodup.ru sarm.tk -scanmarine.info -scanner-elena.top -scanner-willy.top -scenicmissouri.us -scoopquest.com -searchtooknow-a.akamaihd.net -seasaltwithfood.com -semalt.com -seokicks.de -seoprofiler.com -seorankinglinks.com -seotoolsagency.com -service.adtech.us +saveriopiazza.it +sbetodiodnye-lampy.ru +scanner-donald.top +scanner-george.top +search.xtconnect.com +sei80.com +sel-hoz.com +selectads.men +seo-tools-optimizing.com +seofirmreviewsus.info +seoholding.com +serpstat.com +service.adtech.fr +servingnotice.com sevenstars7.com -sex-pr.net -sexad.net -sexreliz.com -sexspornotub.com -sexy-pings.com -sfd-chess.ru -sherlock.se -shopsellcardsdumps.com -shopwme.ru -silktide.com -simon3.ru -simply.net -site-speed-check.site -sitevaluation.com -sledstvie-veli.net -smsactivator.ru -soaksoak.ru -socas.pluto.ro -social-s-ggg.xyz -socialseet.ru -socialtrade.biz -solinf.co -sotkal.lark.ru -space-worry.ml -special-porn.com -sr-rekneskap.no -srgwebmail.nl -start.myplaycity.com -starwars.wikia.com -stop-zavisimost.com -strangeduckfilms.com -stroiminsk.com -stroymonolit.su -studiofaca.com -sukarame.net -sundrugstore.com -superinterstitial.com -supermama.top -svnuppsalaorebro.se -sygraem.com +sexyali.com +shitmovs.com +shivafurnishings.com +shop.xz618.com +shopperifymac.com +sideeffectsoftizanidine.blogspot.com +signal03.ru +sims-sims.ru +sizeplus.work +slomm.ru +slujbauborki.ru +smartshoppymac.com +snjack.info +snow.nvr163.com +snworks.com +sobecjvuwa.com.ru +soft1.ru +softonicads.com +softtor.com +softwaretrend.net +sohoindia.net +solitaire-game.ru +souvenir.cc +spaceshipad.com +speechfoodie.com +spyfu.com +ssconstruction.co +statoutlook.info +store-rx.com +stretchingabuckblog.com +stroyplus.ru +sureone.pro +surintech.ac.th +swsociety.se +syndicate.fun +tacbelarus.ru takethatad.com tam-gde-more.ru -tehngr.ru -telefonsexi.com +tanieaukcje.com.pl template-kid.com -thebitcoincode.com -thecoral.com.br -thepornsex.org -thewomenlife.com -thexart.club -tizanidine4mgprice.blogspot.com -tizanidineandhydrocodone.blogspot.com -tizanidinenarcotic.blogspot.com -tizanidinewithdrawal.blogspot.com -tkanorganizma.ru +templates.franklinfire.co +teslathemes.com +tetracsaudi.com +the-trader.net +thegalerie.eu +timdreby.com +tizanidinehcl2mg.blogspot.com +tizanidinemusclerelaxant.blogspot.com +tizanidinezanaflex.blogspot.com +tk-assortiment.ru tn811.us -topbestgames.com -topclickguru.com -topkarkas.com -trackzapper.com -tradedeals.biz -trafficmonetize.org -tramadolandtizanidine.blogspot.com -traxdom.ru -tupper-posuda.ru -twelvevisionspartyofcolorado.com -twittrading.com -ua-company.ru -uchil.net -uginekologa.com -unacittaconte.org +toloka.hurtom.com +toolsky.com +top1-seo-service.com +topshef.ru +topvidos.ru +torrentdownloadhub.com +tour-line.net +tracklead.net +trafficcentr.xyz +trainoffend.ml +triplepanda.xyz +trustl.life +tuckermktg.com +turbodsp.com +turn-up-life.life +txxx.com +u17795.netangels.ru +ugguk.online unimodemhalfduplefw.pen.io -uzporno.mobi -vacuumscleaner.com -vadimkravtcov.ru -valueclick.com -vancleefreplica.pw -vapeface.club -varikoz24.com -vegascosmetics.ru -vektorpress.ru -viddyoze.com -videogamesecrets.com -vip-file.com +uogonline.com +urdoot.win +utiblog.fr +validccseller.com +vapsy.com +vbtracker.net +velobikestock.com +vesnatehno.com +vgoloveboli.net +via-energy-cumpara.com +videochat.tv.br +videojam.tv +vinylvault.co.uk +vip.51.la vipcallsgirls.com -vkgaleria.com -voluumtracker1.com -vuclip.com +virus-respirators.com +vk-mus.ru +vltai.com +voluumtrk.com +vrnelectro.ru +vseigru.one vut.com.ru -w7s.ru -wallpaperaccess.com -warningzscaler.heraeus.com -waycash.net -wdfdocando.com -web-betting.ru -webalan.ru -webpromotion.ae -whatistizanidine2mg.blogspot.com -whipme.yopoint.in -wildcattube.com -wingsoffury2.com -wleuaprpxuvr.ga -womens-journal.net -wowas31.ucoz.ru -wurr.voila.net -www.solartek.ru -wwwadultcheck.com -x-musics.com -xaylapdiendanang.com -xdoza.com -xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai -xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks -xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai -xn--80ab4aa2g.xn--p1ai -xn--80atua3d.xn--p1ai -xn--h1ahbi.com.ua -xn--lifehacer-1rb.com -xpresscare.ru -xtrafficplus.com -xtube.com -xvideosporn.biz -xxx-cam.webcam -xz618.com -yebocasino.com -yoursearch.me -yuarra.pluto.ro -yugo-star.ru -zebramart.ru -zero1.it -zootoplist.com +vvpg.ru +vzlomfb.com +wcb.su +webads.co.nz +wejdz-tu.pl +weprik.ru +whengirlsgowild.com +wholesalejerseychinaoutlet.com +whosonmyserver.com +wnhjavlhezp.gq +womensterritory.ru +wordkeyhelper.com +www.wohnkabinen-shop.de +wygraj-skiny.win +x5market.ru +xkaz.org +xn--80ajbshivpvn2i.xn--p1ai +xxlargepop.com +xxxdatinglocal.us +yellowproxy.net +youdesigner.kz +yourporngay.com +z-master.ru +zaidia.xhost.ro +zeroredirect10.com +zeroredirect2.com +zog.link +zreloeporno.tv +zvooq.eu diff --git a/dev-tools/test_units/random-referrers-for-whitelist-test.list b/dev-tools/test_units/random-referrers-for-whitelist-test.list index e23f3ce53..540681394 100644 --- a/dev-tools/test_units/random-referrers-for-whitelist-test.list +++ b/dev-tools/test_units/random-referrers-for-whitelist-test.list @@ -1,250 +1,250 @@ -108shot.com -123locker.com -2020iscoming.info -3-letter-domains.net -7zap.com -adamoads.com -adsref.men -affrh2015.com -aghanyna.com -alienwheel.es -all-number.com -apibetweenlinesn-a.akamaihd.net -aproposde.com -arcadeplayhouse.com -arenanews.com.ua -artdeko.info -as5000.com -atdedinotuho.tk -atout-energie-69.com -auto-moto-elektronika.cz -auto.rusvile.lt -autobudpostach.club -awaybird.ru -bablonow.ru -backiee.com -baltgem.com -bang-hotties.com -bannerpower.com -basedecor.ru -beachdriveblog.com -beremenyashka.com -bezlimitko.xyz -binomo.kz -bonvillan.com -briomotor.co -camel-beach.com -canyougethighofftizanidine.blogspot.com -cardiosport.com.ua -caulderwoodkennels.com -cbozhe.com -cezartabac.ro -cheapjerseysap.com -check-this-out-now.online -chee-by.biz -christianlouboutinshoes.xyz -cienum.fr -clmforexeu.com -clothesforcash.com -co.lumb.co -compliance-barak.top -compliance-don.xyz -confib.ifmo.ru -coolwallpapers4k.info -copro.pw -creatives.adbetclickin.pink -darmebel.com.ua -data.vtc.pw -decenttools.com -deluxedumps.com -demian.kz -dgfitness.co -doreenblog.online -dorratex.tn -doxysexy.com -dprtb.com -e-commerce-seo1.com -ebonyporn.site +007angels.com +11pikachu.ru +202ch.com +20pascals.nl +2345.com +7fon.ru +acheterviagrafr24.com +advancedcleaner.com +alert-fdm.xyz +allbizne.co.ua +allboard.xobor.de +anonymous-redirect.com +app-ready.xyz +ayakino.net +ayodhya.co +bambi.ck.ua +bankiem.pl +bannerspace.com +batanga.net +bavsac.com +bcmp.org +best-mam.ru +bestdraws.com +biglistofwebsites.com +blobar.org +bloggen.be +bloggers.nl +bonux.nextview.ru +camsex.xxx-cam.webcam +candlehandmade.com +casinopinup-wins.com +cejewelry.xyz +cheapcigarettesc.info +checktext.org +chelnytruck.ru +cjmc.info +clipartnew.com +compiko.info +compliance-jess.top +compliance-margo.top +cookie-law-enforcement-ff.xyz +copypaste.traderzplanet.in +cornomase.win +courtshipgift.com +credit.co.ua +culad.com +cymbaltaandtizanidine.blogspot.com +daisye.top +deshevo-nedorogo.ru +distver.ru +downloadme.life +droidlook.net +econom.co +elektrozigarette1.dreamwidth.org +eng-lyrics.com epicbrogaming.com -eralph.tk +erotiktreff24.info +erotische-geschichten-xxl.com +escortslet.net +eshop.md +essayservicewriting.org +european-torches.ru evidencecleanergold.com -ezb.elvenmachine.com -ezrvrentals.com -fast-wordpress-start.com -feel-planet.com -filmfanatic.com -finejewelryshop.ru -foodcrafts.website -forex.osobye.ru +exoneration-project.us +exonline.info +ezigarettekaufen.myblog.de +facialporntube.com +fatfasts-4tmz.com +fickenprivat.info +filefilter.weebly.com +flex4launch.ru +florida-tourism.net forums.d2jsp.org -gay-file.com -gaygalls.net -gdebestkupit.ru -geoads.com -getlamborghini.ga -gogps.me -good-mummy.ru -graphicwe.org -gratis-sexkontakte.com -haveinc.xyz -hawaiielectriclight.com -heatpower.ru -hebr.myddns-flir.com -homeart.space -homedecoguide.info -ico.re -imitex-plus.ru -immigrational.info -instasexyblog.com -interesnie-faktu.ru -internetproviderstucson.com -ipornox.xxx -jbl-charge.info -jerseyswholesalechinalimited.com -kaac.ru -kolotiloff.ru -krafte.ru -kung-fu-ru.com +frcls.fr +freza-sverlo.ru +frustrated-favorable.gq +fyxabomiw.ru +g33.org +genetworx.com +gnuetella.com +golaya.pw +goodnightjournal.com +googlefeud.com +gosmeb.ru +gsasearchenginerankerhelp.com +hchha.com +healgastro.com +helvetia.com.ua +heroz.fr +high-speed1.net +hildinghr.se +hmmm.cz +homemature.net +hop.clickbank.net +host-protection.com +hotel-mkad.ru +hotsocialz.com +ifirestarter.ru +ihc2015.info +iklysha.ml +ilte.info +istripper.com +itbc.kiev.ua +itis4you.com +ivoiretechnocom.ci +ix20.ru +izhevsk.xrus.org +johnrobertsoninc.com +kartiniresto.com +kashubadesign.ru +kasino-money.pw +kichenaid.ru +kimcurlrvsms.com +klikbonus.com ladsup.com -laexotic.com -lalalove.ru -lenpipet.ru -lexaprogeneric.link -lexiangwan.com -lezbiyanki.net +landmania.ru +laudit.ru +lawyers.cafe +letsrepair.in likrot.com -liky.co.ua -linkdebrideur.xyz -lion.playtap.us -littlesexdolls.com -liver-chintai.org -lkbennettoutlet.online -localmatchbook.com -lonely-mature.com -lottospring.com -mabdoola.blogspot.com -macrotek.ru -manipulyator-peterburg.ru -masterseek.com -meget.co.za -menetie.ru -mir-business-24.ru -mobicover.com.ua -mobile.ok.ru -mobioffertrck.com -mobsfun.net -moncleronline.xyz -moroccosurfadventures.com -musicdaddy.net -muycerdas.xxx -muz-shoes.ru -mxgetcode.com -myfreemp3.eu -naperehresti.info -narco24.me -narkologiya-penza.ru -nastydollars.com -nationalbreakdown.com -naturalpharm.com.ua -nbsproject.ru -newhairstylesformen2014.com -nhl17coinsforps3.gratisblog.biz -niroo.info -no-fuel.org -nonameread45.live -obiavo.uz -offers.bycontext.com -office2web.com -onlineku.com -onlineserialy.ru -oops-cinema.ru -paramountmarble.co.uk -partybunny.ru -pcads.ru -pcgroup.com.uy -pdn-4.com -photosaga.info -physfunc.ru -pijoto.net +limads.men +lionking-1994.blogspot.com +lisque.batcave.net +livingroomdecor.info +lkbennettstore.online +locimge.pw +magento-crew.net +matchpal-a.akamaihd.net +maximpartnerspr.com +mazda-roadsters.com +medosmotr-ufa.ru +memberty.com +mhi-systems.ru +mindeyegames.com +morefastermac.trade +moscow-region.ru +moviemail-online.co.uk +moyakuhnia.ru +moz.com +musezone.su +mydoctorok.ru +myonigroup.com +myshopmatemac.com +nfvsz.com +no-rx.info +nosecret.com.ua +npoet.ru +nuit-artisanale.com +nvformula.ru +online-hit.info +p-business.ru +pcimforum.com +perm-profnastil.ru piter.xrus.org -pizza-imperia.com -plaff-go.ru -popcash.net -porno-video-chati.ru -pornofeuer.com -porto.abuilder.net -pretty-mart.com -printie.com -profitwithalex.info -prombudpostach.com.ua -psoriasis-file.trade -sbtdesign.co.uk -scanner-alex.top -scanner-barak.top -scanner-fred.top -scanner-irvin.top -scanner-jessica.top -scenicmissouri.us -scopich.com -scrapy.org -searchimpression.com -sell-fb-group-here.com -sexsaoy.com -share-buttons-for-free.com -sherlock.se -ship-marvel.co.ua -sinestesia.host.sk -sms2x2.ru -snjack.info -snjatie-geroinovoy-lomki.ru -space-worry.ml -spaceshipad.com -statustroll.com -stickers-market.ru -stillmiracle.com -studentguide.ru -superlist.biz -supervesti.ru -szamponrevita.pl -taranerymagesswa.blogspot.com -tds-advert005.info -thefds.net -tk-assortiment.ru -touchmods.fr -traffic100.com -traffic2money.com -trustl.life -twu.com.ua -u17795.netangels.ru -ukrup.com -umekana.ru -ural-buldozer.ru -urccvfmc.bloger.index.hr -urlopener.blogspot.com.au -v720hd.ru -vacances-voyages.info -visitcambridge.org +pixgood.com +porn-w.org +porno.simple-image.com.ua +pornosmola.info +powenlite24.ru +pregnant.guru +pricheskaonline.ru +princeadvantagesales.com +progonrumarket.ru +prostitutki-tyumeni.org +pts163.ru +rankings-analytics.com +redhotfreebies.co.uk +rep-am.com +ricorsogiustizia.org +rn-to-bsn.com +rospromtest.ru +saitevpatorii.com +scanmarine.info +search.1and1.com +seocdvig.ru +service-core.ru +sexcamamateurchat.com +shakhtar-doneck.ru +shell-pmr.ru +site-analyzer.com +site-auditor.online +solmarket.by +sophang8.com +soundfrost.org +speedup-my.site +splendorsearch-a.akamaihd.net +spylog.com +spymac.net +stockspmb.info +streha-metalko.si +strigkaomsk.ru +students-cheapskate.ml +supernew.org +svensk-poesi.com +svolze.com +talant-factory.ru +taqplayer.info +td-33.ru +technika-remont.ru +teguh.info +teletype.in +textads.men +tfxiq.com +thegalerie.eu +thegolfclub.info +thepantonpractice.co.uk +theporndude.com +thexart.club +tizanidinedosage.blogspot.com +tizanidinehcl2mgtablet.blogspot.com +tnaionline.org +tootoo.to +topcar-krasnodar.ru +topsiteminecraft.com +topsy.com +tour-line.net +trk-4.net +uchil.net +unmaroll.ya.ru +upproar.com +ussearche.cf +v24s.net +valsalud.com +viberdownload10.com +video-woman.com +videogamesecrets.com +videooko.weebly.com vita.com.hr -vladimir.xrus.org -vozbujdenie.com -vsdshnik.com -wallpapersdesk.info -wheelchairliftsarea.com -wholesalejerseysgaa.com -wleuaprpxuvr.ga -wpsecurity.website -wrona.it -ww2awards.info -xedserver.com -xn--lifehacer-1rb.com -xxxhdvideo.site -yaderenergy.ru -yuarra.pluto.ro -yunque.pluto.ro -za-fun-offer.com -zajm-zalog-krasnodar.ru -zeg-distribution.com -zhacker.net -zigarettenonlinekaufen1.bloog.pl -zryydi.com -zzlgxh.com +viteonlusarezzo.it +viveresaniesnelli.it +vladimir.zrus.org +vroze.com +wallpaperstock.net +webkeyit.com +weboptimizes.com +website-datenbank.de +websitevaluebot.com +wordkeyhelper.com +wormix-cheats.ru +ww1943.ru +x69ty.ru +xchangetrak.com +xgames-04.com +xn--d1acah0c.xn--p1ai +xnxx699.com +xxxdatinglocal.us +yaminecraft.ru +youbloodyripper.com +youtoner.it +z-master.ru diff --git a/dev-tools/test_units/ratelimittest-beta.txt b/dev-tools/test_units/ratelimittest-beta.txt index f0474a154..3656720f2 100644 --- a/dev-tools/test_units/ratelimittest-beta.txt +++ b/dev-tools/test_units/ratelimittest-beta.txt @@ -581,4 +581,14 @@

Welcome to the NginX Ultimate Bad Bot Blocker

This is merely used for testing !!!

+ + + +Welcome to NginX + + +
+

Welcome to the NginX Ultimate Bad Bot Blocker

+

This is merely used for testing !!!

+ \ No newline at end of file diff --git a/dev-tools/test_units/ratelimittest-master.txt b/dev-tools/test_units/ratelimittest-master.txt index 3656720f2..f0474a154 100644 --- a/dev-tools/test_units/ratelimittest-master.txt +++ b/dev-tools/test_units/ratelimittest-master.txt @@ -581,14 +581,4 @@

Welcome to the NginX Ultimate Bad Bot Blocker

This is merely used for testing !!!

- - - -Welcome to NginX - - -
-

Welcome to the NginX Ultimate Bad Bot Blocker

-

This is merely used for testing !!!

- \ No newline at end of file diff --git a/dev-tools/test_units/whitelist-ips.conf b/dev-tools/test_units/whitelist-ips.conf index 7baf11936..0a7e1f4b5 100644 --- a/dev-tools/test_units/whitelist-ips.conf +++ b/dev-tools/test_units/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.0.165 0; +10.1.0.163 0; 127.0.0.1 0; diff --git a/dev-tools/tmp/robots.txt b/dev-tools/tmp/robots.txt index c79658aa4..a9d923eca 100644 --- a/dev-tools/tmp/robots.txt +++ b/dev-tools/tmp/robots.txt @@ -6,8 +6,8 @@ ### Version Information # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:36 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:53 UTC 2022 ### Bad Bot Count: 637 ################################################### ### Version Information ## diff --git a/robots.txt/robots.txt b/robots.txt/robots.txt index c79658aa4..a9d923eca 100644 --- a/robots.txt/robots.txt +++ b/robots.txt/robots.txt @@ -6,8 +6,8 @@ ### Version Information # ################################################### -### Version: V4.2022.09.3334 -### Updated: Tue Sep 6 10:03:36 UTC 2022 +### Version: V4.2022.09.3335 +### Updated: Tue Sep 6 22:01:53 UTC 2022 ### Bad Bot Count: 637 ################################################### ### Version Information ##