From 4e6147b1d0cfb868478ae2a7bc4a9af391237b61 Mon Sep 17 00:00:00 2001 From: mitchellkrogza Date: Tue, 28 Sep 2021 10:09:23 +0000 Subject: [PATCH] V4.2021.09.2618 [ci skip] --- AUTO-CONFIGURATION.md | 2 +- MANUAL-CONFIGURATION.md | 2 +- README.md | 2 +- _google_analytics_ghost_spam/README.md | 2 +- .../etc/nginx/conf.d/globalblacklist.conf | 4 +- conf.d/globalblacklist-testing-version.conf | 4 +- conf.d/globalblacklist.conf | 4 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- dev-tools/buildnumber | 2 +- dev-tools/globalblacklist-testing.template | 4 +- dev-tools/globalblacklist.template | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/blacklist-ips.conf | 2 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- .../bots.d/whitelist-ips.conf | 2 +- .../conf.d/globalblacklist.conf | 4 +- dev-tools/test_units/blacklist-ips.conf | 2 +- .../random-bots-for-test-quick.list | 20 +- .../test_units/random-bots-for-test.list | 310 +++--- .../random-bots-for-whitelist-test.list | 288 +++--- .../random-referrers-for-test-quick.list | 20 +- .../test_units/random-referrers-for-test.list | 912 +++++++++--------- .../random-referrers-for-whitelist-test.list | 486 +++++----- dev-tools/test_units/ratelimittest-master.txt | 9 +- dev-tools/test_units/whitelist-ips.conf | 2 +- dev-tools/tmp/robots.txt | 4 +- robots.txt/robots.txt | 4 +- 46 files changed, 1075 insertions(+), 1082 deletions(-) diff --git a/AUTO-CONFIGURATION.md b/AUTO-CONFIGURATION.md index a7b7937fb..394aa48bb 100755 --- a/AUTO-CONFIGURATION.md +++ b/AUTO-CONFIGURATION.md @@ -4,7 +4,7 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2021.09.2617 +#### Version: V4.2021.09.2618 #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/MANUAL-CONFIGURATION.md b/MANUAL-CONFIGURATION.md index d62a79127..2afbd5813 100755 --- a/MANUAL-CONFIGURATION.md +++ b/MANUAL-CONFIGURATION.md @@ -4,7 +4,7 @@ ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: _______________ -#### Version: V4.2021.09.2617 +#### Version: V4.2021.09.2618 #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/README.md b/README.md index 9d3d219b5..dae156eca 100755 --- a/README.md +++ b/README.md @@ -11,7 +11,7 @@ ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) _______________ -#### Version: V4.2021.09.2617 +#### Version: V4.2021.09.2618 #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/_google_analytics_ghost_spam/README.md b/_google_analytics_ghost_spam/README.md index fcc93d6b6..9cfbe65f1 100644 --- a/_google_analytics_ghost_spam/README.md +++ b/_google_analytics_ghost_spam/README.md @@ -3,7 +3,7 @@ # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM _______________ -#### Version: V4.2021.09.2617 +#### Version: V4.2021.09.2618 #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) diff --git a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100755 --- a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf +++ b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/conf.d/globalblacklist-testing-version.conf b/conf.d/globalblacklist-testing-version.conf index 4d0674c86..3c16a8acc 100644 --- a/conf.d/globalblacklist-testing-version.conf +++ b/conf.d/globalblacklist-testing-version.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/conf.d/globalblacklist.conf b/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100644 --- a/conf.d/globalblacklist.conf +++ b/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/beta_conf_files/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files/conf.d/globalblacklist.conf index 4d0674c86..3c16a8acc 100644 --- a/dev-tools/beta_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf index 4d0674c86..3c16a8acc 100644 --- a/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf index 4d0674c86..3c16a8acc 100644 --- a/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf b/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf b/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf index 4d0674c86..3c16a8acc 100644 --- a/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/buildnumber b/dev-tools/buildnumber index 1da593893..9673c92a0 100644 --- a/dev-tools/buildnumber +++ b/dev-tools/buildnumber @@ -1 +1 @@ -2617 +2618 diff --git a/dev-tools/globalblacklist-testing.template b/dev-tools/globalblacklist-testing.template index 4d0674c86..3c16a8acc 100644 --- a/dev-tools/globalblacklist-testing.template +++ b/dev-tools/globalblacklist-testing.template @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V3.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V3.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/globalblacklist.template b/dev-tools/globalblacklist.template index 1e2e29ee0..1133a8c94 100755 --- a/dev-tools/globalblacklist.template +++ b/dev-tools/globalblacklist.template @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf index 41ab64930..0822010e5 100644 --- a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -51.141.187.141 0; +52.183.38.186 0; diff --git a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100644 --- a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100644 --- a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100644 --- a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf +++ b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf index 1e2e29ee0..1133a8c94 100644 --- a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf +++ b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf index 41ab64930..0822010e5 100644 --- a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -51.141.187.141 0; +52.183.38.186 0; diff --git a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf index f3f91ccec..0fc0153ee 100644 --- a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf index 41ab64930..0822010e5 100644 --- a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf +++ b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf @@ -45,4 +45,4 @@ # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST -51.141.187.141 0; +52.183.38.186 0; diff --git a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf index 2aacc397e..73837f29d 100644 --- a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf +++ b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf @@ -4,8 +4,8 @@ ### VERSION INFORMATION # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:20 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:32 UTC 2021 ### Bad Referrer Count: 7078 ### Bad Bot Count: 623 ################################################### diff --git a/dev-tools/test_units/blacklist-ips.conf b/dev-tools/test_units/blacklist-ips.conf index 320183a50..9772f8d32 100644 --- a/dev-tools/test_units/blacklist-ips.conf +++ b/dev-tools/test_units/blacklist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 1; +10.1.0.244 1; 127.0.0.1 1; diff --git a/dev-tools/test_units/random-bots-for-test-quick.list b/dev-tools/test_units/random-bots-for-test-quick.list index e7500c273..529807b59 100644 --- a/dev-tools/test_units/random-bots-for-test-quick.list +++ b/dev-tools/test_units/random-bots-for-test-quick.list @@ -1,10 +1,10 @@ -Copier -FDM -FHscan -LNSpiderguy -Microsoft Data Access -Pockey -V-BOT -WebFuck -WiseGuys Robot -s1z.ru +Asterias +BuiltWith +Disco +EirGrabber +GetWeb +Pandalytics +Panscient +ProPowerBot +SocialRankIOBot +coccocbot-web diff --git a/dev-tools/test_units/random-bots-for-test.list b/dev-tools/test_units/random-bots-for-test.list index 02df58bcc..1208fcae4 100644 --- a/dev-tools/test_units/random-bots-for-test.list +++ b/dev-tools/test_units/random-bots-for-test.list @@ -1,250 +1,250 @@ 01h4x.com -360Spider 404checker +80legs AIBOT -ASPSeek +ALittle Client +Aboundex +Aboundexbot Acunetix -AhrefsBot -Aipbot -Alexibot -AllSubmitter -Anarchie -BBBike -BDCbot -BDFetch -BLEXBot +AfD-Verbotsverfahren +Alligator +Anarchy +Ankit +Apexoo +Asterias +AwarioRssBot +AwarioSmartBot BackWeb BacklinkCrawler -Badass Bigfoot Black Hole -Blow +BlowFish +Boardreader Bolt -Brandwatch +Brandprotect Buck -Buddy BuiltBotTough -BuiltWith Bullseye -BunnySlippers +CATExplorador CCBot CODE87 -Cegbfeieh +CSHttp +Calculon +CensysInspect CheeseBot -CherryPicker ChinaClaw +Claritybot +Cliqzbot +Cocolyzebot Cogentbot -Collector -Copier +Cosmos +Craftbot Crawling at Home Project CrazyWebCrawler -Crescent -CrunchBot Curious -DBLBot +Custo +CyotekWebCopy DIIbot +DSearch +DTS Agent +DatabaseDriverMysqli +Demon +Deusu +Disco +Discobot Discoverybot Dispatch DnyzBot -Download Wonder +Dotbot Dragonfly -EMail Siphon -EasyDL -Evil +EMail Wolf +Ebingbong +EroCrawler +Exabot Express WebPictures +ExtLinksBot ExtractorPro -FHscan -Freeuploader -Fuzz +Extreme Picture Finder +FDM +Firefox/7.0 +Flunky +Foobot +FrontPage +Fyrebot G-i-g-a-b-o-t -GT::WWW GermCrawler -GetWeb -Go!Zilla -Go-Ahead-Got-It +GetRight +Getintent Gotit -GrabNet +Grabber +GrapeshotCrawler HMView +HTMLparser +HTTP::Lite HTTrack +HaosouSpider Harvest -HybridBot -Id-search -Image Fetch -IndeedBot +Humanlinks +IDBTE4M +IRLbot +IlseBot Indy Library -InfoNaviRobot -InfoTekies -Intelliseek -InterGET -Internet Ninja -Iria -Iskanie +InternetSeer IstellaBot -JamesBOT -JetCar +JOC Web Spider +Jbrofuzz +JennyBot JikeSpider JustView Jyxobot -Kinza -LNSpiderguy +Kenjin Spider LWP::Simple +Lanshanbot Larbin -LeechGet -LexiBot -Lftp -LibWeb +Leap Libwhisker -Lightspeedsystems -Likse +LieBaoFast LinkScan -LinkpadBot +LinkWalker +LinkextractorPro LinksManager -LinqiaMetadataDownloaderBot +LinqiaRSSBot +Lipperhey Spider +Litemage_walker Lmspider -MIDown tool -MSFrontPage +MSIECrawler MTRobot Magnet -Mail.RU_Bot -Masscan -Mb2345Browser -Meanpathbot -Metauri -Mojeek -Mr.4x3 +Majestic SEO +Majestic12 +MauiBot +Mediatoolkitbot +MegaIndex.ru +Mister PiX +Moblie Safari +Mozlila +Msrabot +Musobot NICErsPRO -Navroad -NearSite -Nibbler -Nikto -Ninja -Nmap -Offline Explorer +Name Intelligence +Needle +NetAnts +NetMechanic +NetZIP +Offline Navigator OnCrawl -OpenVAS +OpenLinkProfiler +Openfind +Openvas OutclicksBot -Page Analyzer +PECL::HTTP +PHPCrawl +PageGrabber PageScorer +Panscient Papa Foto Pavuk -Petalbot -Pi-Monster Picscout +Piepmatz Pixray -Probethenet -Psbot +ProPowerBot +Pu_iN Pump -PxBroker +PyCurl +Quick-Crawler RSSingBot RankActive -RankFlex Rankivabot -Reaper +RealDownload RedesScrapy RepoMonkey Ripper -RocketCrawler -Rogerbot SBIder -SEOkicks -SEOprofiler +SEOkicks-Robot +SEOstats +SISTRIX SMTBot -ScanAlert -Scanbot -Screaming -ScreenerBot +SalesIntelligent +SearchmetricsBot +Semrush SentiBot SeoSiteCheckup Shodan -Siphon +Site Sucker SiteCheckerBotCrawler SiteExplorer SiteLockSpider -SiteSnagger -Siteimprove +Sitebeam Sitevigil SlySearch -SmartDownload Snake -Snapbot -Sociscraper +Sosospider +Sottopop SpaceBison -SpankBot -Spanner -Spbot -Spinn3r -SputnikBot -Sqlworm -Sqworm -Steeler -Stripper -Sucker -SuperHTTP -SurveyBot -Suzuran -T0PHackTeam +Sucuri +Swiftbot Teleport TeleportPro +Telesoft +The Intraformant Thumbor -TightTwatBot Toata -Tracemyfile -Trendiction -True_Robot -Turnitin -TwengaBot +Trendictionbot +Turingos +URLy Warning URLy.Warning UnisterBot Upflow -VCI +VB Project +Vacuum Vagabondo -Voltron -WEBDAV -WPScan -WWW::Mechanize -WWWOFFLE +VelenPublicWebCrawler +VoidEYE +WWW-Collector-E WallpapersHD -WeSEE -Web Auto -Web Collage -Web Fetch Web Pix -WebAuto -WebGo IS -WebImageCollector +WebCollage +WebFuck WebLeacher WebPix -WebSucker -WebZIP -Webalta +WebmasterWorldForumBot Webshag Website Quester +Whack +Whacker +Whatweb +Who.is Bot Widow -Wonderbot -Wprecon -Zauba -Zermelo -Zeus -ZoomBot +WiseGuys Robot +Woobot +Wotbox +Xaldon_WebSpider +Xenu +YoudaoBot +Zade +Zitebot ZyBorg archive.org_bot -arquivo-web-crawler +arquivo.pt +autoemailspider backlink-check -check1.exe -crawler.feedback -eCatch +coccocbot-web +crawl.sogou.com +dataforseo.com +demandbase-bot evc-batch -isitwp.com +ips-agent +lwp-request +lwp-trivial mediawords muhstik-scan -polaris version -s1z.ru -seostar -siteripz -sogouspider -sp_auditbot +oBot +page scorer +ripz +scan.lol +seobility +spyfu +sysscan +tAkeOut +voyagerx.com webmeup-crawler -webpros.com -xpymep1.exe -zauba.io -zgrab diff --git a/dev-tools/test_units/random-bots-for-whitelist-test.list b/dev-tools/test_units/random-bots-for-whitelist-test.list index 4f0567dbf..c61882ddc 100644 --- a/dev-tools/test_units/random-bots-for-whitelist-test.list +++ b/dev-tools/test_units/random-bots-for-whitelist-test.list @@ -1,250 +1,250 @@ -01h4x.com -404enemy 80legs ALittle Client -Acunetix -AfD-Verbotsverfahren +Aboundex +Aboundexbot AhrefsBot +AiHitBot +Aipbot Alexibot +Alligator AlphaBot -Anarchie Ankit -Asterias Attach -AwarioSmartBot +BDFetch BackDoorBot +BackWeb Backlink-Ceck BacklinkCrawler Badass Bandit -Barkrowler -Bigfoot -Blackboard +BetaBot +Black Hole BlowFish Boardreader -BuiltBotTough -BuiltWith -BunnySlippers +BotALot +Brandprotect +Buddy +Bullseye +CCBot CSHttp -ChinaClaw +Calculon +CazoodleBot +CherryPicker Cliqzbot -Cogentbot -CopyRightCheck -CyotekWebCopy -DIIbot -Devil -Dirbuster -Disco +Cloud mapping +Crescent +Curious +DTS Agent +DataCha0s +Deusu +DigitalPebble Discobot Discoverybot -Dispatch DomCopBot -Download Wonder -Drip +DomainAppender +DomainStatsBot +Dotbot +Dragonfly ECCP/1.0 -EMail Siphon -EirGrabber -Exabot +Ebingbong Express WebPictures Ezooms -FDM -FHscan -FemtosearchBot FlashGet -Foobot +Flunky Freeuploader -FyberSpider -Fyrebot -G-i-g-a-b-o-t -Genieo -GermCrawler -GetRight -GetWeb +Fuzz Getintent -GoZilla -GrabNet +Go!Zilla Grafula -GrapeFX -GrapeshotCrawler +HEADMasterSEO HMView -HTTP::Lite -HTTrack +HTMLparser HaosouSpider -Harvest Humanlinks -HybridBot IDBTE4M IRLbot -Image Sucker -IndeedBot -InfoTekies -Iria +Iblog +Indy Library +Internet Ninja +InternetSeer +Iskanie IstellaBot -JOC Web Spider Jbrofuzz -Joomla Jorgee -Jyxobot -Keyword Density -Kozmosbot +JustView +Kinza +LWP::Simple Larbin -LeechFTP -LexiBot Lftp -LibWeb -LinkpadBot +LieBaoFast +Lightspeedsystems +LinkScan +Linkdexbot +LinkextractorPro LinksManager LinqiaMetadataDownloaderBot -LinqiaScrapeBot +LinqiaRSSBot Lipperhey -Litemage_walker -Ltx71 -MIIxpc +Lipperhey Spider MQQBrowser MSFrontPage -MSIECrawler +Mag-Net Mail.RU_Bot -Majestic12 +Majestic SEO +Majestic-SEO +MarkMonitor MarkWatch -Mata Hari +MauiBot +Mb2345Browser MeanPath Bot -Mediatoolkitbot MegaIndex.ru +Metauri MicroMessenger -Microsoft URL Control +Microsoft Data Access Moblie Safari +Mojeek Morfeus Fucking Scanner +Mozlila Msrabot +NICErsPRO +Navroad +NearSite Nessus +Net Vampire +NetLyzer +NetSpider +Netcraft Netvibes NextGenSearchBot Niki-bot -Nikto -Nuclei +NimbleCrawler Nutch -Offline Explorer Offline Navigator OpenLinkProfiler OpenVAS Openvas OrangeBot OutfoxBot -PECL::HTTP -PageAnalyzer +POE-Component-Client-HTTP PageGrabber -PageThing.com +PageScorer +Pandalytics +Papa Foto +Pavuk +Petalbot Picscout Piepmatz -Pimonster -PleaseCrawl -Pockey -Psbot -PxBroker -QueryN Metasearch -RankingBot2 -Rankivabot -RankurBot +Pixray +ProWebWalker +Pump +PyCurl Re-re +ReGet RealDownload -Recorder +RebelMouse RedesScrapy -SEOkicks-Robot +RepoMonkey +RocketCrawler SEOlyticsCrawler +SEOprofiler SMTBot -SalesIntelligent -ScanAlert -ScoutJet -SearchmetricsBot -SeoSiteCheckup -SeobilityBot -Seomoz -Siphon +ScrepyBot +SemrushBot +Shodan SiteCheckerBotCrawler -SiteExplorer -SiteSucker -Sitebeam +SiteSnagger Siteimprove -Sitevigil +SlySearch SmartDownload +Snake +Snapbot SocialRankIOBot +Sosospider +SpaceBison +Spammen SpankBot -Spanner Sqlworm -Steeler Stripper +Sucuri +Surfbot +SurveyBot +Suzuran Szukacz -Telesphoreo +T0PHackTeam +T8Abot +TeleportPro Telesphorep The Intraformant -TheNomad -Thumbor +TightTwatBot Titan -Toata -Trendictionbot -True_Robot -Turingos -Turnitin -TurnitinBot -VB Project +Toweyabot +Tracemyfile +V-BOT Vacuum +Vagabondo VelenPublicWebCrawler -VeriCiteCrawler -Voil +VidibleScraper +Virusdie Voltron WEBDAV WISENutbot +WWW-Collector-E WWW-Mechanize -Wallpapers +WWWOFFLE +WeSEE Web Collage -Web Fetch -Web Fuck -WebCollage +Web Enhancer +Web Sauger +WebAuto +WebCopier WebFuck -WebSucker +WebImageCollector +WebSauger +WebStripper +WebZIP Webalta -Webshag -Website Quester -WebsiteExtractor Webster -Who.is Bot -Widow +Whack +WinHTTrack +WiseGuys Robot Wonderbot Woobot -Wotbox -Xaldon WebSpider -Xaldon_WebSpider -Zade -Zauba -Zitebot +Wprecon +Xenu +YoudaoBot ZmEu -ZoomBot -arquivo-web-crawler +ZumBot +ZyBorg arquivo.pt -cah.io.community -check1.exe +autoemailspider +backlink-check clark-crawler -coccocbot-web cognitiveseo -com.plumanalytics +crawler.feedback crawler4j -domainsproject.org -eCatch +dataforseo.com +demandbase-bot evc-batch -gopher -internetVista monitor +instabid ips-agent -isitwp.com +lwp-request lwp-trivial -magpie-crawler meanpathbot muhstik-scan +netEstate NE Crawler pcBrowser polaris version -probe-image-size +satoristudio.net scalaj-http -serpstatbot +scan.lol +seostar +sexsearcher sitechecker.pro +sogouspider +spyfu +tAkeOut +trendiction.com ubermetrics-technologies.com -webprosbot -x09Mozilla -x22Mozilla +webmeup-crawler +webpros.com +zauba.io diff --git a/dev-tools/test_units/random-referrers-for-test-quick.list b/dev-tools/test_units/random-referrers-for-test-quick.list index ac3826b47..186df94c8 100644 --- a/dev-tools/test_units/random-referrers-for-test-quick.list +++ b/dev-tools/test_units/random-referrers-for-test-quick.list @@ -1,10 +1,10 @@ -a.frcls.fr -apiqualitinknet-a.akamaihd.net -bestwaystogetpaid.us -communisave.co.za -ecxtracking.com -myonigroup.com -oivcvx.website -pornoforadult.com -samara.rosfirm.ru -uamtrk.com +abclauncher.com +anaseracresar.tk +anniemation.com +babyfactory.fr +dlya-android.org +koral.se +matpre.top +seccioncontrabajo.com +surgut.zrus.org +zajm-pod-zalog-nedvizhimosti.ru diff --git a/dev-tools/test_units/random-referrers-for-test.list b/dev-tools/test_units/random-referrers-for-test.list index c31ed9a1f..f9f11eed9 100644 --- a/dev-tools/test_units/random-referrers-for-test.list +++ b/dev-tools/test_units/random-referrers-for-test.list @@ -1,500 +1,500 @@ 00author.com -1001desert.com -100searchengines.com -123locker.com -12masterov.com -1stat.ru -1webmaster.ml -2020iscoming.info +08800.top +0n-line.tv +1-free-share-buttons.com +101flag.ru 20pascals.nl -24-ak.ru -2daytrendingnews.com -2nt.ru -300richmond.co.nz -3th.co.in -3xforum.ro -5000-cotydzien.com +2drittel.de +3-letter-domains.net 5kstore.com -5ws.dating-app.ru -7a2rnuey1tw9ar.ru -7wind.ru -888.com -a96527gi.beget.tech -absolutelyanalog.com -adamoads.com -addray.pro -adexprts.com -adsland.men -adsloads.com -adtiger.tk -aimayangzhi.com -air-edem.ru +66cpwgln.space +7fon.ru +aa9bd78f328a6a41279d0fad0a88df1901.com +aaa38852e886ac4af1a3cff9b47cab6272.com +absolute-s.ru +addblueoff.com.ua +adidas.frwebs.fr +adobereader-free.ru +ads.gold +adtech.us +adultmeetonline.info +adultwebhosting.info +affrh2015.com +afora.ru +agahinameh.com +agreda.pluto.ro +ahmedabadwebs.com akita.kz -alienwheel.es -all4wap.ru -allknow.info -ample-awards-today.us -animal36.com -apccargo.com -apessay.com -apidigidocketnet-a.akamaihd.net -applyneedy.xyz -apps-analytics.net -artparquet.ru -asseenontv.ru -astana.xxxkaz.org -autodo.info -autoplate.info -autotrends.today -autovideobroadcast.com -avirasecureserver.com -avkzarabotok.com +allboard.xobor.de +allkrim.com +allmarketsnewdayli.gdn +allwidewallpapers.com +alot.com +am-se.com +ampower.me +animalrank.com +apartmentratings.com +appsecurityr.com +arabgirls.adultgalls.com +arenda-yeisk.ru +arraty.altervista.org +artefakct.com +articlesdirectoryme.info +asophoto.com +atley.eu.pn +auto4style.ru +autoloans.com +autoseo-traffic.com +aviav.ru +avon-novosib.ru +avramstroy.ru avtocredit-legko.ru -azartniy-bonus.com -azbukadiets.ru +ayeartoforget.com babyfactory.fr -bad-stars.net -bagsonsale.online -baksman.com -bank.uz -bausparen.bz.it +backgroundpictures.net +baersaratov.ru +balans.shahterworld.org +bbsoldes.fr +bbtec.net +bedcapdealers.com +belinka.com.ua +benchmarkcommunications.co.uk +best-games.today +bestcoin.cc +bestdraws.com bestmobilityscooterstoday.com -bestssaker.com -bezsporno.ru -biglistofwebsites.com -bio.trade-jp.net -birzha-truda.eu -bizzliving.com -blavia.00author.com -blogos.kz -blogs.rediff.com -bluejays-jerseys.us -bmsco.co -bobinoz.com -bolitgorlo.net -bonzibuddi.com -braintobe.win -breget74.ru -buketeg.xyz -bytimedance.ru -caveavins.fr -cejewelry.xyz -celejihad.info -cerev.info -cfjump.com +bestplacetobuyeriacta.jw.lt +bestsexyblog.com +bet365.com +binaryoptionscops.info +bizcheapjerseyswholesalechina.com +bizfly.info +biznesschat.net +bkgr.se +bluesalt.co +bocoarchives.org +bonanza-fortune.men +brandimensions.com +browserprotecter.com +bupropion-sr-150-mg.us +business-suggested.tk +buyantiviralwp.com +buydissertation.net +cakemediahq.com.au +callawaygolfoutlet.online +candytiner.com +carson.getenjoyment.net +cartierlovestore.xyz +cartierwatch.xyz +casinos4dummies.co.uk +caulderwoodkennels.com +ccjp.eu +cctva.tv +centraletermice.us chatroulette.si -cheapbarbour.online -christianlouboutinreplica.win -cienum.fr -cjmc.info -clickbanksites.info -clickcash.com -clickpapa.com -clickzzs.nl -coindirect.io -concordexoticrentals.com -constantaservice.net -coolbar.pro -copro.pw -copypaste.traderzplanet.in -cottageofgrace.com +chcu.net +cheapjerseysap.com +chiptuninger.com +christianlouboutinsaleoutletonline.us +clean-virus-mac.com +clksite.com +cmd.kz +cobaltpro.ru +com-cleaner.systems +compliance-george.top +compliance-josh.top +coolingoods.com +corta.co +costablue.xyz counterbot.com -credit.co.ua -creditnation.ru +country-chic.ru +cowblog.fr +cranly.net cs-passion.pl -cv.wallhade.co -czat.wp.pl -data-mining.tk -ddospanel.com +cubook.supernew.org +culad.com +culturevie.info +customsua.com.ua +damedingel.ya.ru +danceuniverse.ru +data.vtc.pw +dataloading.net +datsun-do.com +day-news.info +ddsoldes.fr deplim.com -deutschland123.de -diegolopezcastan.com -disruptingdinnerparties.com -dividendo.ru -dktr.ru -dojki-hd.com -domain-tracker.com -dostavimvdom.ru -download-walpaperhd.blogspot.com -doxysexy.com -dyshagi.ru -e-poker-2005.com -easync.io -ecookna.com.ua -editmedios.com -ekobata.ru -elektrischeziga.livejournal.com -elvenmachine.com -ero-advertising.com -esfchat.tk -essay-writing.work -exhibitionplus.eu -extremepornos.net -ezigarettekaufen2.yolasite.com -ezigaretteshop.webs.com -facialporntube.com -familyholiday.ml -fashionindeed.ml -fast-wordpress-start.com -fastcrawl.com -favorcosmetics.com -fermersovet.ru -fikasound.tk -filmetricsasia.com -filmfanatic.com -financeloan.us -finstroy.net -finteks.ru +deshevo-nedorogo.ru +design-lands.ru +detmebel.su +dfwu1019.info +diarioaconcagua.com +dieta-personalna.pl +dikqlyremy.info +dinosaurus.site +dogclothing.store +domaincdn.xyz +donna7753191.ru +doublepimp.com +dprtb.com +duplicashapp.com +dustyorate.com +eachdayisagift.review +easytuningshop.ru +easyukraine.com +ebooknovel.club +ecommerce-seo.com +eduinfosite.com +edwinkonijn.com.au +ekto.ee +elektrozigarette1.dreamwidth.org +elektrozigarette2.wordpressy.pl +elitepcgames.com +elmifarhangi.com +empathica.com +energydiet24.ru +ereko.ru +eropho.com +erotikchat-24.com +essayservicewriting.org +evaashop.ru +exchangeit.gq +expolicenciaslatam.co +extener.org +eyessurgery.ru +ezigarettenshop1.yolasite.com +ezigarettenshop2.myblog.de +fashion-mk.net +fastfixing.tech +fearcrow.com +felizporno.com +ferrotodo.com +fighrofacciufreesig.ga +filesmonster.porn +financetip.eu +findanysex.com fishingwholesale.us -florida-tourism.net -forsex.info -free-social-buttons.com -freelifetimefuckbook.com -freewebs.com +focalink.com +food.dtu.dk +foto-weinberger.at +free-share-buttons.com +freemaintenancesysforpcandmac.top frequiry.com -friendflnder.com -fun2cell.net -gagrasector.ru -gambarkatabaru.com -game-mmorpg.net -gameprimary.com -gaygalls.net -gaz-voshod.ru -getpopunder.com +fres-news.com +fungirlsgames.net +fxtips.ru +gamevalue7.weebly.com +gay.adultgalls.com +gdcentre.ru +gembird.com +generic-pills-online.com +genericlowlatencyasiodriverhq.aircus.com +genericviagrasildenafiled.net +getmiro.com +getyourimage.club +gg-arena.ru +gifspics.com +gilbertbanda.net girls-ufa.ru +gk-atlant.info globalscam.ga -globetrotting-culture.ru -gogalleryawesome.com -goldadpremium.com -goodly.pro -gotcher.us -gotorussia.com -gotwebsite1.com -greatzip.com -gribokstop.com -groupmoney.ru -gsmtlf.ru +go2mike.ru +golmau.host.sk +gonextmedia.com +googst2.ru +gosreg.amchs.ru +gsasearchenginerankerdiscount.com gsou.cf -gta-club.ru -guigyverpo.cf -heliko.no -homeandhealth.ru -hoste.octopis.com -hostingclub.lk -hostsshop.ru +guarrasdelporno.xxx +gwagka.com +gyffu.com +hackers-crackers.tk +happy.new.yeartwit.com +hasshe.com +hd720kino.ru +headpress.ru +hermesbracelets.xyz +hotel-mkad.ru +hothot.ru house.sieraddns.com -houston-vikings.com -hoverboard360.at -howtowhitenteethfast.xyz -hptwaakw.blog.fc2.com -hydropump.su -iboss.com -ilovevitaly.com -imadedinner.net -imagefinder.site -imagez.co -imagui.eu -imfamous.info -imgarit.pw -incanto.in.ua -indiakino.net -infokonkurs.ru -instakink.com -investzalog.ru -islamtoday.co.za -isoveti.ru +houseofrose.com +humanelydrew.com +humanorightswatch.org +ictizanidinehcl4mg.blogspot.com +ideawheel.com +ifirestarter.ru +iklysha.ml +imperia31.ru +impisr.edunsk.ru +inet-traffic.com +infazavr.ru +insurple.com +ipornox.xxx +iqs.biz.ua +istanbulit.com istizanidinelikexanax.blogspot.com -iusstf.org -ivanovo.zrus.org -iwantmyfreecash.com -javrip.net -javxxx18.com +istock-mebel.ru +itbc.kiev.ua +itis4you.com +itservicesthatworkforyou.com +iweblist.info +ix20.ru +izhevsk.xrus.org +izhevsk.zrus.org +jamiembrown.com +janerikholst.se jbl-charge.info -jerseywholesalebizchina.com -jikoman.info -joessmogtestonly.com -jus0wil.pp.ua -justdating.online -jyrxd.com -kalandranis.gr +jmat.cn +jobmarket.com.ua +johnrobertsoninc.com +joingames.org +justucalling32211123456789.tk +kalb.ru karpun-iris.ru -katushka.net -kinoduh.ru -kinozapas.com -kongoultry.net -konpax.com -kostenloser-sex.com -krasnodar.xrus.org -krasnodar.zrus.org -kredit-pod-zalog-krasnodar.ru -ku6.com -landscaping.center +katadhin.co +kazrent.com +knowyournextmove.com +kol-energo.ru +kollekcioner.ru +konteiner24.com +koral.se +kountrylife.com +lacloop.info +lafourmiliaire.com +lampokrat.ws lankarns.com -lashstudia.ru -law-check-eight.xyz -lawyers.cafe -laxob.com -leboard.ru -lexiangwan.com -libertybilisim.com -life-instyle.com -lifebyleese.com -lifeinsurancekb.com -liffa.ru -lightinghomes.net -linkpulse.com -liran-locks.com -liupis.com -localflirtbuddies.com -locatellicorretor.com.br -lomb.co -longadventure.com -louboutinreplica.xyz -luckyday.world -lyngdalhudterapi.no -mainlinehobby.net -manualterap.roleforum.ru -manve.info -marketingtechniques.info -mastershef.club -matpre.top -megaindex.ru -mesbuta.info -michellblog.online -microstatic.pl -mini-modus.ru -misswell.net -mmgq.ru -mobilemedia.md -mobplayer.ru -moivestiy.biz -mojpreskumanie.com -moncleroutletonline.pw -monetizationking.net -montazhnic.ru -morf.snn.gr -mosrif.ru +lawyersinfo.org +le-clos-des-alouettes.com +letolove.ru +lexixxx.com +light.ifmo.ru +lisque.batcave.net +littleberry.ru +liumimgx.pw +live-sexcam.tk +liverpool.gsofootball.com +liveu.infoteka.hu +losangeles-ads.com +lyrster.com +macrotek.ru +mahnwachen-helfen.info +make-money-online.com +makis.nu +maladot.com +map028.com +meddesk.ru +medkritika.ru +mega-bony2017.pl +megavolt.net.ua +meteocast.net +michaelkorssaleoutletonline.net +mini.7zap.com +mir-betting.ru +monclerboots.xyz +moncleroutletonline.win +more-letom.ru mouselink.co -moviemail-online.co.uk movies-in-theaters.net -moz.com -mp3s.club -muz-shoes.ru -my-aladin.com -myghillie.info -myhealthcare.com -mysex21.com +mrbitsandbytes.com +mrcsa.com.au +multgo.ru +musicktab.com +mysexpics.ru nailsimg.com -narkologiya-voronezh.ru -nerudlogistik.ru -next-dentists.tk -nfljerseyscheapbiz.us -o-o-8-o-o.ru +natali-forex.com +negral.pluto.ro +neodownload.webcam +newhairstylesformen2014.com +news-speaker.com +nightvision746.weebly.com +njkmznnb.ru +nl.netlog.com +norththeface.store +novatech.vn +november-lax.com +nw-servis.ru +nzfilecloud.weebly.com +obiavo.com obiavo.uz -office-windows.ru +oddamzadarmo.eu oil-td.ru -okel.co -onefilms.net -onetravelguides.com -onko-24.com -onlinemegax.com -openlibrary.org -openmediasoft.com -opinionreelle.com -oren-cats.ru -orenburg-gsm.ru +onemactrckr.com +oneminutesite.it +online-templatestore.com +online247.ml +openstat.com +oranga.host.sk +ordernorxx.com osoznanie-narkotikam.net -oxford-book.com.ua -pagesense.com -palvira.com.ua -paparazzistudios.com.au -paperwritingservice17.blogspot.ru -parajumpersjakkesalgnorge.info -paramountmarble.co.uk -parlament.biz -partnerads.men -pattersonsweb.com -pcads.ru -peekyou.com -perl.dp.ua -perosan.com -phormchina.com -photo.houseofgaga.ru -picsfair.com -pictures-and-images.com -pinapchik.com -pipki.r.acdnpro.com -pizda.lol -pladform.ru -play-movie.pl -pochtovyi-index.ru -pogruztehnik.ru -popugaychiki.com -porno-raskazy.ru -pornoklad.net -pornowarp.info -pornpost.in -privatamateure.com -privhosting.com -professionalwritingservices15.blogspot.ru -profolan.pl -purplesphere.in +ownshop.cf +par-fallen.ga +parajumpersoutlet.online +partybunny.ru +paydayonlinecom.com +pcgroup.com.uy +perfectplanned.com +perfectpracticeweb.com +pflexads.com +picsearch.com +pihl.se +pijoto.net +pillscheap24h.com +pizdeishn.com +pizza-imperia.com +pizza-tycoon.com +ploenjitmedia.azurewebsites.net +plohaya-kreditnaya-istoriya.ru +poligon.com +pornofiljmi.com +pornosemki.info +pornotubexxx.name +pr0fit-b0x.com +prefersurvey.net +privat-girl.net +pro-okis.ru +prokotov.com +proxyradar.com +pulseonclick.com putitin.me -r-control.ru +qpypcx.com rangoman.date -rankingchart.de -rapevideosmovies.com -rasteniya-vs-zombi.ru -razorweb-a.akamaihd.net +rapidsites.pro rcpmda.ikan1080.xyz -recinziireale.com -redirlock.com -rednise.com -remont-komputerov-notebook.ru -resultshub-a.akamaihd.net +retailwith.com +rewardit.com +rezeptiblud.ru rightenergysolutions.com.au -riralmolamsaca.tk -rossanasaavedra.net +ritlweb.com +rixpix.ru +rollercoin.com +ros-ctm.ru rozalli.com -ru-dety.ru ruex.org.ua -ruscoininvest.company -rvi.biz -sandhillsonline.com +ruscopybook.com +ryetaw.com +sack.net +salut-camp.ru +samo-soznanie.ru sanidumps.com -santasgift.ml -sayyoethe.blogspot.co.za -scanmarine.info -scanner-alexa.top -scanner-walter.top -scripted.com -searchinterneat-a.akamaihd.net -semaltmedia.com -semrush.com -seojokes.net -sex-dating.co -sex-pr.net -sex.hotblog.top -sexflirtbook.com -sexpornotales.com -sexyteens.hol.es -shinikiev.com.ua +saratov.xrus.org +scanner-don.top +scanner-marwin.top +scanner-olga.top +scanner-willy.top +scenarii-1-sentyabrya.uroki.org.ua +se-welding.ru +serialsway.ucoz.ru +sex-tracker.com +sexsearch.com +sextracker.com shoesonlinebuy.cn -shoppingjequiti.com.br -shymkent.xkaz.org -sibdevice.ru -simplepooltips.com -slomm.ru -socialmadesimple.com -soft-program.com -softlinesolutions.me -softomix.net -soheavyblog.com +sindragosa.comxa.com +sispe.com.br +siteexpress.co.il +slayerlife.com +small-games.biz +snsdeainavi.info +sobecjvuwa.com.ru +soblaznu.net +sofit-dmd.ru +solinf.co +sotkal.lark.ru spasswelt.net -special-porn.com -sptslmtrafms.com +spy-app.info spymac.net -stanthonyscatholicchurch.org -startufa.ru -stathat.com -statustroll.com -staynplay.net -stickers-market.ru -stjamesschool.info -strag-invest.ru -strongholdsb.ru -surffoundation.nl -svbur.ru -sygraem.com -szamponrevita.pl -taqywu51.soup.io -taxi-v-eisk.ru -tds-advert005.info -teastory.co -tecspb.ru -tedxrj.com -teenbbw.yopoint.in -templates.radiodigital.co -texbaza.by -tgtclick.com -theautoprofit.ml -thebestweightlosspills.ovh +sr-rekneskap.no +srecorder.com +stackthatbucks.com +sucsesofinspiration.com +supernew.org +supervesti.ru +symphonyintegratedhealthcare.com +technika-remont.ru +tfxiq.com +thebluenoodle.com +thedownloadfreeonlinegames.blogspot.com +thegamerznetwork.com +theheroes.ru +thelottosecrets.com +thenews-today.info thin.me.pn -timdreby.com -titan-cloud.life -tizanidineandhydrocodone.blogspot.com -tizanidinedosage.blogspot.com -tizanidinehcl4mgtab.blogspot.com -tmtrck.com -tn811.us +timeallnews.ru +tizanidine4mguses.blogspot.com +tizanidineandcipro.blogspot.com +tizanidineforopiatewithdrawal.blogspot.com +tizanidineonline.blogspot.com +tizanidineusedfor.blogspot.com +toonfamilies.net +top-study.work topbestgames.com -torrentgamer.net -trafaret74.ru -trahic.ru -truck-addzilla.life -tytoona.com -u17795.netangels.ru -ukr-lit.com -umaseh.com -undergroundcityphoto.com -uni.me -vabasa.inwtrade.com -vancleefreplica.pw -vandrie-ict.nl -vapomnoncri.tk -vbabule.net -veerotech.com -velen.io +torture.ml +touchmods.fr +traderzplanet.in +tradgardspartner.se +trafficmania.com +trafficstars.com +treasuretrack-a.akamaihd.net +trubywriting.com +tubeoffline.com +tuberkuleznik.ru +twinderbella.com +typimga.pw +uchetunet.su +udayavani.com +udsgame.online +umnovocaminho.com +unisexjewelry.org +unitygame3d.com +universals.com.ua +uytmaster.ru +validdomain.xyz +vapsy.com +vasileostrovsky-rayon.ru viandpet.com -videochat.life -videochat.tv.br -viel.su -visa-pasport.ru -vozbujdenie.com -vseigru.one -vseigry.fun -vysigy.su -wallpapers-best.com -wardreapptokone.tk -watchmygf.net -watracker.net -watsonrealtycorp.com -webcamdevochka.com -webix.biz -webmasterhome.cn -webnode.me -wejdz-tu.pl -wesharepics.com -wetgames.ru -whereiskentoday.com -wholesalecheapjerseysfree.com +videositename.com +videotuber.ru +villakohlanta.nu +visitcambridge.org +vitalads.net +watchinf.com +webalan.ru +webextract.profound.net +webjam.com +websiteexplorer.info +webstatsdomain.org +westermarkanjou.se +wheelchairliftsarea.com wholinkstome.com -worldtraveler.world -wpthemedetector.co.uk -wttavern.com -wzgyyq.com +wildworld.site +wladimirpayen.com +wordkeyhelper.com +worst-sites.online +wowas31.ucoz.ru +wowcasinoonline.ooo +x-diesel.com x-diesel.info -xep.info +xboxster.ru xkaz.org -xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai +xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai +xn----7sbho2agebbhlivy.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai -xn----ctbigni3aj4h.xn--p1ai -xn--80aafb2a.xn--p1ai -xn--d1acah0c.xn--p1ai -xn--l1aengat.xn--p1ai -xportvusbdriver8i.snack.ws -xvideospornoru.com -xxxguitars.com -xxxkaz.org -xz618.com -yebocasino.co.za -youporn-forum.ga -yourserverisdown.com -zed21.net -zhorapankratov7.blogspot.com -zixizop.net.ru -zlatnajesen.com -znaniyapolza.ru -zrelaya.pw -zreloeporno.tv -zvooq.eu +xn----btbdvdh4aafrfciljm6k.xn--p1ai +xn--b1agm2d.net +xn--h1ahbi.com.ua +xtremeeagles.net +yellowstonevisitortours.com +yes-com.com +youradulthosting.com +youraticles.pl +yousense.info +youtoner.it +youtubedownload.org +yuarra.pluto.ro +yugo-star.ru +za-fun-offer.com +za-music.mymobiplanet.com +zagadki.in.ua +zebramart.ru +zocaparj.kz +zojirushi-products.ru +zoosexart.com +zscaler.net diff --git a/dev-tools/test_units/random-referrers-for-whitelist-test.list b/dev-tools/test_units/random-referrers-for-whitelist-test.list index eb5a1f28d..cd0a5093a 100644 --- a/dev-tools/test_units/random-referrers-for-whitelist-test.list +++ b/dev-tools/test_units/random-referrers-for-whitelist-test.list @@ -1,250 +1,250 @@ -007angels.com -202ch.com -20pascals.nl -4rent.ru -5u.com -a14download.com -aa9bd78f328a6a41279d0fad0a88df1901.com -adzpower.com -alarmobninsk.ru -alert.scansafe.net -alfa9.com -algarveglobal.com -alldezservice.kz -altamayoztourism.com -animalia-life.club -anonymizeme.pro -apple.com-webbrowsing-security.review -apxeo.info -ardimobileinfo.ml -arkkivoltti.net -asdfz.pro -audiofree.ru -aviav.ru.com -babosas.com -bag77.ru -bagcionderlab.com -baikaleminer.com -bala.getenjoyment.net -bankcrediti.ru -batanga.net -beachdriveblog.com -belsetirehafi.tk -bestadbid.com -bestchoice.cf -bestserials.com -bestssaker.com -bezlimitko.xyz -billiard-classic.com.ua -biographiya.com -bpro1.top -burger-imperia.com -buron.pw -buynorxx.com -bvlgariring.xyz -candlewooddentalcentre.com.au -cercacamion.it -cheap-pills-norx.com -cheapmarmot.online -christianlouboutinshoes.xyz -clean-virus-mac.com -clickzzs.nl -clips.ua.ac.be -coindirect.io -compliance-andrew.top -compliance-don.top -coolyarddecorations.com -cottageofgrace.com -countercrazy.com -country-chic.ru -darmebel.com.ua -den-noch24.ru -dentalpearls.com.au -design-lands.ru -devochki.top -dispo.de -domashneeruporno.com +2girls1cup-free.com +3rbseyes.com +6hopping.com +7a2rnuey1tw9ar.ru +91abcw.com +acmebtn.ml +adktrailmap.com +adman.gr +adssafeprotected.com +adultactioncam.com +advokateg.xyz +aghanyna.com +amazingpic.net +amung.us +android-style.com +animaltoplist.com +apartamentwroclaw.eu +apiitsthirteende-a.akamaihd.net +atmagroup.ru +auto-moto-elektronika.cz +avon-ukraine.com +avtovolop.ru +b00kmarks.com +bankofthewext.com +beachtoday.ru +best-way.men +bestmouthwash.club +bfz.biz +blackbabesporn.com +blobar.org +boc.kz +briomotor.co +buqyxa.rincian.info +casinorewards.info +centrumcoachingu.com +cheapjerseysbizwholesale.us +cleanallvirus.com +clothesforcash.com +confib.ifmo.ru +coslab.club +cougfan.info +cpajunkies.com +crirussian.ru +darodar.com +db.speedup.gdn +ddsoldes.fr +depositfiles-porn.ga +dimaka.info +dirtpics.pw +docs4all.com +doktoronline.no +donvito.unas.cz dotnetdotcom.org -downloaddy.net -downloadme.life -drupa.com -duplicashapp.com -e-collantes.com -e2click.com -easyukraine.com -ebonyporn.site -ekosmetyki.net.pl -elektrischezigaretten1.blogse.nl -enhand.se -evening-dating-club.info -exhibitionplus.eu -expdom.com -exportshop.us -factorynightclub.com -fetlifeblog.com -fivedwld.cf -footbalive.org -forum69.info -get-free-traffic-now.com -getridofstretchmarks.org -gigapeta.com -girlspicsa.com -gorodservis.ru -greatidea.marketing -greenshop.su -guigyverpo.cf -guildebzh.info +download-walpaperhd.blogspot.com +druzhininevgeniy63.blogspot.com +dtm-spain.com +duawitchrarato.tk +easyshoppermac.com +edelstahlschornstein-123.de +ekspresihati.info +elitesportsadvisor.com +eloxal.ru +elvel.com.ua +ertelecom.ru +evrotekhservis.ru +extlinks.com +ezigarettenshop2.myblog.de +familienzahnaerzte.com +feorina.ru +fikasound.tk +filesdatabase.net +filmi-onlain.info +financeloan.us +forumprofi.de +freshdz.com +fsalas.com +funnymama.com +galleryawesome.com +gambarxkata.co +gameonasia.com +gamezblox.com +gay-site.store +genericviagrasildenafiled.net +goodprotein.ru +graphicwe.org +growboxbl.ru hd-filmy.net -helicalpile.us -hermesbelts.xyz -hikesearch.net -hoste.octopis.com -hptwaakw.blog.fc2.com +hdpixent.com +heliko.no +hentai-manga.porn +histock.info +hosting-tracker.com +hotcore.info +howlongdoestizanidinestayinyoursystem.blogspot.com +hreade.com humanelydrew.com -iklysha.ml -imagine-ex.co -infogame.name -intim-uslugi.info -invitefashion.com -izhevsk.xrus.org -j-times.ru -j33x.com -johannesburgsingles.co.za -jrpmakati.com -jyrxd.com -karachev-city.ru -katadhin.co -keywords-monitoring-success.com -kiwe-analytics.com -krynica.info -kurwa.win -landscapebackgrounds.blogspot.com -law-check-seven.xyz -laxob.com -leboard.ru -lechenie-gemorroya.com -lida-ru.com -littleberry.ru -lodki-pvh.dp.ua -lol-smurfs.com -lomza.info -long-beach-air-conditioning.com +igithab.com +igtools.club +iinstalll-fii1leis.jus0wil.pp.ua +ilikevitaly.com +imperiafilm.ru +incanto.in.ua +intellego.info +jobgirl24.ru +kaz.kz +kiprinform.com +koral.se +krasivoe-hd.com +kung-fu-ru.com +kutikomi.net +la-fa.ru +lacloop.info +larose.jb2c.me +lerporn.info +lescinq.com +locationdesaison.com +louboutinreplica.pw luchshie-topcasino.ru -luckyshop.net.ua -lulea-auktionsverk.se -luxup.ru -max-p.men -metaxalonevstizanidine.blogspot.com -mirmedinfo.ru -missvietnam.org -mncrftpcs.com -moonci.ru -my-cash-bot.co -nardulan.com -nastydollars.com -ningessaybe.me -omoikiri-japan.ru +magda-gadalka.ru +marketingvici.com +mebel-ekb.com +medispainstitute.com.au +meget.co.za +mesto-x.com +misterjtbarbers.com +moi-glazki.ru +mokrayakiska.com +moncleronline.xyz +money-every-day.com +mossmesi.com +mrinsidesales.com +musicspire.online +mylesosibirsk.ru +narkologiya-orel.ru +newstudio.tv +niki-mlt.ru +nudejapan.net +nuker.com +obuv-kupit.ru +odoratus.net +odywpjtw.bloger.index.hr +officedocuments.net onemantrip.com -onlainbesplatno.ru -online.ktc45.ru -ooo-olni.ru -openlibrary.org -osb.se11.ru -ownshop.cf -ownshop.win -paceform.com -panicatack.com -patol01.pw -pdns.download -pearlisland.ru -percin.biz.ly -pertlocogasilk.tk -pixelrz.com -plastweb.ru -pornokajf.com -pornpost.in -progress-upakovka.ru -promodj.com -prostitutki-astana.org -questionmarque.ch -rabot.host.sk -rankscanner.com -real-time-analytics.com -redirlock.com -remont-fridge-tv.ru -rent2spb.ru -responsinator.com -ric.info -riders.ro -riralmolamsaca.tk +online-zaymy.ru +ons-add.men +onstrapon.purplesphere.in +orgasmatrix.com +orhonit.com +osagonline.ru +parajumpersjakkesalgnorge.info +partner-high.men +pay2me.pl +pcads.ru +picmoonco.pw +pivka.xyz +pixshark.com +popup-hgd.xyz +porn555.com +porndairy.in +porndl.org +prostitutki-tolyatti.org +psoriasis-file.trade +pussysaga.com +qcstrtvt.bloger.index.hr +razamicroelectronics.com +realresultslist.com +realtytimes.com +referencemoi.com +renecaovilla.online +rique.host.sk +rollercoin.com romhacking.ru -royal-betting.net -scanner-barak.top +running-line.ru +rustic-quiver.win +rybalka-opt.ru +saneyes.com +sanjosestartups.com +santasgift.ml +savefrom.com +sbt-aqua.ru +scanner-margo.top +scanner-nelson.top sdi-pme.com -seasaltwithfood.com -seorussian.ru -sergiorossistore.online -sex-znakomstva.online -shiksabd.com -shopcheermakeup.info -sientalyric.co -sisi-go.ru -sitebeam.net -skatestick.bid -sledstvie-veli.net -sloopyjoes.com -sluganarodu.ru -socialmonkee.com -soda.media -soheavyblog.com -sports-supplements.us -spy-sts.com -stackthatbucks.com -stevemonsen.com -stockspmb.info -symphonyintegratedhealthcare.com -taboola.com -tagil.zrus.org -tandvardshuset.net -tfxiq.com -the-trader.net -thenews-today.info -trustedmaccleaner.com -tula.mdverey.ru -twelvevisionspartyofcolorado.com -tx41tclega.ru -tytoona.com -u555u.info -unionmarkt.de -uptime-alpha.net -valuado.com -vereo.eu -vesnatehno.com -vesnatehno.ru -visionwell.com.cn -vkontaktemusic.ru -vladimir.xrus.org -vote-up.ru -vvon.co.uk -vzube.com -web.cvut.cz -webenlace.com.ar -wechatdownload10.com -woman-tampon.ru -womensplay.net -word-vorlagen.xyz -wpsecurity.website -xmnb.net -xn----btbdvdh4aafrfciljm6k.xn--p1ai -xn----ctbbcjd3dbsehgi.xn--p1ai -xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai -youporn-ru.com -yourads.website -yousense.info -ytmnd.com -yun56.co -zrelaya.pw -zrus.org -zscalertwo.net -zvooq.eu -zx6.ru +searchengineranker.email +searchkut.com +searchlock.com +semp.net +seoanalyses.com +sextracker.de +sexytrend.ru +silktide.com +silverage.ru +simul.co +sitechecker.pro +smadihome.com +soundfrost.org +spinnerco.ca +sptslmtrafms.com +ssconstruction.co +sstroy44.ru +streamin.to +stroyplus.ru +sukirgenk.dvrlists.com +superkanpo.com +supermodni.com.ua +surintech.ac.th +svolze.com +tacbibirfa.tk +takeflyte.com +tedxrj.com +telefonsex-ohne0900.net +terrafootwear.us +tetracsaudi.com +thegamerznetwork.com +toon-families.com +topcasinoratings.ru +topsiteminecraft.com +torrents.life +tovaroboom.vast.ru +toys.erolove.in +traffixer.com +udsgame.online +us-america.ru +vashsvet.com +vbabule.net +visa-pasport.ru +vitalads.net +viveresaniesnelli.it +vladhistory.com +voditeltrezviy.ru +vpnmouse.com +wesharepics.info +wheelchairliftsarea.com +wholesalenfljerseys.us.com +womama.ru +woman-h.ru +worldhistory.biz +www.kabbalah-red-bracelets.com +www.timer4web.com +xn--80aikhbrhr.net +xn--b1addnj3cah.xn--p1ai +xn--e1aggki3c.xn--80adxhks +yaoguangdj.com +yougotanewdomain.com +yourdesires.ru +zaobao.com.sg +zebradudka.com +zerocash.msk.ru +zigarettenonlinekaufen.tumblr.com +zoomovies.org diff --git a/dev-tools/test_units/ratelimittest-master.txt b/dev-tools/test_units/ratelimittest-master.txt index 3656720f2..1a1628894 100644 --- a/dev-tools/test_units/ratelimittest-master.txt +++ b/dev-tools/test_units/ratelimittest-master.txt @@ -8,14 +8,7 @@

Welcome to the NginX Ultimate Bad Bot Blocker

This is merely used for testing !!!

- -503 Service Temporarily Unavailable - -

503 Service Temporarily Unavailable

-
nginx/1.18.0 (Ubuntu)
- - - +ml> 503 Service Temporarily Unavailable

503 Service Temporarily Unavailable

diff --git a/dev-tools/test_units/whitelist-ips.conf b/dev-tools/test_units/whitelist-ips.conf index e0d65a2eb..073172db8 100644 --- a/dev-tools/test_units/whitelist-ips.conf +++ b/dev-tools/test_units/whitelist-ips.conf @@ -1,2 +1,2 @@ -10.1.1.36 0; +10.1.0.244 0; 127.0.0.1 0; diff --git a/dev-tools/tmp/robots.txt b/dev-tools/tmp/robots.txt index dfabeeac1..a8e2f62d9 100644 --- a/dev-tools/tmp/robots.txt +++ b/dev-tools/tmp/robots.txt @@ -6,8 +6,8 @@ ### Version Information # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:21 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:33 UTC 2021 ### Bad Bot Count: 623 ################################################### ### Version Information ## diff --git a/robots.txt/robots.txt b/robots.txt/robots.txt index dfabeeac1..a8e2f62d9 100644 --- a/robots.txt/robots.txt +++ b/robots.txt/robots.txt @@ -6,8 +6,8 @@ ### Version Information # ################################################### -### Version: V4.2021.09.2617 -### Updated: Mon Sep 27 22:01:21 UTC 2021 +### Version: V4.2021.09.2618 +### Updated: Tue Sep 28 10:03:33 UTC 2021 ### Bad Bot Count: 623 ################################################### ### Version Information ##