V4.2021.08.2524 [ci skip]

2025-09-01 18:19:55 +00:00 · 2021-08-14 08:03:16 +00:00 · 2021-08-14 08:03:16 +00:00 · 35e716ab11
commit 35e716ab11
parent 61157da9e6
61 changed files with 1228 additions and 1129 deletions
--- a/AUTO-CONFIGURATION.md
+++ b/AUTO-CONFIGURATION.md
@ -4,9 +4,9 @@
 ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:

 _______________
-#### Version: V4.2021.08.2523
-#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
-#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
+#### Version: V4.2021.08.2524
+#### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
+#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
 ____________________

--- a/MANUAL-CONFIGURATION.md
+++ b/MANUAL-CONFIGURATION.md
@ -4,9 +4,9 @@
 ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:

 _______________
-#### Version: V4.2021.08.2523
-#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
-#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
+#### Version: V4.2021.08.2524
+#### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
+#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
 ____________________

--- a/README.md
+++ b/README.md
@ -11,9 +11,9 @@
 ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)

 _______________
-#### Version: V4.2021.08.2523
-#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
-#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
+#### Version: V4.2021.08.2524
+#### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
+#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
 ____________________

--- a/_generator_lists/bad-referrers.list
+++ b/_generator_lists/bad-referrers.list
@ -1,5 +1,3 @@
-placid-rounded-coast.glitch.me
-mybackgroundlandscape.blogspot.com
 000free.us
 007angels.com
 00author.com
@ -4562,6 +4560,7 @@ pl-top.pl
 pl-vouchers.com
 pl.aasoldes.fr
 pl.id-forex.com
+placid-rounded-coast.glitch.me
 pladform.ru
 plaff-go.ru
 plastgran.com
@ -7079,4 +7078,4 @@ zygophyceous.womanstars.site
 zynax.ua
 zytpirwai.net
 zzbroya.com.ua
-zzlgxh.com
+zzlgxh.com
--- a/_generator_lists/bad-user-agents.list
+++ b/_generator_lists/bad-user-agents.list
@ -1,6 +1,3 @@
-webprosbot
-webpros.com
-clark-crawler
 01h4x.com
 360Spider
 404checker
@ -564,6 +561,7 @@ autoemailspider
 backlink-check
 cah.io.community
 check1.exe
+clark-crawler
 coccocbot-web
 cognitiveseo
 com.plumanalytics
@ -616,6 +614,8 @@ trendiction.de
 ubermetrics-technologies.com
 voyagerx.com
 webmeup-crawler
+webpros.com
+webprosbot
 x09Mozilla
 x22Mozilla
 xpymep1.exe
--- a/_google_analytics_ghost_spam/README.md
+++ b/_google_analytics_ghost_spam/README.md
@ -3,9 +3,9 @@
 # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM

 _______________
-#### Version: V4.2021.08.2523
-#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
-#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
+#### Version: V4.2021.08.2524
+#### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
+#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
 ____________________

--- a/_google_analytics_ghost_spam/google-exclude-03.txt
+++ b/_google_analytics_ghost_spam/google-exclude-03.txt
--- a/_google_analytics_ghost_spam/google-exclude-04.txt
+++ b/_google_analytics_ghost_spam/google-exclude-04.txt
--- a/_google_analytics_ghost_spam/google-exclude-05.txt
+++ b/_google_analytics_ghost_spam/google-exclude-05.txt
--- a/_google_webmaster_disavow_links/google-disavow.txt
+++ b/_google_webmaster_disavow_links/google-disavow.txt
@ -4560,6 +4560,7 @@ domain:pl-top.pl
 domain:pl-vouchers.com
 domain:pl.aasoldes.fr
 domain:pl.id-forex.com
+domain:placid-rounded-coast.glitch.me
 domain:pladform.ru
 domain:plaff-go.ru
 domain:plastgran.com
--- a/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
+++ b/_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/conf.d/globalblacklist-testing-version.conf
+++ b/conf.d/globalblacklist-testing-version.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/conf.d/globalblacklist.conf
+++ b/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/_robots_input/robots-input.txt
+++ b/dev-tools/_robots_input/robots-input.txt
@ -561,6 +561,7 @@ autoemailspider
 backlink-check
 cah.io.community
 check1.exe
+clark-crawler
 coccocbot-web
 cognitiveseo
 com.plumanalytics
@ -613,6 +614,8 @@ trendiction.de
 ubermetrics-technologies.com
 voyagerx.com
 webmeup-crawler
+webpros.com
+webprosbot
 x09Mozilla
 x22Mozilla
 xpymep1.exe
--- a/dev-tools/beta_conf_files/conf.d/globalblacklist.conf
+++ b/dev-tools/beta_conf_files/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
+++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
+++ b/dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
+++ b/dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
+++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
+++ b/dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
+++ b/dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
+++ b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-user-agents.conf
+++ b/dev-tools/beta_conf_files_whitelist/bots.d/blacklist-user-agents.conf
@ -622,6 +622,7 @@
 	"~*(?:\b)backlink-check(?:\b|)"		0;
 	"~*(?:\b)cah.io.community(?:\b|)"		0;
 	"~*(?:\b)check1.exe(?:\b|)"		0;
+	"~*(?:\b)clark-crawler(?:\b|)"		0;
 	"~*(?:\b)coccocbot-web(?:\b|)"		0;
 	"~*(?:\b)cognitiveseo(?:\b|)"		0;
 	"~*(?:\b)com.plumanalytics(?:\b|)"		0;
@ -674,6 +675,8 @@
 	"~*(?:\b)ubermetrics-technologies.com(?:\b|)"		0;
 	"~*(?:\b)voyagerx.com(?:\b|)"		0;
 	"~*(?:\b)webmeup-crawler(?:\b|)"		0;
+	"~*(?:\b)webpros.com(?:\b|)"		0;
+	"~*(?:\b)webprosbot(?:\b|)"		0;
 	"~*(?:\b)x09Mozilla(?:\b|)"		0;
 	"~*(?:\b)x22Mozilla(?:\b|)"		0;
 	"~*(?:\b)xpymep1.exe(?:\b|)"		0;
--- a/dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
+++ b/dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
@ -4607,6 +4607,7 @@
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	0;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	0;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	0;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	0;
 	"~*(?:\b)pladform\.ru(?:\b)" 	0;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	0;
 	"~*(?:\b)plastgran\.com(?:\b)" 	0;
--- a/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
+++ b/dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
+++ b/dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/buildnumber
+++ b/dev-tools/buildnumber
@ -1 +1 @@
-2523
+2524
--- a/dev-tools/globalblacklist-testing.template
+++ b/dev-tools/globalblacklist-testing.template
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V3.2021.08.2523
-### Updated: Fri Aug 13 22:01:38 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V3.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/globalblacklist.template
+++ b/dev-tools/globalblacklist.template
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/referrers-regex-format-whitelist-test.txt
+++ b/dev-tools/referrers-regex-format-whitelist-test.txt
@ -4560,6 +4560,7 @@
 "~*(?:\b)pl\-vouchers\.com(?:\b)" 	0;
 "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	0;
 "~*(?:\b)pl\.id\-forex\.com(?:\b)" 	0;
+"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	0;
 "~*(?:\b)pladform\.ru(?:\b)" 	0;
 "~*(?:\b)plaff\-go\.ru(?:\b)" 	0;
 "~*(?:\b)plastgran\.com(?:\b)" 	0;
--- a/dev-tools/referrers-regex-format.txt
+++ b/dev-tools/referrers-regex-format.txt
@ -4560,6 +4560,7 @@
 "~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 "~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 "~*(?:\b)pladform\.ru(?:\b)" 	1;
 "~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 "~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
+++ b/dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.69.159.43            0;
+13.77.155.201           0;
--- a/dev-tools/test1_conf_files/conf.d/globalblacklist.conf
+++ b/dev-tools/test1_conf_files/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
+++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
+++ b/dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
+++ b/dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
+++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
+++ b/dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
+++ b/dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
+++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
+++ b/dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
@ -622,6 +622,7 @@
 	"~*(?:\b)backlink-check(?:\b|)"		0;
 	"~*(?:\b)cah.io.community(?:\b|)"		0;
 	"~*(?:\b)check1.exe(?:\b|)"		0;
+	"~*(?:\b)clark-crawler(?:\b|)"		0;
 	"~*(?:\b)coccocbot-web(?:\b|)"		0;
 	"~*(?:\b)cognitiveseo(?:\b|)"		0;
 	"~*(?:\b)com.plumanalytics(?:\b|)"		0;
@ -674,6 +675,8 @@
 	"~*(?:\b)ubermetrics-technologies.com(?:\b|)"		0;
 	"~*(?:\b)voyagerx.com(?:\b|)"		0;
 	"~*(?:\b)webmeup-crawler(?:\b|)"		0;
+	"~*(?:\b)webpros.com(?:\b|)"		0;
+	"~*(?:\b)webprosbot(?:\b|)"		0;
 	"~*(?:\b)x09Mozilla(?:\b|)"		0;
 	"~*(?:\b)x22Mozilla(?:\b|)"		0;
 	"~*(?:\b)xpymep1.exe(?:\b|)"		0;
--- a/dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
+++ b/dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
@ -4607,6 +4607,7 @@
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	0;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	0;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	0;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	0;
 	"~*(?:\b)pladform\.ru(?:\b)" 	0;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	0;
 	"~*(?:\b)plastgran\.com(?:\b)" 	0;
--- a/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
+++ b/dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
+++ b/dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
+++ b/dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.69.159.43            0;
+13.77.155.201           0;
--- a/dev-tools/test2_conf_files/conf.d/globalblacklist.conf
+++ b/dev-tools/test2_conf_files/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
+++ b/dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.69.159.43            0;
+13.77.155.201           0;
--- a/dev-tools/test3_conf_files/conf.d/globalblacklist.conf
+++ b/dev-tools/test3_conf_files/conf.d/globalblacklist.conf
@ -4,10 +4,10 @@

 ### VERSION INFORMATION #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:37 UTC 2021
-### Bad Referrer Count: 7079
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:28 UTC 2021
+### Bad Referrer Count: 7080
+### Bad Bot Count: 623
 ###################################################
 ### VERSION INFORMATION ##

@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)backlink-check(?:\b)"		3;
 	"~*(?:\b)cah.io.community(?:\b)"		3;
 	"~*(?:\b)check1.exe(?:\b)"		3;
+	"~*(?:\b)clark-crawler(?:\b)"		3;
 	"~*(?:\b)coccocbot-web(?:\b)"		3;
 	"~*(?:\b)cognitiveseo(?:\b)"		3;
 	"~*(?:\b)com.plumanalytics(?:\b)"		3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
 	"~*(?:\b)ubermetrics-technologies.com(?:\b)"		3;
 	"~*(?:\b)voyagerx.com(?:\b)"		3;
 	"~*(?:\b)webmeup-crawler(?:\b)"		3;
+	"~*(?:\b)webpros.com(?:\b)"		3;
+	"~*(?:\b)webprosbot(?:\b)"		3;
 	"~*(?:\b)x09Mozilla(?:\b)"		3;
 	"~*(?:\b)x22Mozilla(?:\b)"		3;
 	"~*(?:\b)xpymep1.exe(?:\b)"		3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	1;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	1;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	1;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	1;
 	"~*(?:\b)pladform\.ru(?:\b)" 	1;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	1;
 	"~*(?:\b)plastgran\.com(?:\b)" 	1;
--- a/dev-tools/test_units/blacklist-ips.conf
+++ b/dev-tools/test_units/blacklist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	1;
+10.1.0.168	1;
 127.0.0.1	1;
--- a/dev-tools/test_units/blacklist-user-agents.conf
+++ b/dev-tools/test_units/blacklist-user-agents.conf
@ -622,6 +622,7 @@
 	"~*(?:\b)backlink-check(?:\b|)"		0;
 	"~*(?:\b)cah.io.community(?:\b|)"		0;
 	"~*(?:\b)check1.exe(?:\b|)"		0;
+	"~*(?:\b)clark-crawler(?:\b|)"		0;
 	"~*(?:\b)coccocbot-web(?:\b|)"		0;
 	"~*(?:\b)cognitiveseo(?:\b|)"		0;
 	"~*(?:\b)com.plumanalytics(?:\b|)"		0;
@ -674,6 +675,8 @@
 	"~*(?:\b)ubermetrics-technologies.com(?:\b|)"		0;
 	"~*(?:\b)voyagerx.com(?:\b|)"		0;
 	"~*(?:\b)webmeup-crawler(?:\b|)"		0;
+	"~*(?:\b)webpros.com(?:\b|)"		0;
+	"~*(?:\b)webprosbot(?:\b|)"		0;
 	"~*(?:\b)x09Mozilla(?:\b|)"		0;
 	"~*(?:\b)x22Mozilla(?:\b|)"		0;
 	"~*(?:\b)xpymep1.exe(?:\b|)"		0;
--- a/dev-tools/test_units/custom-bad-referrers.conf
+++ b/dev-tools/test_units/custom-bad-referrers.conf
@ -4607,6 +4607,7 @@
 	"~*(?:\b)pl\-vouchers\.com(?:\b)" 	0;
 	"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 	0;
 	"~*(?:\b)pl\.id\-forex\.com(?:\b)" 	0;
+	"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 	0;
 	"~*(?:\b)pladform\.ru(?:\b)" 	0;
 	"~*(?:\b)plaff\-go\.ru(?:\b)" 	0;
 	"~*(?:\b)plastgran\.com(?:\b)" 	0;
--- a/dev-tools/test_units/random-bots-for-test-quick.list
+++ b/dev-tools/test_units/random-bots-for-test-quick.list
@ -1,10 +1,10 @@
-Bolt
-GermCrawler
-Gigablast
-Mozlila
-OutfoxBot
-RocketCrawler
-TurnitinBot
-Virusdie
-ips-agent
-magpie-crawler
+Abonti
+Bigfoot
+Boardreader
+LinqiaRSSBot
+Metauri
+Microsoft URL Control
+Pu_iN
+RankActiveLinkBot
+Voltron
+Web Fuck
--- a/dev-tools/test_units/random-bots-for-test.list
+++ b/dev-tools/test_units/random-bots-for-test.list
@ -1,250 +1,250 @@
-404enemy
-ALittle Client
-ASPSeek
-Aboundex
+ADmantX
+AIBOT
+Aboundexbot
+Acunetix
 AfD-Verbotsverfahren
-Alligator
-AlphaBot
-Anthill
+AiHitBot
+Aipbot
+Anarchy
 Apexoo
-Attach
-AwarioSmartBot
-BBBike
 BDCbot
-BDFetch
 BLEXBot
-BackStreet
-BacklinkCrawler
-Bandit
+BackWeb
+BetaBot
 Bitacle
+BlackWidow
+Blackboard
+BlowFish
 Bolt
 BotALot
 Brandprotect
-BuiltBotTough
+Brandwatch
+Buddy
 BuiltWith
-BuzzSumo
+Bullseye
+BunnySlippers
 CATExplorador
-CCBot
 CODE87
-CazoodleBot
-CensysInspect
-CheTeam
-CheeseBot
+Cegbfeieh
 CherryPicker
-ChinaClaw
-Cloud mapping
-CopyRightCheck
-Copyscape
-CrazyWebCrawler
-Crescent
-CrunchBot
-CyotekWebCopy
+Cocolyzebot
+Cogentbot
+Copier
+Cosmos
+Curious
+Custo
 DBLBot
 DTS Agent
-DatabaseDriverMysqli
-Disco
-Discobot
-Discoverybot
+Deusu
 DittoSpyder
-DnyzBot
+DomCopBot
 DomainSigmaCrawler
-DomainStatsBot
-Domains Project
+Dotbot
 Download Wonder
-EMail Siphon
+ECCP/1.0
+EMail Wolf
+EasyDL
+Ecxi
 EirGrabber
+Evil
 Exabot
-Extractor
+ExtractorPro
 EyeNetIE
-FDM
-FHscan
-FlashGet
+Fimap
 Flunky
+Freeuploader
+FyberSpider
 Fyrebot
-GalaxyBot
+GermCrawler
+GetRight
 Gigabot
-Go-Ahead-Got-It
+Go!Zilla
 GoZilla
-Grafula
+Gotit
+GrabNet
 GrapeFX
-HMView
-HaosouSpider
-Havij
+GrapeshotCrawler
+HTMLparser
+HTTrack
+Haansoft
+Harvest
 Heritrix
-Hloader
-Humanlinks
-HybridBot
 IDBot
 IRLbot
-Id-search
 IlseBot
+Image Fetch
 InfoTekies
-Internet Ninja
-InternetSeer
-Iria
-JamesBOT
-Jbrofuzz
-JennyBot
+InterGET
+Iskanie
+JetCar
+Jetty
 JikeSpider
+Joomla
 JustView
+Jyxobot
 Kenjin Spider
-Larbin
+Kozmosbot
+LNSpiderguy
+LWP::Simple
+LeechGet
+LexiBot
 Lftp
 LibWeb
-Libwhisker
-LieBaoFast
-Lightspeedsystems
-Linkbot
+LinkWalker
 LinkextractorPro
-LinqiaMetadataDownloaderBot
-LinqiaRSSBot
-MFC_Tear_Sample
-MIIxpc
+LinkpadBot
+LinksManager
+Ltx71
+MQQBrowser
 MSFrontPage
 MTRobot
+Magnet
 Mail.RU_Bot
-Majestic-SEO
-Majestic12
+MarkMonitor
+MarkWatch
+Mass Downloader
+Masscan
 MauiBot
 Mb2345Browser
-Meanpathbot
+MeanPath Bot
+MegaIndex.ru
 Metauri
-Microsoft Data Access
 Microsoft URL Control
-Mister PiX
 Mojolicious
 Morfeus Fucking Scanner
-Mozlila
-NPbot
-Name Intelligence
-Nameprotect
+Msrabot
+NICErsPRO
 Needle
 Nessus
-Net Vampire
 NetAnts
+NetMechanic
 NetSpider
-Netcraft
+Nettrack
 Netvibes
-Niki-bot
-Nikto
-NimbleCrawler
+Nibbler
 Ninja
-Nuclei
 Nutch
-Offline Explorer
+Octopus
+Offline Navigator
 OpenLinkProfiler
 OpenVAS
-OutclicksBot
-PageAnalyzer
-PageGrabber
+Openfind
+OrangeBot
+PageScorer
+PageThing.com
 Panscient
 Papa Foto
-Pi-Monster
-Pimonster
-Psbot
-PxBroker
-RankActive
-RankingBot2
+PeoplePal
+Petalbot
+Picscout
+PictureFinder
+Pixray
+Pockey
+ProPowerBot
+Probethenet
+PyCurl
+RankFlex
+RankingBot
+Rankivabot
+RankurBot
 Re-re
-Reaper
-RebelMouse
+RealDownload
+Recorder
 RedesScrapy
 RepoMonkey
-RocketCrawler
-SEOkicks-Robot
-SEOlyticsCrawler
-SEOstats
-ScoutJet
-Scrapy
-Screaming
+Rogerbot
+SBIder
+ScanAlert
 ScreenerBot
-Semrush
+ScrepyBot
+Searchestate
 SentiBot
 SeoSiteCheckup
+Shodan
+Siphon
+SiteCheckerBotCrawler
 SiteSnagger
-Sitevigil
 SlySearch
+Snake
 SocialRankIOBot
 Sociscraper
-Sogou web spider
+SputnikBot
+Sqlmap
 Sqworm
-Stripper
 Sucuri
-SuperBot
-Surfbot
+SuperHTTP
 SurveyBot
-T8Abot
-Teleport
+Suzuran
+T0PHackTeam
 TeleportPro
+Telesoft
 Telesphoreo
-TheNomad
 Thumbor
-TightTwatBot
-Titan
-Toweyabot
-Trendiction
 True_Robot
+Turingos
+Turnitin
+TurnitinBot
+TwengaBot
+URLy Warning
+URLy.Warning
+UnisterBot
 V-BOT
+VB Project
+Vacuum
 Vagabondo
-VelenPublicWebCrawler
 VidibleScraper
-Virusdie
-WASALive-Bot
-WEBDAV
+WBSearchBot
 WISENutbot
-WPScan
-WWW-Collector-E
-WallpapersHD
-WeSEE
-Web Enhancer
-Web Fetch
-Web Sauger
+WWW::Mechanize
+WWWOFFLE
+Wallpapers
+Wallpapers/3.0
+Web Collage
+Web Fuck
+Web Pix
 Web Sucker
+WebBandit
 WebEnhancer
 WebFetch
 WebFuck
-WebGo IS
-WebImageCollector
-WebPix
-WebReaper
+WebSauger
 WebSucker
-WebWhacker
-WebZIP
-Webshag
-WebsiteQuester
-Webster
-Whack
-Whacker
+Webalta
+WebmasterWorldForumBot
+Website Quester
+Whatweb
+WinHTTrack
+WiseGuys Robot
 Woobot
-Xaldon_WebSpider
+Wotbox
+Xaldon WebSpider
+Xenu
 YoudaoBot
-ZoominfoBot
-archive.org_bot
-arquivo-web-crawler
-arquivo.pt
-cah.io.community
+Zade
+Zauba
+Zermelo
+Zeus
+ZmEu
+ZyBorg
+clark-crawler
 coccocbot-web
-crawl.sogou.com
-gopher
+com.plumanalytics
+crawler.feedback
+domainsproject.org
+heritrix
+instabid
 ips-agent
-isitwp.com
-lwp-trivial
 magpie-crawler
-netEstate NE Crawler
-oBot
-pcBrowser
+muhstik-scan
 polaris version
-probe-image-size
 s1z.ru
-scalaj-http
-seoscanners
+seobility
 sitechecker.pro
 sogouspider
+sp_auditbot
 spyfu
-sysscan
 trendiction.com
 trendiction.de
-x09Mozilla
+webprosbot
 x22Mozilla
-xpymep1.exe
 zgrab
--- a/dev-tools/test_units/random-bots-for-whitelist-test.list
+++ b/dev-tools/test_units/random-bots-for-whitelist-test.list
@ -1,250 +1,250 @@
-404checker
-404enemy
-80legs
+01h4x.com
+360Spider
 ADmantX
-AIBOT
 ALittle Client
-ASPSeek
 Abonti
-Aboundex
 Aboundexbot
+AfD-Verbotsverfahren
 AhrefsBot
 AiHitBot
+Aipbot
+AlphaBot
 Anarchie
-Apexoo
+Ankit
+Anthill
 Aspiegel
-Asterias
-AwarioRssBot
-BBBike
-BDCbot
-BLEXBot
-BackDoorBot
+Attach
+BackWeb
+BacklinkCrawler
 Badass
+Bandit
+Barkrowler
+BatchFTP
+Battleztar Bazinga
+Bigfoot
+Bitacle
 Black Hole
 Blackboard
 Blow
-Boardreader
-Bolt
 BotALot
+Brandprotect
+Brandwatch
 Buck
-Buddy
 BuiltBotTough
 BuiltWith
-CATExplorador
+Bullseye
+BunnySlippers
+BuzzSumo
 CCBot
 CODE87
-Calculon
-CazoodleBot
-CheTeam
-CherryPicker
-ChinaClaw
-Copyscape
-Cosmos
-Craftbot
-Curious
+CSHttp
+CheeseBot
+Chlooe
+Crescent
 DBLBot
 DIIbot
 DTS Agent
+DataCha0s
 Demon
-Devil
-DigitalPebble
+Discobot
 Discoverybot
-Dispatch
 DittoSpyder
+DnyzBot
 DomCopBot
-DomainSigmaCrawler
-Dotbot
+DomainCrawler
+DomainStatsBot
 Download Wonder
-Drip
-EMail Wolf
+EasyDL
 Ecxi
-EirGrabber
-EroCrawler
-Exabot
-ExtLinksBot
-FDM
+Evil
+Extractor
+FHscan
+FemtosearchBot
 Fimap
+Firefox/7.0
+Flunky
+Foobot
 Freeuploader
-FrontPage
 GT::WWW
-GermCrawler
-GetRight
+Genieo
 Gigablast
-Gigabot
+Go!Zilla
 Go-Ahead-Got-It
-Grabber
-GrapeFX
+GoZilla
+GrabNet
 GridBot
-Havij
+HEADMasterSEO
+HTMLparser
+Harvest
+Heritrix
 Hloader
 Humanlinks
+HybridBot
 IDBot
-IlseBot
-Image Sucker
+Iblog
+Image Fetch
+IndeedBot
+Indy Library
 InfoNaviRobot
+InfoTekies
+Intelliseek
 InterGET
-InternetSeer
+Internet Ninja
+IstellaBot
+JOC Web Spider
+JetCar
+Jetty
 JikeSpider
-LWP::Simple
+Joomla
+Jorgee
+Kozmosbot
 Lanshanbot
+LeechFTP
 LeechGet
-LexiBot
-LinkWalker
+Libwhisker
+LinkScan
+Linkbot
 LinkextractorPro
-LinqiaMetadataDownloaderBot
+LinkpadBot
+LinksManager
 LinqiaRSSBot
-Ltx71
-MFC_Tear_Sample
-MIDown tool
+Lipperhey
+Litemage_walker
+Lmspider
 MJ12bot
 MQQBrowser
+MSFrontPage
+MTRobot
+Mag-Net
 Majestic SEO
-Majestic-SEO
+MarkMonitor
 MarkWatch
-Mediatoolkitbot
+Mata Hari
+Mb2345Browser
+Meanpathbot
 MegaIndex.ru
-Metauri
-MicroMessenger
-Microsoft Data Access
-Moblie Safari
 Morfeus Fucking Scanner
-Mozlila
 Mr.4x3
+Msrabot
 NICErsPRO
-NPbot
 Navroad
-Needle
-Net Vampire
-NetSpider
-Nettrack
-Netvibes
+NearSite
+Netcraft
+NextGenSearchBot
 Nikto
-Nutch
-Octopus
+Nimbostratus
 Offline Explorer
-Openfind
-OrangeSpider
+OnCrawl
+OpenLinkProfiler
+OpenVAS
+Openvas
 OutfoxBot
-PageAnalyzer
-PageGrabber
-PageScorer
-Pandalytics
 Papa Foto
-Petalbot
+Pi-Monster
 Picscout
-Picsearch
-Pimonster
-Probethenet
-Psbot
+Piepmatz
+ProPowerBot
+ProWebWalker
+Pu_iN
 Pump
-PxBroker
 QueryN Metasearch
-RSSingBot
-RankActiveLinkBot
-RankFlex
-ReGet
-Recorder
-RedesScrapy
+Quick-Crawler
+RankActive
+RankurBot
+Reaper
 Ripper
-RocketCrawler
-Rogerbot
 SBIder
-SEOlyticsCrawler
+SEOkicks
+SEOprofiler
+SEOstats
 SMTBot
-ScanAlert
+SalesIntelligent
 ScoutJet
-Scrapy
 Screaming
 ScreenerBot
-ScrepyBot
-SearchmetricsBot
-SentiBot
-Seomoz
-Siphon
-Site Sucker
+SeoSiteCheckup
+Shodan
 SiteExplorer
-SiteLockSpider
-Siteimprove
-Sitevigil
+SiteSnagger
+SiteSucker
+Sitebeam
 SlySearch
-Snapbot
 Snoopy
 SocialRankIOBot
-Sociscraper
 Sosospider
-Sottopop
-SpaceBison
-SpankBot
 Spanner
-Spbot
-Spinn3r
 SputnikBot
-Sqlworm
 Sqworm
+Stripper
 Sucker
-TeleportPro
-Telesphorep
+Suzuran
+Szukacz
+T0PHackTeam
+Teleport
 The Intraformant
-TheNomad
+TightTwatBot
 Titan
-Toata
 Toweyabot
-True_Robot
-UnisterBot
+Trendictionbot
+Turnitin
+Typhoeus
+URLy Warning
+URLy.Warning
+Upflow
 VCI
-Vacuum
-Vagabondo
 VelenPublicWebCrawler
-VidibleScraper
+VeriCiteCrawler
 Virusdie
-Voil
-Voltron
+WBSearchBot
+WISENutbot
+WPScan
 WWW-Collector-E
 WWWOFFLE
 Wallpapers
-Wallpapers/3.0
 WeSEE
-Web Auto
-Web Enhancer
+Web Collage
+Web Fetch
 Web Sauger
-Web Sucker
-WebCopier
-WebFuck
-WebGo IS
-WebLeacher
+WebBandit
+WebEnhancer
+WebFetch
+WebImageCollector
+WebReaper
+WebStripper
+WebSucker
 WebWhacker
-WebZIP
-Webshag
-Whack
+WebsiteExtractor
+WebsiteQuester
+Whatweb
 Who.is Bot
-WinHTTrack
-Wonderbot
-Woobot
 Wotbox
+Wprecon
 Xaldon_WebSpider
+Xenu
+YoudaoBot
 Zade
 Zauba
-Zermelo
-Zeus
-ZumBot
-autoemailspider
-backlink-check
-cah.io.community
-check1.exe
-cognitiveseo
-crawler.feedback
-facebookscraper
-gopher
+ZoominfoBot
+ZyBorg
+arquivo.pt
+com.plumanalytics
+evc-batch
+instabid
+internetVista monitor
+lwp-request
 lwp-trivial
 magpie-crawler
-muhstik-scan
+mediawords
+netEstate NE Crawler
 oBot
-page scorer
+pcBrowser
+s1z.ru
+satoristudio.net
 scalaj-http
-serpstatbot
 sexsearcher
-sysscan
-trendiction.de
-voyagerx.com
+tAkeOut
+trendiction.com
 webmeup-crawler
+webprosbot
+x09Mozilla
 x22Mozilla
--- a/dev-tools/test_units/random-referrers-for-test-quick.list
+++ b/dev-tools/test_units/random-referrers-for-test-quick.list
@ -1,10 +1,10 @@
-bannerspace.com
-chatroulette.online
-danschawbel.com
-fitnesspiks.com
-gosreg.amchs.ru
-hauleddes.com
-headpress.ru
-imk.com.ua
-moncleroutletonline.win
-slowmacfaster.trade
+202ch.com
+beauty-b0x.pl
+e90post.com
+minneapoliscopiers.com
+mountainstream.ms
+polybuild.ru
+sex-pr.net
+sexsaoy.com
+store-rx.com
+traffixer.com
--- a/dev-tools/test_units/random-referrers-for-test.list
+++ b/dev-tools/test_units/random-referrers-for-test.list
@ -1,500 +1,500 @@
-101raccoon.ru
-1flag.co.za
-21h2o.com
-24-ak.ru
-2rich4bitches.com
-5ws.dating-app.ru
-66cpwgln.space
-7wind.ru
-98oi.ru
-9med.net
-aaronabel.com
-accessoires-mode.in
-addblueoff.com.ua
+000free.us
+1-free-share-buttons.com
+1001watch.com.ua
+1008.su
+100dollars-seo.com
+10bet.com
+23kw.ru
+4replicawatch.net
+aasoldes.fr
+abusora.com
+abwa.tk
+adbetclickin.pink
+adf.ly
 adimmix.com
-admatic.com.tr
-adrunnr.com
-adsfresh.men
-adtech.fr
-adzpower.com
-agysya.ru
-air-edem.ru
-alert.scansafe.net
-alfa9.com
-alienwheel.es
-alive-ua.com
-allboard.xobor.de
-allfinweb.com
-allproblog.com
-allwomen.info
-am-se.com
-ample-awards-today.us
-analytics-ads.xyz
-android4fun.org
-antons-transporte.de
-apiadanaknet-a.akamaihd.net
-apidigidocketnet-a.akamaihd.net
-apimountainbikei-a.akamaihd.net
-asrv-a.akamaihd.net
-asscenihotosidea.blogspot.co.za
-atmovs.com
-atofilms.com
+adloads.net
+adservme.com
+adultfullhd.com
+aero2.ru
+affrh2015.com
+afftrack001.com
+alarmobninsk.ru
+albumsuper.info
+alldezservice.kz
+alveris.ru
+alyeskaresort.com
+ameblo.top
+amt-k.ru
+amyfoxfitness.com
+ananumous.ru
+andpolice.com
+animali.deagostinipassion.it
+anmysite.com
+anonymousfox.co
+app5.letmacworkfaster.world
+apper.de
+appleid-verification.com
+apps-analytics.net
+arcadepages.com
+arewater.com
+arraty.altervista.org
+asseenontv.ru
 atovh.local-finders.com
-auto.rusvile.lt
-autoblogger24.info
-aviav.co
-aviav.ru.com
-aviva-limoux.com
-avkzarabotok.info
-avramstroy.ru
-avtoarenda.by
-avtolombard-krasnodar.ru
+avon-novosib.ru
+awency.com
 azbukafree.com
-azinoofficial777.ru
-b2b-lounge.com
-balook.com
-bank.uz
-bannerconnect.net
-bannertesting.com
-battleforupdating.site
-belsetirehafi.tk
-besthoro.ru
-betterhdporn.com
-bget.ru
-bif-ru.info
-bingoporno.com
-binomo.kz
-blagovest-med.ru
-blogs.rediff.com
-blpmovies.com
-boc.kz
-bodybuilding-shop.biz
-bravegirlsclub.com
-brewdom.ru
+bablonow.ru
+backlinkwatch.com
+backuperwebcam.weebly.com
+badavit.com.ua
+bala.getenjoyment.net
+baladur.ru
+beachdriveblog.com
+beclean-nn.ru
+best-seo-offer.com
+bestkfiledxd.cf
+bestmobilityscooterstoday.com
+bestwaystogetpaid.us
+bestwebsiteawards.com
+bet365.com
+beztuberkuleza.ru
+biketank.ga
+bimatoprost-careprost.com.ua
+bin-brokers.com
+bloggedporn.com
+bloke.com
+bonky.biz
+bookmaker-bet.com
+bookmark4you.com.biz
+brainsandeggs.blogspot.com
+brandedleadgeneration.com
+brandimensions.com
+break-the-chains.com
 brimstonehillfortress.org
-bristolhostel.com
-bugof.gq
-bumascloset.com
+briomotor.co
+bristolhotel.com.ua
+brus.city
+buigas.00it.com
+bumskontakte.org
+buqayy0.livejournal.com
+bus-offer.com
 buy-cheap-online.info
-buy-cheap-pills-order-online.com
-byme.se
-cakemediahq.com.au
-candlehandmade.com
-caveavins.fr
-cejewelry.xyz
-cementaresearch.se
-cenoval.ru
-cerev.info
-cheatcode-lita12.rhcloud.com
-chiptuninger.com
-cicaki.net
-cleanmypc.com
-cleanpcnow.com
-compliance-andrew.xyz
-constantaservice.net
-continent-e.tv
-converse.ddsoldes.fr
+buy-forum.ru
+carfax.com.ua
+cartierlovestore.xyz
+cartierreplica.xyz
+cdn.walkme.com
+cfjump.com
+chatroulette.si
+cheap-trusted-backlinks.com
+cheapmarmot.online
+cheapmoncler.xyz
+christianlouboutinreplica.win
+cialisndbrx.com
+cialiswithoutadoctor.net
+cityadspix.com
+clash-clans.ru
+clayvasedesigns.tk
+clickaider.com
+clknsee.com
+clksite.com
+clothesforcash.com
+co.lumb.co
+comissionka.net
+compliance-john.top
+comsysnet.com
+concealthyself.com
+contentsexpress.com
 cookie-law-enforcement-hh.xyz
-copro.pw
+coolyarddecorations.com
+coprofam.org
 country-chic.ru
-cscwtalkto.site
-cupday.com
-customcollegeessays.net
-dailystrength.org
-damasarenai.info
-daneshetabiat.com
-data-mining.tk
-datadepths.com
-date-withme.com
-dating-app.ru
-de.zapmeta.com
-descargar-musica-gratis.net
-design-ideas.info
+covetnica.com
+cranly.net
+crazyboost.pro
+credit-online.ws
+credit.co.ua
+crystalslot.com
+czeshop.info
+darkbooks.org
+daydream-studio.ru
+daymusam.com
+dbmkfhqk.bloger.index.hr
+deda-moroza-zakaz.ru
+delitime.info
 destinationrealestate.com
-dirtpics.pw
-divatraffic.com
-djekxa.ru
-dnsrsearch.com
-dodlive.mil
-donvito.unas.cz
-download-wallpaper.net
-dumpsmania24.com
-e-collantes.com
-earthmagic.info
-egovaleo.it
-egvar.net
-electrik-avenue.com
-elvel.com.ua
-en.altezza.travel
-engines-usa.com
-englate.com
-eorogo.top
-eropornosex.ru
-essayassist.com
-estibot.com
-evehemming.blogspot.com.au
-everflora.ru
-exchanges-bet.com
-extlinks.com
-extremepornos.net
+diarioaconcagua.com
+digest-project.ru
+digitalassetmanagement.site
+dildofotzen.net
+dimaka.info
+dinkolove.ya.ru
+discountbarbour.online
+divisioncore.com
+docs4all.com
+documentbase.net
+domainsatcost.com
+domashneeruporno.com
+domini.cat
+dostavimvdom.ru
+download-walpaperhd.blogspot.com
+downloadeer.net
+dvd-famille.com
+eachdayisagift.review
+easycommerce.cf
+easync.io
+edge.sharethis.com
+efkt.jp
+elektrozigarette2.webs.com
+englishdictionaryfree.com
+erot.co
+erotikstories.ru
+ertelecom.ru
+esopini.com
+etur.ru
+euroskat.ru
+ewebarticle.info
+excitacao.com
 eywords-monitoring-your-success.com
-ezigarettekaufen2.blox.pl
+ezigarettenkaufen2.dreamwidth.org
 ezigaretteshop.webs.com
-falcon-images.blogspot.com
-favornews.com
-fetroshok.ru
-fettefrauen.net
-fickluder69.com
-findpik.com
-fitfloponline.store
+f00kclan.de
+f07.de
+falopicm.pw
+farmingworm.com
+fdzone.org
+fil.ru
+filerockstar298.weebly.com
+filmci.pro
+findsexguide.com
+fix-website-errors.com
+flooringinstallation-edmonton.com
+floridahuntingfishingadventures.com
+fordsonmajbor.cf
+forex-procto.ru
 forex21.ru
 forexgb.ru
 forodvd.com
-forpackningsutveckling.se
-forum-engineering.ru
-franklinfire.co
-freshdz.com
-frustrated-favorable.gq
-fx-brokers-review.com
-fz139.ttk.ru
-game-top.su
-gameplexcity.com
-gamesprite.me
-gateway.zscalerone.net
-gavuer.ru
-gay-site.store
-get-free-traffic-now.com
-getridofstretchmarks.org
-ghostvisitor.com
-gidonline.one
-gigapeta.com
-girlporn.ru
-girlsatgames.ru
-glicol.kz
-globatur.ru
+foto-telok.net
+free-fb-traffic.com
+free-social-buttons.xyz
+freeuploader.ml
+fuel-gas.com
+galaxy-family.ru
+gamedayhouse.com
+gaypornmovie.net
+gearcraft.us
+geilehausfrauen.net
+getmyads24.com
+gigablast.com
 glopages.ru
-goatse.ru
-gosmeb.ru
-gov.yanao.ru
-guiadeserraazul.com
-hamacapty.com
-hanink.biz.ly
-hausfrauensex18.com
-hdimagegallery.net
-hdwalls.xyz
-healbio.ru
-healing-dysplasia.ru
-health-medical-portal.info
-hermesbracelets.xyz
+gnuetella.com
+go2album.com
+gobongo.info
+golden-catalog.pro
+googglet.com
+gorabagrata.ru
+goroda-vsego-mira.ru
+guod.me
+hacktougroup.ru
+handicapbathtubarea.com
+handsandlegs.ru
+herehloadibs.cf
 hifidesign.ru
-hildinghr.se
-hmmm.cz
-hoholikik.club
-host-protection.com
-hostingclub.lk
-housemilan.ru
-hoztorg-opt.ru
-hplaserjetpdriver8y.pen.io
-hubbble.com
+himazin.info
+histock.info
+home-task.com
+hotblog.top
+houdom.net
+hoverboardforsaledirect.com
+howtoclean.club
+hspline.com
+huhn.altervista.org
+husky-shop.cz
 iamsport.org
-idegenvezeto.eu
-iflycapetown.co.za
+ictizanidinehcl4mg.blogspot.com
+ideawheel.com
+ideibiznesa2015.ru
+ifirestarter.ru
 ihc2015.info
-iinstalll-fii1leis.jus0wil.pp.ua
-ikritikimou.gr
-imagerydatabase.com
-impresagaia.it
-incolors.club
-increasewwwtraffic.info
-inet-traffic.com
-infobanks.ru
-intellego.info
-investsuccess.org
-iopeninghours.co.uk
-irkutsk.zrus.org
-isitwp.com
-ispac.org
-istizanidinelikexanax.blogspot.com
-itch.io
-ivearchenceinflu.cf
-iwantmyfreecash.com
-jamiembrown.com
-japfm.com
-joessmogtestonly.com
-jyrxd.com
-kalandranis.gr
-karpun-iris.ru
-karusel-market.ru
-kfon.eu
-knowsitall.info
-kochanelli.com
-ktotut.net
-kupit-adenu.ru
-laptoper.net
-lawyersinfo.org
-lechenie-gemorroya.com
-ledis.top
-lenvred.org
-lexaprogeneric.link
-li-er.ru
-linkarena.com
-linksharingt.com
-littlesunraiser.com
-livetsomudvekslingstudent.bloggersdelight.dk
-locatellicorretor.com.br
-longadventure.com
-lovi-moment.com.ua
-lunamedia.co
-lunchrock.co
-m1media.net
-macresource.co.uk
-maranbrinfo.com.br
+iklysha.ml
+ilte.info
+imgarit.pw
+integritylandscapeservices.com
+interferencer.ru
+internetartfair.com
+investingclub.ru
+iptool.xyz
+istizanidineanarcoticdrug.blogspot.com
+itag.pw
+itservicesthatworkforyou.com
+james13prix.info
+javatex.co.id
+javspace.net
+jbl-charge.info
+jerseyschinabizwholesale.us
+jurajskie.info
+jwcialislrt.com
+kaidalibor.de
+kazan.zrus.org
+kemerovo.zrus.org
+kenaba.su
+kinogolos.ru
+kinozapas.com
+kongruan.com
+kountrylife.com
+krassh.ru
+ks1234.com
+kvartir-remont.biz
+kvartira-sutochno.com
+laptop-4-less.com
+lashstudia.ru
+laxob.com
+lion.bolegapakistan.com
+littlecity.ch
+llastbuy.ru
+loadingpages.me
+lotto6888.com
+m.b00kmarks.com
+m0r0zk0-krava.ru
+macfix.life
+macrotek.ru
+magento-crew.net
+magicalfind-a.akamaihd.net
+magnetic-bracelets.ru
+mailemedicinals.com
+mamasuper.prom.ua
+marblestyle.ru
 marinetraffic.com
-mazda-roadsters.com
-megahdporno.net
-meget.co.za
-migente.com
-militarysale.pro
-mir-limuzinov.ru
-mirtorrent.net
-misswell.net
-misterjtbarbers.com
-mitrasound.ru
-mlvc4zzw.space
-mobifunapp.weebly.com
-mole.pluto.ro
-moneyviking-a.akamaihd.net
-moomi-daeri.com
-mosdverka.ru
-mossmesi.com
-msk.afora.ru
-muz-shoes.ru
+masthopehomes.com
+matchpal-a.akamaihd.net
+mecash.ru
+medanestesia.ru
+medictube.ru
+medkletki.ru
+meduza-consult.ru
+megakino.net
+mexicosleevegastrectomy.com
+mir-betting.ru
+mirmedinfo.ru
+mirzonru.net
+moivestiy.biz
+mojowhois.com
+monetizationking.net
+moneyteam24.com
+morf.snn.gr
+mrcsa.com.au
+mrpornogratis.xxx
+mrsdalloways.com
+mttwtrack.com
+mustat.com
+mwtpludn.review
 myblogregistercm.tk
-mydeathspace.com
-myghillie.info
-myphotopipe.com
-naj-filmy24.pl
-nastydollars.com
-needtosellmyhousefast.com
-netvouz.com
-new-post.tk
+namecrumilchlet.tk
+naphukete.ru
+naturtreenspicerx.pw
+naval.jislaaik.com
+neobux-bg.info
+net-profits.xyz
 newstraveller.ru
-newyorkhotelsmotels.info
-nibbler.silktide.com
-nicovideo.jp
-nightvision746.weebly.com
-njkmznnb.ru
-noclegonline.info
 nodding-passion.tk
-nofreezingmac.work
-nootrino.com
-nottyu.xyz
+norththeface.store
+noumeda.com
+novatech.vn
 o-o-11-o-o.com
+obiavo.by
+obiavo.kz
+obuv-kupit.ru
 oddamzadarmo.eu
-oivcvx.website
-okmedia.sk
-one-gear.com
-onlainbesplatno.ru
-online-hit.info
-onlinemeetingnow.com
-onlinewritingjobs17.blogspot.ru
-orsonet.ru
+omgtnc.com
+onlinefilmz.net
+ooo-gotovie.ru
+openfrost.com
+openlibrary.org
+osb.se11.ru
+ostrovtaxi.ru
 outpersonals.com
-outrageousdeal-a.akamaihd.net
-ozoz.it
-pacificair.com
-paparazzistudios.com.au
-paradontozanet.ru
-partner-high.men
-partner-pop.men
-pcads.ru
-pearlisland.ru
-penisvergrotendepillennl.ovh
-photokitchendesign.com
-pintattoos.com
-pipki.r.acdnpro.com
-pixell.club
-pk-pomosch.ru
-pl-vouchers.com
-pl.id-forex.com
-pod-muzyku.club
+paclitor.com
+palvira.com.ua
+parfusale.se
+pc-services.ru
+perm-profnastil.ru
+photo-clip.ru
+picsearch.com
+piluli.info
+pivka.xyz
+platesauto.com
+platinumdeals.gr
+playlott.com
+pochtovyi-index.ru
+podshipniki-ntn.ru
 pokemongooo.ml
-porno-home365.com
-pornodojd.ru
-pornoklad.ru
-pornosmola.info
-pornoxxx.com.mx
-pornpost.in
-poshiv-chehol.ru
-pozdrawleniya.ru
-pr0fit-b0x.com
-prchecker.info
-predmety.in.ua
+popmarker.com
+popugauka.ru
+porngalleries.top
+porno.simple-image.com.ua
+pornoblood.com
+powenlite24.ru
+powitania.pl
 predominant-invent.tk
-privacylocationforloc.com
-privatamateure.com
-profitfx.online
+printdirectforless.com
+priora-2.com
+professionaldieselcare.com
+profitwithalex.info
 prointer.net.ua
-prom23.ru
-prostitutki-belgoroda.org
-prostitutki-kharkova.org
+prospekt-st.ru
 prostitutki-novgoroda.org
-prostitutki-odessa.org
-purplestats.com
-quangcaons.com
-quick-offer.com
-razamicroelectronics.com
+qor360.com
+quelle.ru
+quickbuck.com
+qwarckoine.com
+ranksonic.com
+rapevideosmovies.com
 real-time-analytics.com
-reckonstat.info
-redhotfreebies.co.uk
-referencemoi.com
-registry-clean-up.net
-remorcicomerciale.ro
-resant.ru
-rewardpoll.com
-ricorsogiustizia.org
-roleforum.ru
-royalvegascasino.com
-rrutw.com
+realizmobi.com
+rebuildermedical.com
+redirlock.com
+regionshop.biz
+registrationdomainsite.com
+reklama-i-rabota.ru
+remont-fridge-tv.ru
+replica-watch.ru
+resellerclub.com
+responsinator.com
+restaurantlescampi.com
+rewardit.com
+ringtonepartner.com
+ruex.org.ua
+runstocks.com
+ruscoininvest.company
+rutor.group
+rybalka-opt.ru
 sabaapress.com
 sabizonline.com
-salut-camp.ru
-sammyweaver.com
-samo-soznanie.ru
-sanatorrii.ru
-sbprabooks.com
-scanner-jack.top
-scanner-walter.top
-screentoolkit.com
-secretscook.ru
-see-your-website-here.com
-seeingmeerkat.com
-seeresultshub-a.akamaihd.net
-seinterface.com
-seksotur.ru
-semprofile.com
+saddiechoua.com
+sanidumps.com
+sardinie.us
+sarf3omlat.com
+savetubevideo.com
+scanner-elena.top
+scenarii-1-sentyabrya.uroki.org.ua
+search.xtconnect.com
+searchimpression.com
+searchkut.com
+searchwebknow-a.akamaihd.net
+seminarykansas904.ml
 seo-tools-optimizing.com
-seobility.net
-seozoom.it
-servicecenter.co.ua
-serw.clicksor.com
-sex.hotblog.top
-sexkrasivo.net
-sexsaoy.com
-sexspornotub.com
-ship-marvel.co.ua
-shoppingjequiti.com.br
-site3.free-share-buttons.com
-sitevaluation.org
-skincrate.net
-skypasss.com
-slim.sellany.ru
-slomm.ru
-slowmac.tech
-smichovbike.cz
-smokewithrabbits.com
-smstraf.ru
-soc-econom-problems.ru
-socialbuttons.xyz
+seofied.com
+serptehnika.ru
+sex-tracker.de
+sexs-foto.com
+sexstream.pl
+shop.xz618.com
+simply.net
+sinestesia.host.sk
+small-game.com
+snow.nvr163.com
+soaksoak.ru
+social-s-hhh.xyz
+social-vestnik.ru
 socialseet.ru
-softtor.com
-soserfis.com
-spywareit.com
-srecorder.com
+socialtrade.biz
+sockshare.net
+soda.media
+softwaretrend.net
+sotkal.lark.ru
+spravka130.ru
+sps-shop.com
 ssconstruction.co
-star61.de
+starpages.net
+startufa.ru
 starwars.wikia.com
-stauga.altervista.org
-sticken.co
-stopnarco.ru
-streetfire.net
+staticfs.host
+steelmaster.lv
+storehouse.ua
+strag-invest.ru
+strana-krasoty.ru
+strana-solnca.ru
 strongholdsb.ru
+studiokamyk.com.pl
 sugarkun.com
 suggest-keywords.com
-suhanpacktech.com
-superstarfloraluk.com
-survival.betteroffers.review
-svarkagid.com
-svetodiodoff.ru
-tampabaywatch.org
-tandvardshuset.net
-tedy.su
-teenporn18.net
-telsis.com
-templates.radiodigital.co
+superfish.com
+superlist.biz
+surflinksmedical.com
+svarbit.com
+syvertsen-da.no
 thaisamkok.com
-the-usa-games.blogspot.com
+thaismartloan.com
 thedownloadfromwarez.blogspot.com
-theprofitsmaker.net
-thin.me.pn
-timdreby.com
-tizanidineusedfor.blogspot.com
-tnaionline.org
-top10registrycleaners.com
-topbestgames.com
-torrent-newgames.com
-tourcroatia.co.uk
-trahic.ru
+thefotosgratis.eu
+theheroes.ru
+thelottosecrets.com
+thetardistimes.ovh
+tizanidine4mgstreetvalue.blogspot.com
+tizanidinefibromyalgia.blogspot.com
+tizanidinehcl2mgsideeffects.blogspot.com
+tizanidineingredients.blogspot.com
+tizanidineoral.blogspot.com
+tongkatmadura.info
+top-study.work
+top10-way.com
+trkdf.com
 truck-rece.life
-twittrading.com
-u-cheats.ru
-uchetunet.su
-udsgame.online
-ugguk.online
-umg-stroy.ru
-uni.me
-unimodemhalfduplefw.pen.io
-univerfiles.com
-uptime-as.net
-us-america.ru
-utiblog.fr
-v24s.net
-vclicks.net
-verymes.xyz
-vesnatehno.com
-videochat.ph
-videospornogratisx.net
-vietimgy.pw
-vikistars.com
-vip-parfumeria.ru
-vitalads.net
-vitoriacabos.com
-vltai.com
-vodkoved.ru
-vvon.co.uk
-wallpapers-best.com
-webenlace.com.ar
-webpromotion.ae
-webs.com
-webshoppermac.com
-webtherapy.ru
-weddingdresses.xyz
-whatistizanidinehclusedfor.blogspot.com
-whatsappdownload10.com
-whereverdesperate.gq
-wikes.20fr.com
-wineration.com
-woman-tampon.ru
-woweb.com.ua
-wrz0iuebwhp5fg.freeddns.com
-wurr.voila.net
-x-true.info
-xn--24-glceagatoq7c2a6ioc.xn--p1ai
-xn--b1ag5cfn.xn--p1ai
-xtraffic.plus
-xvideospornoru.com
-xxx-treker.ru
-yachts-cruise.info
-yellocloud.be
-yes-com.com
-yunque.pluto.ro
-yurgorod.ru
-zaidia.xhost.ro
-zeroredirect.com
-zeroredirect5.com
+twitlinks.com
+twu.com.ua
+ukkala.xyz
+ultimateclassicrock.com
+unrealcommander.org
+uptimechecker.com
+url-extractor.xyz
+url-img.link
+uzungil.com
+varikozdok.ru
+vbtracker.net
+viagraneggrx.com
+viddyoze.com
+vintontech.info
+vip-dom.in
+vip2ch.com
+vkak.ru
+vsexkontakte.net
+vtcdns.com
+vuclip.com
+vzlomfb.com
+wahicbefa31.soup.io
+waterefficiency.co
+website-analyzer.info
+whipme.yopoint.in
+wholesalejerseys-cheapest.com
+whos.amung.us
+williamrobsonproperty.com
+womensplay.net
+wowas31.ucoz.ru
+xcc24.pl
+xep.info
+xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
+xn----7sbho2agebbhlivy.xn--p1ai
+xn--c1acygb.xn--p1ai
+xn--h1ahbi.com.ua
+xn--hxazdsfy.blogspot.com
+xsion.net
+xtremeeagles.net
+xtube.com
+yoshkarola.zrus.org
+youbloodyripper.com
+youdesigner.kz
+youporn-forum.ga
+yourserverisdown.com
+yugk.net
+zarabiaj-dzis.pl
+zastroyka.org
+zatjmuzu.info
+zeroredirect7.com
+zigzog.ru
+znaniyapolza.ru
 zojirushi-products.ru
-zoogdisany.com
-zooggames.com
+zoodrawings.com
+zoominfo.com
 zrizvtrnpale.tk
-zskdla.site
-zvuker.net
+zs2vm.top
--- a/dev-tools/test_units/random-referrers-for-whitelist-test.list
+++ b/dev-tools/test_units/random-referrers-for-whitelist-test.list
@ -1,250 +1,250 @@
-007angels.com
-00it.com
-123kuma.com
-18ps.ru
-2daytrendingnews.com
-4senses.co
-4webmasters.com
-5kstore.com
-adktrailmap.com
-adminshop.com
-adsland.men
-aimayangzhi.com
-alldubai.biz
-alot.com
-amt-k.ru
-apiadanaknet-a.akamaihd.net
-apidiamondatanet-a.akamaihd.net
-arcadeplayhouse.com
-ascat.porn
-asrv-a.akamoihd.net
-atelielembrancaqueencanta.com.br
-auspolice.com
-auto-zapchasti.org
-autorn.ru
-balans.shahterworld.org
-banki76.ru
-barnfurnituremart.com
-battle.net
-best-seo-offer.com
-bestfortraders.com
-bet-prognoz.com
-betune.onlinewebshop.net
-bfz.biz
-bird1.ru
-bpro1.top
-brendbutik.ru
-budilneg.xyz
-buqyxa.rincian.info
+00author.com
+03p.info
+4rent.ru
+5u.com
+aa08daf7e13b6345e09e92f771507fa5f4.com
+admanaerofoil.com
+adult3dgames.com
+alice.it
+alvtank.se
+anime.dougasouko.com
+appmsr.org
+arclk.net
+asrvvv-a.akamaihd.net
+asseenontv.ru
+atofilms.com
+availit.weebly.com
+avon-novosib.ru
+azbukafree.com
+babyfactory.fr
+best-coupon-offer.com
+bestcurs.org
+bio-market.kz
+blogqpot.com
+bmw-ark.ru
+bookmaker-bet.com
+boom-celebs.com
+bryansk.zrus.org
+bugof.gq
+bugshoot.cn
+burger-tycoon.com
+businesxxl.com
+buzzzg.men
+bvlgariwallet.xyz
 bycontext.com
-c-gainsbourg.com
-candy-glam-hp.com
-cheapmoncler.pw
-cherrypointplace.ca
-chinese-amezon.com
-christianlouboutinreplica.pw
-cialischsrx.com
-citetick.com
-citizenclsdriveri7.pen.io
-civilwartheater.com
-cleanallvirus.com
-compliance-julianna.top
-comsysnet.com
-contentlook.co
-continent-e.tv
-coolbar.pro
+cand.jp
+carapics.com
+cartierreplica.top
+cartiertrinity.xyz
+cheapsergiorossi.online
+choice-credit.ru
+cialischstgerts.com
+cialiswithoutadoctor.net
+club-musics.ru
+companies-catalog.com
+compliance-don.top
+compliance-jessica.top
+coolingoods.com
 copyrightclaims.org
-cottageofgrace.com
-deshevo-nedorogo.ru
-diusyawiga.tk
-divci-hry.info
-dividendo.ru
-djihispano.com
-dmmspy.com
-domashneeruporno.com
-doska-vsem.ru
-dvervmoskvu.ru
-ekn-art.se
-elektrozigarette2.webs.com
-empirepoker.com
-eredijovon.com
-erotik-kostenlos.net
-ezigarettenshop2.postbit.com
-fashion-mk.net
+czat.wp.pl
+d-black.bz
+dairyindia.in
+dayibiao.com
+dealighted.com
+detmebel.su
+dfwu1019.info
+dignitasdata.se
+discountbarbour.online
+dodlive.mil
+dogoimage.com
+dokumentalkino.net
+dosugrostov.site
+downloaddy.net
+eduserver.net
+energydiet24.ru
+extener.org
+extrabot.com
+fearcrow.com
 fickluder69.com
-fidelityfunding.com
-finstroy.net
-fitfloponline.store
-fodelsedagspresenter.nu
-forpostlock.ru
-forums.toucharcade.com
-foxtechfpv.com
-frameimage.org
-free-traffic.xyz
-freefoto.ca
-freejabs.com
-freelotto.com
-funnypica.com
-galeria-zdjec.com
-gay-file.com
-gnuetella.com
-goldpanningtools.com
-goodwriterssales.com
-goroda-vsego-mira.ru
-graphid.com
-greendream.com.ua
-gsasearchenginerankerdiscount.com
-hesteel.pl
-hidemyass.com
-hoporno.com
-hosting-tracker.com
-howmuchdoestizanidinecost.blogspot.com
-hunthillfarmtrust.org
-ibb.com.ua
-interfucks.net
-intermesh.net
-itrevolution.cf
-jongose.ninja
-kanimage.com
-keenoutlet.online
-kino-rf.ru
-kinobest.pl
-kinoplen.ru
-kutikomi.net
-lapitec.eu
-lasvegaslockandsafe.com
-laxdrills.com
-lerporn.info
-lexiangwan.com
-lidoradio.com
-lietaer.com
-lirunet.ru
-lisque.batcave.net
-locksmith.jp
-louboutinreplica.pw
-louboutinshoes.xyz
-maju.bluesalt.co
-mantramusic.ru
+findacheaplawyers.com
+flprog.com
+freevpn.space
+gcup.ru
+gdebestkupit.ru
+getmyads24.com
+given2.com
+gkvector.ru
+go2album.com
+gojiberriess.apishops.ru
+greamimgo.pw
+hazardky.net
+hermesreplica.win
+hkladys.com
+hoholikik.club
+houtings.xyz
+hunterboots.online
+idc.com.ua
+iklysha.ml
+imagefinder.site
+intellektmedia.at
+intimshop-fantasy.ru
+iradiology.ru
+irkutsk.zrus.org
+jewelryandfiligree.com
+job.icivil.ir
+ketoanhanoi.info
+keywordsdoctor.com
+kicknights.gq
+komputers-best.ru
+kopihijau.info
+kovrenok.ru
+kredit-pod-zalog-krasnodar.ru
+ktotut.net
+letmacworkfaster.world
+lida-ru.com
+linkrr.com
+lionking-1994.blogspot.com
+losangeles-ads.com
+lotto6888.com
+low-format.ru
+makis.nu
+mansparskats.com
+mapquestz.us
 maranbrinfo.com.br
-mecash.ru
-medi-fitt.hu
-minneapoliscopiers.com
-mir-limuzinov.ru
-mirobuvi.com.ua
-mixtapetorrent.com
-mncrftpcs.com
-modnie-futbolki.net
-monclerjacketsoutlet.win
-moncleroutletonline.xyz
-monetizer.com-01.site
+mastershef.club
+matchpal-a.akamaihd.net
+maximpartnerspr.com
+meendo-free-traffic.ga
+megakino.net
+merryhouse.co.uk
+michaelkorssaleoutletonline.net
+minecraft-neo.ru
+mmoguider.ru
+moncleroutletonline.pw
+mrbojikobi4.biz
+msk-diplomat.com
 mvpicton.co.uk
-my-aladin.com
-mydownloadengine.com
-myftpupload.com
-mylesosibirsk.ru
-mysex21.com
-negral.pluto.ro
-news-readers.ru
-nikkiewart.ru
-nina.az
-njkmznnb.ru
-noclegonline.info
-ok-ua.info
-ok.ru
-olvanto.ru
-onlineslotmaschine.com
-onthemarch.co
-orhonit.com
-parajumpersoutlet.online
-partnersafe.men
-pc-services.ru
-pestomou.info
-piulatte.cz
-porno-raskazy.ru
-pornobrazzers.biz
-pornohd1080.online
-portside.xyz
-priscilarodrigues.com.br
-prizefestival.mobi
-produkto.net
-promgirldresses.xyz
-prospekt-st.ru
-quickbuck.com
+mycaf.it
+nbsproject.ru
+negociosdasha.com
+netcheckcdn.xyz
+netoil.no
+nevansk.ru
+nootrino.com
+nrjmobile.fr
+o00.in
+online-hit.info
+online-zaymy.ru
+oren-cats.ru
+ourville.info
+ownshop.win
+ozas.net
+pertlocogasilk.tk
+petedrummond.com
+pipki.r.acdnpro.com
+piski.top
+piter.xrus.org
+pixgood.com
+playboyfiles.xblog.in
+pontiacsolstice.info
+pony-business.com
+proprostatit.com
+prostitutki-almata.org
+pulseonclick.com
 razleton.com
-reelheroes.net
-remontbiz.ru
-rewardpoll.com
-rutor.group
-sbt-aqua.ru
-seansonline24.pl
-sexad.net
-sexyebonyteen.com
-shitmovs.com
-siha.de
-sildenafilcitratemed.com
-sluganarodu.ru
-sodexo.com
-spin2016.cf
-spravka130.ru
-spywarenuker.com
-srecorder.com
-srgwebmail.nl
-ssconstruction.co
-streha-metalko.si
-strfls.com
-sugarlyflex.pw
-svbur.ru
-tam-gde-more.ru
-tandvardshuset.net
-templates.radiodigital.co
-theallgirlarcade.com
-thebluenoodle.com
+reeyanaturopathy.com
+referencemoi.com
+rep-am.com
+rn-to-bsn.com
+robertefuller.com
+royal-investments.net
+sadaholding.com
+sale-japan.com
+samo-soznanie.ru
+savefrom.com
+sbdl.no
+sdelatmebel.ru
+seo-smm.kz
+seozoom.it
+sexkontakte-seite.com
+sexobzor.info
+sexytrend.ru
+shlyahten.ru
+shopfishing.com.ua
+simple-image.com.ua
+sisi-go.ru
+site-analyzer.com
+skachat-besplatno-obrazcy.ru
+sky-mine.ru
+slutloadlive.com
+smstraf.ru
+snip.to
+songoo.wz.cz
+stop-zavisimost.com
+strigkaomsk.ru
+swinginwithme.ru
+taranerymagesswa.blogspot.com
+taraz.xkaz.org
+tattooreligion.ru
+taximytishi.ru
+td-l-market.ru
+tecnoteakviareggio.it
+tedxrj.com
 theguardlan.com
-tizanidinenarcotic.blogspot.com
-tizanidinesleepaid.blogspot.com
-tizanidinevscyclobenzaprine.blogspot.com
-tn811.us
-todohr.com
-tongkatmadura.info
-topquality.cf
-turn-up-life.life
-unrealcommander.com
-url-img.link
-usacasino.com
-ustion.ru
-uzporno.mobi
-validdomain.xyz
-veopornogratis.xxx
-versaut.xxx-cam.webcam
-via-energy-acquistare.com
+timer4web.com
+timhost.ru
+tizanidineshowupondrugtest.blogspot.com
+tomck.com
+toonfamilies.net
+topclickguru.com
+torrents.life
+traffique.net
+trustl.life
+tryrating.com
+turbabitload.weebly.com
+twiclub.in
+tzritel.tk
+utrolive.ru
 videochat.tv.br
-videogamesecrets.com
-vip-file.com
-vip2ch.com
+videokrik.net
+vigrx-original.ru
 visitcambridge.org
-viveresaniesnelli.it
-vk-mus.ru
-webstatsdomain.org
-weburlopener.com
-weekes.biz.tc
-weprik.ru
-wildcattube.com
-withstandingheartwarming.com
-wormix-cheats.ru
-xfluro.com
-xkaz.org
-xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
-xn----7sbho2agebbhlivy.xn--p1ai
-xn--lifehacer-1rb.com
-xnxx699.com
-xsion.net
-xtremeeagles.net
-yougetsignal.com
-youraticles.pl
-zaim-pod-zalog-krasnodar.ru
-zaimhelp.ru
-zero1.it
-zigarettenonlinekaufen1.blox.pl
-znaniyapolza.ru
-zoogdiesney.com
-zvuker.net
+vita.com.hr
+vkgaleria.com
+vonradio.com
+vostoktrade.info
+vozbujdenie.com
+vremya.eu
+vroze.com
+vseigry.fun
+vsesubwaysurfers.com
+vvon.co.uk
+web-betting.ru
+welcomeauto.ru
+wholesalejerseysgaa.com
+wikes.20fr.com
+wineitudes.wordpress.com
+worldtraveler.world
+woweb.com.ua
+x-diesel.com
+xblognetwork.com
+xdoza.com
+xerox-douglas.cf
+xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
+xtraffic.plus
+yaderenergy.ru
+yottos.com
+yougotanewdomain.com
+yourads.website
+yugo-star.ru
+yun56.co
+za-music.mymobiplanet.com
+zaobao.com.sg
+zeroredirect12.com
+zhongwenlink.com
+zixizop.net.ru
+zmoda.hostreo.com
+zojirushi-products.ru
+zootravel.com
+zs2vm.top
+zvetki.ru
--- a/dev-tools/test_units/ratelimittest-beta.txt
+++ b/dev-tools/test_units/ratelimittest-beta.txt
@ -581,4 +581,14 @@
 <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
 <p>This is merely used for testing !!!</p>
 </body>
+</html><!DOCTYPE html>
+<html>
+<head>
+<title>Welcome to NginX</title>
+</head>
+<body>
+<div align=center>
+<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
+<p>This is merely used for testing !!!</p>
+</body>
 </html>
--- a/dev-tools/test_units/whitelist-ips.conf
+++ b/dev-tools/test_units/whitelist-ips.conf
@ -1,2 +1,2 @@
-10.1.0.162	0;
+10.1.0.168	0;
 127.0.0.1	0;
--- a/dev-tools/tmp/robots.txt
+++ b/dev-tools/tmp/robots.txt
@ -6,9 +6,9 @@

 ### Version Information #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:39 UTC 2021
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:29 UTC 2021
+### Bad Bot Count: 623
 ###################################################
 ### Version Information ##

@ -1141,6 +1141,8 @@ User-agent: cah.io.community
 Disallow:/
 User-agent: check1.exe
 Disallow:/
+User-agent: clark-crawler
+Disallow:/
 User-agent: coccocbot-web
 Disallow:/
 User-agent: cognitiveseo
@ -1245,6 +1247,10 @@ User-agent: voyagerx.com
 Disallow:/
 User-agent: webmeup-crawler
 Disallow:/
+User-agent: webpros.com
+Disallow:/
+User-agent: webprosbot
+Disallow:/
 User-agent: x09Mozilla
 Disallow:/
 User-agent: x22Mozilla
--- a/robots.txt/robots.txt
+++ b/robots.txt/robots.txt
@ -6,9 +6,9 @@

 ### Version Information #
 ###################################################
-### Version: V4.2021.08.2523
-### Updated: Fri Aug 13 22:01:39 UTC 2021
-### Bad Bot Count: 620
+### Version: V4.2021.08.2524
+### Updated: Sat Aug 14 07:57:29 UTC 2021
+### Bad Bot Count: 623
 ###################################################
 ### Version Information ##

@ -1141,6 +1141,8 @@ User-agent: cah.io.community
 Disallow:/
 User-agent: check1.exe
 Disallow:/
+User-agent: clark-crawler
+Disallow:/
 User-agent: coccocbot-web
 Disallow:/
 User-agent: cognitiveseo
@ -1245,6 +1247,10 @@ User-agent: voyagerx.com
 Disallow:/
 User-agent: webmeup-crawler
 Disallow:/
+User-agent: webpros.com
+Disallow:/
+User-agent: webprosbot
+Disallow:/
 User-agent: x09Mozilla
 Disallow:/
 User-agent: x22Mozilla