vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2524 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-14 08:03:16 +00:00
parent 61157da9e6
commit 35e716ab11
61 changed files with 1228 additions and 1129 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2523 #### Version: V4.2021.08.2524
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

6
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2523 #### Version: V4.2021.08.2524
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

6
README.md
View file

@ -11,9 +11,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2523 #### Version: V4.2021.08.2524
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

3
_generator_lists/bad-referrers.list
View file

@ -1,5 +1,3 @@
placid-rounded-coast.glitch.me
mybackgroundlandscape.blogspot.com
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -4562,6 +4560,7 @@ pl-top.pl
pl-vouchers.com pl-vouchers.com
pl.aasoldes.fr pl.aasoldes.fr
pl.id-forex.com pl.id-forex.com
placid-rounded-coast.glitch.me
pladform.ru pladform.ru
plaff-go.ru plaff-go.ru
plastgran.com plastgran.com

6
_generator_lists/bad-user-agents.list
View file

@ -1,6 +1,3 @@
webprosbot
webpros.com
clark-crawler
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -564,6 +561,7 @@ autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler
coccocbot-web coccocbot-web
cognitiveseo cognitiveseo
com.plumanalytics com.plumanalytics
@ -616,6 +614,8 @@ trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe

6
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2523 #### Version: V4.2021.08.2524
#### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7080](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [620](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-03.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-05.txt
View file

File diff suppressed because one or more lines are too long

1
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -4560,6 +4560,7 @@ domain:pl-top.pl
domain:pl-vouchers.com domain:pl-vouchers.com
domain:pl.aasoldes.fr domain:pl.aasoldes.fr
domain:pl.id-forex.com domain:pl.id-forex.com
domain:placid-rounded-coast.glitch.me
domain:pladform.ru domain:pladform.ru
domain:plaff-go.ru domain:plaff-go.ru
domain:plastgran.com domain:plastgran.com

12
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

12
conf.d/globalblacklist-testing-version.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

12
conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

3
dev-tools/_robots_input/robots-input.txt
View file

@ -561,6 +561,7 @@ autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler
coccocbot-web coccocbot-web
cognitiveseo cognitiveseo
com.plumanalytics com.plumanalytics
@ -613,6 +614,8 @@ trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe

12
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -622,6 +622,7 @@
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;
"~*(?:\b)clark-crawler(?:\b|)" 0;
"~*(?:\b)coccocbot-web(?:\b|)" 0; "~*(?:\b)coccocbot-web(?:\b|)" 0;
"~*(?:\b)cognitiveseo(?:\b|)" 0; "~*(?:\b)cognitiveseo(?:\b|)" 0;
"~*(?:\b)com.plumanalytics(?:\b|)" 0; "~*(?:\b)com.plumanalytics(?:\b|)" 0;
@ -674,6 +675,8 @@
"~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0; "~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0;
"~*(?:\b)voyagerx.com(?:\b|)" 0; "~*(?:\b)voyagerx.com(?:\b|)" 0;
"~*(?:\b)webmeup-crawler(?:\b|)" 0; "~*(?:\b)webmeup-crawler(?:\b|)" 0;
"~*(?:\b)webpros.com(?:\b|)" 0;
"~*(?:\b)webprosbot(?:\b|)" 0;
"~*(?:\b)x09Mozilla(?:\b|)" 0; "~*(?:\b)x09Mozilla(?:\b|)" 0;
"~*(?:\b)x22Mozilla(?:\b|)" 0; "~*(?:\b)x22Mozilla(?:\b|)" 0;
"~*(?:\b)xpymep1.exe(?:\b|)" 0; "~*(?:\b)xpymep1.exe(?:\b|)" 0;

1
dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -4607,6 +4607,7 @@
"~*(?:\b)pl\-vouchers\.com(?:\b)" 0; "~*(?:\b)pl\-vouchers\.com(?:\b)" 0;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 0; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 0;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 0;
"~*(?:\b)pladform\.ru(?:\b)" 0; "~*(?:\b)pladform\.ru(?:\b)" 0;
"~*(?:\b)plaff\-go\.ru(?:\b)" 0; "~*(?:\b)plaff\-go\.ru(?:\b)" 0;
"~*(?:\b)plastgran\.com(?:\b)" 0; "~*(?:\b)plastgran\.com(?:\b)" 0;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2523 2524

12
dev-tools/globalblacklist-testing.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2523 ### Version: V3.2021.08.2524
### Updated: Fri Aug 13 22:01:38 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

12
dev-tools/globalblacklist.template
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

1
dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -4560,6 +4560,7 @@
"~*(?:\b)pl\-vouchers\.com(?:\b)" 0; "~*(?:\b)pl\-vouchers\.com(?:\b)" 0;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 0; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 0;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 0;
"~*(?:\b)pladform\.ru(?:\b)" 0; "~*(?:\b)pladform\.ru(?:\b)" 0;
"~*(?:\b)plaff\-go\.ru(?:\b)" 0; "~*(?:\b)plaff\-go\.ru(?:\b)" 0;
"~*(?:\b)plastgran\.com(?:\b)" 0; "~*(?:\b)plastgran\.com(?:\b)" 0;

1
dev-tools/referrers-regex-format.txt
View file

@ -4560,6 +4560,7 @@
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.159.43 0; 13.77.155.201 0;

12
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -622,6 +622,7 @@
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;
"~*(?:\b)clark-crawler(?:\b|)" 0;
"~*(?:\b)coccocbot-web(?:\b|)" 0; "~*(?:\b)coccocbot-web(?:\b|)" 0;
"~*(?:\b)cognitiveseo(?:\b|)" 0; "~*(?:\b)cognitiveseo(?:\b|)" 0;
"~*(?:\b)com.plumanalytics(?:\b|)" 0; "~*(?:\b)com.plumanalytics(?:\b|)" 0;
@ -674,6 +675,8 @@
"~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0; "~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0;
"~*(?:\b)voyagerx.com(?:\b|)" 0; "~*(?:\b)voyagerx.com(?:\b|)" 0;
"~*(?:\b)webmeup-crawler(?:\b|)" 0; "~*(?:\b)webmeup-crawler(?:\b|)" 0;
"~*(?:\b)webpros.com(?:\b|)" 0;
"~*(?:\b)webprosbot(?:\b|)" 0;
"~*(?:\b)x09Mozilla(?:\b|)" 0; "~*(?:\b)x09Mozilla(?:\b|)" 0;
"~*(?:\b)x22Mozilla(?:\b|)" 0; "~*(?:\b)x22Mozilla(?:\b|)" 0;
"~*(?:\b)xpymep1.exe(?:\b|)" 0; "~*(?:\b)xpymep1.exe(?:\b|)" 0;

1
dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -4607,6 +4607,7 @@
"~*(?:\b)pl\-vouchers\.com(?:\b)" 0; "~*(?:\b)pl\-vouchers\.com(?:\b)" 0;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 0; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 0;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 0;
"~*(?:\b)pladform\.ru(?:\b)" 0; "~*(?:\b)pladform\.ru(?:\b)" 0;
"~*(?:\b)plaff\-go\.ru(?:\b)" 0; "~*(?:\b)plaff\-go\.ru(?:\b)" 0;
"~*(?:\b)plastgran\.com(?:\b)" 0; "~*(?:\b)plastgran\.com(?:\b)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.159.43 0; 13.77.155.201 0;

12
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.159.43 0; 13.77.155.201 0;

12
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,10 +4,10 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:37 UTC 2021 ### Updated: Sat Aug 14 07:57:28 UTC 2021
### Bad Referrer Count: 7079 ### Bad Referrer Count: 7080
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -710,6 +710,7 @@ map $http_user_agent $bad_bot {
"~*(?:\b)backlink-check(?:\b)" 3; "~*(?:\b)backlink-check(?:\b)" 3;
"~*(?:\b)cah.io.community(?:\b)" 3; "~*(?:\b)cah.io.community(?:\b)" 3;
"~*(?:\b)check1.exe(?:\b)" 3; "~*(?:\b)check1.exe(?:\b)" 3;
"~*(?:\b)clark-crawler(?:\b)" 3;
"~*(?:\b)coccocbot-web(?:\b)" 3; "~*(?:\b)coccocbot-web(?:\b)" 3;
"~*(?:\b)cognitiveseo(?:\b)" 3; "~*(?:\b)cognitiveseo(?:\b)" 3;
"~*(?:\b)com.plumanalytics(?:\b)" 3; "~*(?:\b)com.plumanalytics(?:\b)" 3;
@ -762,6 +763,8 @@ map $http_user_agent $bad_bot {
"~*(?:\b)ubermetrics-technologies.com(?:\b)" 3; "~*(?:\b)ubermetrics-technologies.com(?:\b)" 3;
"~*(?:\b)voyagerx.com(?:\b)" 3; "~*(?:\b)voyagerx.com(?:\b)" 3;
"~*(?:\b)webmeup-crawler(?:\b)" 3; "~*(?:\b)webmeup-crawler(?:\b)" 3;
"~*(?:\b)webpros.com(?:\b)" 3;
"~*(?:\b)webprosbot(?:\b)" 3;
"~*(?:\b)x09Mozilla(?:\b)" 3; "~*(?:\b)x09Mozilla(?:\b)" 3;
"~*(?:\b)x22Mozilla(?:\b)" 3; "~*(?:\b)x22Mozilla(?:\b)" 3;
"~*(?:\b)xpymep1.exe(?:\b)" 3; "~*(?:\b)xpymep1.exe(?:\b)" 3;
@ -5609,6 +5612,7 @@ map $http_referer $bad_referer {
"~*(?:\b)pl\-vouchers\.com(?:\b)" 1; "~*(?:\b)pl\-vouchers\.com(?:\b)" 1;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 1;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 1; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 1;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 1;
"~*(?:\b)pladform\.ru(?:\b)" 1; "~*(?:\b)pladform\.ru(?:\b)" 1;
"~*(?:\b)plaff\-go\.ru(?:\b)" 1; "~*(?:\b)plaff\-go\.ru(?:\b)" 1;
"~*(?:\b)plastgran\.com(?:\b)" 1; "~*(?:\b)plastgran\.com(?:\b)" 1;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 1; 10.1.0.168 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -622,6 +622,7 @@
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;
"~*(?:\b)clark-crawler(?:\b|)" 0;
"~*(?:\b)coccocbot-web(?:\b|)" 0; "~*(?:\b)coccocbot-web(?:\b|)" 0;
"~*(?:\b)cognitiveseo(?:\b|)" 0; "~*(?:\b)cognitiveseo(?:\b|)" 0;
"~*(?:\b)com.plumanalytics(?:\b|)" 0; "~*(?:\b)com.plumanalytics(?:\b|)" 0;
@ -674,6 +675,8 @@
"~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0; "~*(?:\b)ubermetrics-technologies.com(?:\b|)" 0;
"~*(?:\b)voyagerx.com(?:\b|)" 0; "~*(?:\b)voyagerx.com(?:\b|)" 0;
"~*(?:\b)webmeup-crawler(?:\b|)" 0; "~*(?:\b)webmeup-crawler(?:\b|)" 0;
"~*(?:\b)webpros.com(?:\b|)" 0;
"~*(?:\b)webprosbot(?:\b|)" 0;
"~*(?:\b)x09Mozilla(?:\b|)" 0; "~*(?:\b)x09Mozilla(?:\b|)" 0;
"~*(?:\b)x22Mozilla(?:\b|)" 0; "~*(?:\b)x22Mozilla(?:\b|)" 0;
"~*(?:\b)xpymep1.exe(?:\b|)" 0; "~*(?:\b)xpymep1.exe(?:\b|)" 0;

1
dev-tools/test_units/custom-bad-referrers.conf
View file

@ -4607,6 +4607,7 @@
"~*(?:\b)pl\-vouchers\.com(?:\b)" 0; "~*(?:\b)pl\-vouchers\.com(?:\b)" 0;
"~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0; "~*(?:\b)pl\.aasoldes\.fr(?:\b)" 0;
"~*(?:\b)pl\.id\-forex\.com(?:\b)" 0; "~*(?:\b)pl\.id\-forex\.com(?:\b)" 0;
"~*(?:\b)placid\-rounded\-coast\.glitch\.me(?:\b)" 0;
"~*(?:\b)pladform\.ru(?:\b)" 0; "~*(?:\b)pladform\.ru(?:\b)" 0;
"~*(?:\b)plaff\-go\.ru(?:\b)" 0; "~*(?:\b)plaff\-go\.ru(?:\b)" 0;
"~*(?:\b)plastgran\.com(?:\b)" 0; "~*(?:\b)plastgran\.com(?:\b)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bolt Abonti
GermCrawler Bigfoot
Gigablast Boardreader
Mozlila LinqiaRSSBot
OutfoxBot Metauri
RocketCrawler Microsoft URL Control
TurnitinBot Pu_iN
Virusdie RankActiveLinkBot
ips-agent Voltron
magpie-crawler Web Fuck

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404enemy ADmantX
ALittle Client AIBOT
ASPSeek Aboundexbot
Aboundex Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
Alligator AiHitBot
AlphaBot Aipbot
Anthill Anarchy
Apexoo Apexoo
Attach
AwarioSmartBot
BBBike
BDCbot BDCbot
BDFetch
BLEXBot BLEXBot
BackStreet BackWeb
BacklinkCrawler BetaBot
Bandit
Bitacle Bitacle
BlackWidow
Blackboard
BlowFish
Bolt Bolt
BotALot BotALot
Brandprotect Brandprotect
BuiltBotTough Brandwatch
Buddy
BuiltWith BuiltWith
BuzzSumo Bullseye
BunnySlippers
CATExplorador CATExplorador
CCBot
CODE87 CODE87
CazoodleBot Cegbfeieh
CensysInspect
CheTeam
CheeseBot
CherryPicker CherryPicker
ChinaClaw Cocolyzebot
Cloud mapping Cogentbot
CopyRightCheck Copier
Copyscape Cosmos
CrazyWebCrawler Curious
Crescent Custo
CrunchBot
CyotekWebCopy
DBLBot DBLBot
DTS Agent DTS Agent
DatabaseDriverMysqli Deusu
Disco
Discobot
Discoverybot
DittoSpyder DittoSpyder
DnyzBot DomCopBot
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot Dotbot
Domains Project
Download Wonder Download Wonder
EMail Siphon ECCP/1.0
EMail Wolf
EasyDL
Ecxi
EirGrabber EirGrabber
Evil
Exabot Exabot
Extractor ExtractorPro
EyeNetIE EyeNetIE
FDM Fimap
FHscan
FlashGet
Flunky Flunky
Freeuploader
FyberSpider
Fyrebot Fyrebot
GalaxyBot GermCrawler
GetRight
Gigabot Gigabot
Go-Ahead-Got-It Go!Zilla
GoZilla GoZilla
Grafula Gotit
GrabNet
GrapeFX GrapeFX
HMView GrapeshotCrawler
HaosouSpider HTMLparser
Havij HTTrack
Haansoft
Harvest
Heritrix Heritrix
Hloader
Humanlinks
HybridBot
IDBot IDBot
IRLbot IRLbot
Id-search
IlseBot IlseBot
Image Fetch
InfoTekies InfoTekies
Internet Ninja InterGET
InternetSeer Iskanie
Iria JetCar
JamesBOT Jetty
Jbrofuzz
JennyBot
JikeSpider JikeSpider
Joomla
JustView JustView
Jyxobot
Kenjin Spider Kenjin Spider
Larbin Kozmosbot
LNSpiderguy
LWP::Simple
LeechGet
LexiBot
Lftp Lftp
LibWeb LibWeb
Libwhisker LinkWalker
LieBaoFast
Lightspeedsystems
Linkbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot LinkpadBot
LinqiaRSSBot LinksManager
MFC_Tear_Sample Ltx71
MIIxpc MQQBrowser
MSFrontPage MSFrontPage
MTRobot MTRobot
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic-SEO MarkMonitor
Majestic12 MarkWatch
Mass Downloader
Masscan
MauiBot MauiBot
Mb2345Browser Mb2345Browser
Meanpathbot MeanPath Bot
MegaIndex.ru
Metauri Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mister PiX
Mojolicious Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Msrabot
NPbot NICErsPRO
Name Intelligence
Nameprotect
Needle Needle
Nessus Nessus
Net Vampire
NetAnts NetAnts
NetMechanic
NetSpider NetSpider
Netcraft Nettrack
Netvibes Netvibes
Niki-bot Nibbler
Nikto
NimbleCrawler
Ninja Ninja
Nuclei
Nutch Nutch
Offline Explorer Octopus
Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS OpenVAS
OutclicksBot Openfind
PageAnalyzer OrangeBot
PageGrabber PageScorer
PageThing.com
Panscient Panscient
Papa Foto Papa Foto
Pi-Monster PeoplePal
Pimonster Petalbot
Psbot Picscout
PxBroker PictureFinder
RankActive Pixray
RankingBot2 Pockey
ProPowerBot
Probethenet
PyCurl
RankFlex
RankingBot
Rankivabot
RankurBot
Re-re Re-re
Reaper RealDownload
RebelMouse Recorder
RedesScrapy RedesScrapy
RepoMonkey RepoMonkey
RocketCrawler Rogerbot
SEOkicks-Robot SBIder
SEOlyticsCrawler ScanAlert
SEOstats
ScoutJet
Scrapy
Screaming
ScreenerBot ScreenerBot
Semrush ScrepyBot
Searchestate
SentiBot SentiBot
SeoSiteCheckup SeoSiteCheckup
Shodan
Siphon
SiteCheckerBotCrawler
SiteSnagger SiteSnagger
Sitevigil
SlySearch SlySearch
Snake
SocialRankIOBot SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider SputnikBot
Sqlmap
Sqworm Sqworm
Stripper
Sucuri Sucuri
SuperBot SuperHTTP
Surfbot
SurveyBot SurveyBot
T8Abot Suzuran
Teleport T0PHackTeam
TeleportPro TeleportPro
Telesoft
Telesphoreo Telesphoreo
TheNomad
Thumbor Thumbor
TightTwatBot
Titan
Toweyabot
Trendiction
True_Robot True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
UnisterBot
V-BOT V-BOT
VB Project
Vacuum
Vagabondo Vagabondo
VelenPublicWebCrawler
VidibleScraper VidibleScraper
Virusdie WBSearchBot
WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WPScan WWW::Mechanize
WWW-Collector-E WWWOFFLE
WallpapersHD Wallpapers
WeSEE Wallpapers/3.0
Web Enhancer Web Collage
Web Fetch Web Fuck
Web Sauger Web Pix
Web Sucker Web Sucker
WebBandit
WebEnhancer WebEnhancer
WebFetch WebFetch
WebFuck WebFuck
WebGo IS WebSauger
WebImageCollector
WebPix
WebReaper
WebSucker WebSucker
WebWhacker Webalta
WebZIP WebmasterWorldForumBot
Webshag Website Quester
WebsiteQuester Whatweb
Webster WinHTTrack
Whack WiseGuys Robot
Whacker
Woobot Woobot
Xaldon_WebSpider Wotbox
Xaldon WebSpider
Xenu
YoudaoBot YoudaoBot
ZoominfoBot Zade
archive.org_bot Zauba
arquivo-web-crawler Zermelo
arquivo.pt Zeus
cah.io.community ZmEu
ZyBorg
clark-crawler
coccocbot-web coccocbot-web
crawl.sogou.com com.plumanalytics
gopher crawler.feedback
domainsproject.org
heritrix
instabid
ips-agent ips-agent
isitwp.com
lwp-trivial
magpie-crawler magpie-crawler
netEstate NE Crawler muhstik-scan
oBot
pcBrowser
polaris version polaris version
probe-image-size
s1z.ru s1z.ru
scalaj-http seobility
seoscanners
sitechecker.pro sitechecker.pro
sogouspider sogouspider
sp_auditbot
spyfu spyfu
sysscan
trendiction.com trendiction.com
trendiction.de trendiction.de
x09Mozilla webprosbot
x22Mozilla x22Mozilla
xpymep1.exe
zgrab zgrab

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
404enemy 360Spider
80legs
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
AiHitBot AiHitBot
Aipbot
AlphaBot
Anarchie Anarchie
Apexoo Ankit
Anthill
Aspiegel Aspiegel
Asterias Attach
AwarioRssBot BackWeb
BBBike BacklinkCrawler
BDCbot
BLEXBot
BackDoorBot
Badass Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole Black Hole
Blackboard Blackboard
Blow Blow
Boardreader
Bolt
BotALot BotALot
Brandprotect
Brandwatch
Buck Buck
Buddy
BuiltBotTough BuiltBotTough
BuiltWith BuiltWith
CATExplorador Bullseye
BunnySlippers
BuzzSumo
CCBot CCBot
CODE87 CODE87
Calculon CSHttp
CazoodleBot CheeseBot
CheTeam Chlooe
CherryPicker Crescent
ChinaClaw
Copyscape
Cosmos
Craftbot
Curious
DBLBot DBLBot
DIIbot DIIbot
DTS Agent DTS Agent
DataCha0s
Demon Demon
Devil Discobot
DigitalPebble
Discoverybot Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnyzBot
DomCopBot DomCopBot
DomainSigmaCrawler DomainCrawler
Dotbot DomainStatsBot
Download Wonder Download Wonder
Drip EasyDL
EMail Wolf
Ecxi Ecxi
EirGrabber Evil
EroCrawler Extractor
Exabot FHscan
ExtLinksBot FemtosearchBot
FDM
Fimap Fimap
Firefox/7.0
Flunky
Foobot
Freeuploader Freeuploader
FrontPage
GT::WWW GT::WWW
GermCrawler Genieo
GetRight
Gigablast Gigablast
Gigabot Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
Grabber GoZilla
GrapeFX GrabNet
GridBot GridBot
Havij HEADMasterSEO
HTMLparser
Harvest
Heritrix
Hloader Hloader
Humanlinks Humanlinks
HybridBot
IDBot IDBot
IlseBot Iblog
Image Sucker Image Fetch
IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies
Intelliseek
InterGET InterGET
InternetSeer Internet Ninja
IstellaBot
JOC Web Spider
JetCar
Jetty
JikeSpider JikeSpider
LWP::Simple Joomla
Jorgee
Kozmosbot
Lanshanbot Lanshanbot
LeechFTP
LeechGet LeechGet
LexiBot Libwhisker
LinkWalker LinkScan
Linkbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
Ltx71 Lipperhey
MFC_Tear_Sample Litemage_walker
MIDown tool Lmspider
MJ12bot MJ12bot
MQQBrowser MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic SEO Majestic SEO
Majestic-SEO MarkMonitor
MarkWatch MarkWatch
Mediatoolkitbot Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Msrabot
NICErsPRO NICErsPRO
NPbot
Navroad Navroad
Needle NearSite
Net Vampire Netcraft
NetSpider NextGenSearchBot
Nettrack
Netvibes
Nikto Nikto
Nutch Nimbostratus
Octopus
Offline Explorer Offline Explorer
Openfind OnCrawl
OrangeSpider OpenLinkProfiler
OpenVAS
Openvas
OutfoxBot OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto Papa Foto
Petalbot Pi-Monster
Picscout Picscout
Picsearch Piepmatz
Pimonster ProPowerBot
Probethenet ProWebWalker
Psbot Pu_iN
Pump Pump
PxBroker
QueryN Metasearch QueryN Metasearch
RSSingBot Quick-Crawler
RankActiveLinkBot RankActive
RankFlex RankurBot
ReGet Reaper
Recorder
RedesScrapy
Ripper Ripper
RocketCrawler
Rogerbot
SBIder SBIder
SEOlyticsCrawler SEOkicks
SEOprofiler
SEOstats
SMTBot SMTBot
ScanAlert SalesIntelligent
ScoutJet ScoutJet
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
ScrepyBot SeoSiteCheckup
SearchmetricsBot Shodan
SentiBot
Seomoz
Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider SiteSnagger
Siteimprove SiteSucker
Sitevigil Sitebeam
SlySearch SlySearch
Snapbot
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper
Sosospider Sosospider
Sottopop
SpaceBison
SpankBot
Spanner Spanner
Spbot
Spinn3r
SputnikBot SputnikBot
Sqlworm
Sqworm Sqworm
Stripper
Sucker Sucker
TeleportPro Suzuran
Telesphorep Szukacz
T0PHackTeam
Teleport
The Intraformant The Intraformant
TheNomad TightTwatBot
Titan Titan
Toata
Toweyabot Toweyabot
True_Robot Trendictionbot
UnisterBot Turnitin
Typhoeus
URLy Warning
URLy.Warning
Upflow
VCI VCI
Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VeriCiteCrawler
Virusdie Virusdie
Voil WBSearchBot
Voltron WISENutbot
WPScan
WWW-Collector-E WWW-Collector-E
WWWOFFLE WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0
WeSEE WeSEE
Web Auto Web Collage
Web Enhancer Web Fetch
Web Sauger Web Sauger
Web Sucker WebBandit
WebCopier WebEnhancer
WebFuck WebFetch
WebGo IS WebImageCollector
WebLeacher WebReaper
WebStripper
WebSucker
WebWhacker WebWhacker
WebZIP WebsiteExtractor
Webshag WebsiteQuester
Whack Whatweb
Who.is Bot Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wotbox Wotbox
Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu
YoudaoBot
Zade Zade
Zauba Zauba
Zermelo ZoominfoBot
Zeus ZyBorg
ZumBot arquivo.pt
autoemailspider com.plumanalytics
backlink-check evc-batch
cah.io.community instabid
check1.exe internetVista monitor
cognitiveseo lwp-request
crawler.feedback
facebookscraper
gopher
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
muhstik-scan mediawords
netEstate NE Crawler
oBot oBot
page scorer pcBrowser
s1z.ru
satoristudio.net
scalaj-http scalaj-http
serpstatbot
sexsearcher sexsearcher
sysscan tAkeOut
trendiction.de trendiction.com
voyagerx.com
webmeup-crawler webmeup-crawler
webprosbot
x09Mozilla
x22Mozilla x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
bannerspace.com 202ch.com
chatroulette.online beauty-b0x.pl
danschawbel.com e90post.com
fitnesspiks.com minneapoliscopiers.com
gosreg.amchs.ru mountainstream.ms
hauleddes.com polybuild.ru
headpress.ru sex-pr.net
imk.com.ua sexsaoy.com
moncleroutletonline.win store-rx.com
slowmacfaster.trade traffixer.com

914
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101raccoon.ru 000free.us
1flag.co.za 1-free-share-buttons.com
21h2o.com 1001watch.com.ua
24-ak.ru 1008.su
2rich4bitches.com 100dollars-seo.com
5ws.dating-app.ru 10bet.com
66cpwgln.space 23kw.ru
7wind.ru 4replicawatch.net
98oi.ru aasoldes.fr
9med.net abusora.com
aaronabel.com abwa.tk
accessoires-mode.in adbetclickin.pink
addblueoff.com.ua adf.ly
adimmix.com adimmix.com
admatic.com.tr adloads.net
adrunnr.com adservme.com
adsfresh.men adultfullhd.com
adtech.fr aero2.ru
adzpower.com affrh2015.com
agysya.ru afftrack001.com
air-edem.ru alarmobninsk.ru
alert.scansafe.net albumsuper.info
alfa9.com alldezservice.kz
alienwheel.es alveris.ru
alive-ua.com alyeskaresort.com
allboard.xobor.de ameblo.top
allfinweb.com amt-k.ru
allproblog.com amyfoxfitness.com
allwomen.info ananumous.ru
am-se.com andpolice.com
ample-awards-today.us animali.deagostinipassion.it
analytics-ads.xyz anmysite.com
android4fun.org anonymousfox.co
antons-transporte.de app5.letmacworkfaster.world
apiadanaknet-a.akamaihd.net apper.de
apidigidocketnet-a.akamaihd.net appleid-verification.com
apimountainbikei-a.akamaihd.net apps-analytics.net
asrv-a.akamaihd.net arcadepages.com
asscenihotosidea.blogspot.co.za arewater.com
atmovs.com arraty.altervista.org
atofilms.com asseenontv.ru
atovh.local-finders.com atovh.local-finders.com
auto.rusvile.lt avon-novosib.ru
autoblogger24.info awency.com
aviav.co
aviav.ru.com
aviva-limoux.com
avkzarabotok.info
avramstroy.ru
avtoarenda.by
avtolombard-krasnodar.ru
azbukafree.com azbukafree.com
azinoofficial777.ru bablonow.ru
b2b-lounge.com backlinkwatch.com
balook.com backuperwebcam.weebly.com
bank.uz badavit.com.ua
bannerconnect.net bala.getenjoyment.net
bannertesting.com baladur.ru
battleforupdating.site beachdriveblog.com
belsetirehafi.tk beclean-nn.ru
besthoro.ru best-seo-offer.com
betterhdporn.com bestkfiledxd.cf
bget.ru bestmobilityscooterstoday.com
bif-ru.info bestwaystogetpaid.us
bingoporno.com bestwebsiteawards.com
binomo.kz bet365.com
blagovest-med.ru beztuberkuleza.ru
blogs.rediff.com biketank.ga
blpmovies.com bimatoprost-careprost.com.ua
boc.kz bin-brokers.com
bodybuilding-shop.biz bloggedporn.com
bravegirlsclub.com bloke.com
brewdom.ru bonky.biz
bookmaker-bet.com
bookmark4you.com.biz
brainsandeggs.blogspot.com
brandedleadgeneration.com
brandimensions.com
break-the-chains.com
brimstonehillfortress.org brimstonehillfortress.org
bristolhostel.com briomotor.co
bugof.gq bristolhotel.com.ua
bumascloset.com brus.city
buigas.00it.com
bumskontakte.org
buqayy0.livejournal.com
bus-offer.com
buy-cheap-online.info buy-cheap-online.info
buy-cheap-pills-order-online.com buy-forum.ru
byme.se carfax.com.ua
cakemediahq.com.au cartierlovestore.xyz
candlehandmade.com cartierreplica.xyz
caveavins.fr cdn.walkme.com
cejewelry.xyz cfjump.com
cementaresearch.se chatroulette.si
cenoval.ru cheap-trusted-backlinks.com
cerev.info cheapmarmot.online
cheatcode-lita12.rhcloud.com cheapmoncler.xyz
chiptuninger.com christianlouboutinreplica.win
cicaki.net cialisndbrx.com
cleanmypc.com cialiswithoutadoctor.net
cleanpcnow.com cityadspix.com
compliance-andrew.xyz clash-clans.ru
constantaservice.net clayvasedesigns.tk
continent-e.tv clickaider.com
converse.ddsoldes.fr clknsee.com
clksite.com
clothesforcash.com
co.lumb.co
comissionka.net
compliance-john.top
comsysnet.com
concealthyself.com
contentsexpress.com
cookie-law-enforcement-hh.xyz cookie-law-enforcement-hh.xyz
copro.pw coolyarddecorations.com
coprofam.org
country-chic.ru country-chic.ru
cscwtalkto.site covetnica.com
cupday.com cranly.net
customcollegeessays.net crazyboost.pro
dailystrength.org credit-online.ws
damasarenai.info credit.co.ua
daneshetabiat.com crystalslot.com
data-mining.tk czeshop.info
datadepths.com darkbooks.org
date-withme.com daydream-studio.ru
dating-app.ru daymusam.com
de.zapmeta.com dbmkfhqk.bloger.index.hr
descargar-musica-gratis.net deda-moroza-zakaz.ru
design-ideas.info delitime.info
destinationrealestate.com destinationrealestate.com
dirtpics.pw diarioaconcagua.com
divatraffic.com digest-project.ru
djekxa.ru digitalassetmanagement.site
dnsrsearch.com dildofotzen.net
dodlive.mil dimaka.info
donvito.unas.cz dinkolove.ya.ru
download-wallpaper.net discountbarbour.online
dumpsmania24.com divisioncore.com
e-collantes.com docs4all.com
earthmagic.info documentbase.net
egovaleo.it domainsatcost.com
egvar.net domashneeruporno.com
electrik-avenue.com domini.cat
elvel.com.ua dostavimvdom.ru
en.altezza.travel download-walpaperhd.blogspot.com
engines-usa.com downloadeer.net
englate.com dvd-famille.com
eorogo.top eachdayisagift.review
eropornosex.ru easycommerce.cf
essayassist.com easync.io
estibot.com edge.sharethis.com
evehemming.blogspot.com.au efkt.jp
everflora.ru elektrozigarette2.webs.com
exchanges-bet.com englishdictionaryfree.com
extlinks.com erot.co
extremepornos.net erotikstories.ru
ertelecom.ru
esopini.com
etur.ru
euroskat.ru
ewebarticle.info
excitacao.com
eywords-monitoring-your-success.com eywords-monitoring-your-success.com
ezigarettekaufen2.blox.pl ezigarettenkaufen2.dreamwidth.org
ezigaretteshop.webs.com ezigaretteshop.webs.com
falcon-images.blogspot.com f00kclan.de
favornews.com f07.de
fetroshok.ru falopicm.pw
fettefrauen.net farmingworm.com
fickluder69.com fdzone.org
findpik.com fil.ru
fitfloponline.store filerockstar298.weebly.com
filmci.pro
findsexguide.com
fix-website-errors.com
flooringinstallation-edmonton.com
floridahuntingfishingadventures.com
fordsonmajbor.cf
forex-procto.ru
forex21.ru forex21.ru
forexgb.ru forexgb.ru
forodvd.com forodvd.com
forpackningsutveckling.se foto-telok.net
forum-engineering.ru free-fb-traffic.com
franklinfire.co free-social-buttons.xyz
freshdz.com freeuploader.ml
frustrated-favorable.gq fuel-gas.com
fx-brokers-review.com galaxy-family.ru
fz139.ttk.ru gamedayhouse.com
game-top.su gaypornmovie.net
gameplexcity.com gearcraft.us
gamesprite.me geilehausfrauen.net
gateway.zscalerone.net getmyads24.com
gavuer.ru gigablast.com
gay-site.store
get-free-traffic-now.com
getridofstretchmarks.org
ghostvisitor.com
gidonline.one
gigapeta.com
girlporn.ru
girlsatgames.ru
glicol.kz
globatur.ru
glopages.ru glopages.ru
goatse.ru gnuetella.com
gosmeb.ru go2album.com
gov.yanao.ru gobongo.info
guiadeserraazul.com golden-catalog.pro
hamacapty.com googglet.com
hanink.biz.ly gorabagrata.ru
hausfrauensex18.com goroda-vsego-mira.ru
hdimagegallery.net guod.me
hdwalls.xyz hacktougroup.ru
healbio.ru handicapbathtubarea.com
healing-dysplasia.ru handsandlegs.ru
health-medical-portal.info herehloadibs.cf
hermesbracelets.xyz
hifidesign.ru hifidesign.ru
hildinghr.se himazin.info
hmmm.cz histock.info
hoholikik.club home-task.com
host-protection.com hotblog.top
hostingclub.lk houdom.net
housemilan.ru hoverboardforsaledirect.com
hoztorg-opt.ru howtoclean.club
hplaserjetpdriver8y.pen.io hspline.com
hubbble.com huhn.altervista.org
husky-shop.cz
iamsport.org iamsport.org
idegenvezeto.eu ictizanidinehcl4mg.blogspot.com
iflycapetown.co.za ideawheel.com
ideibiznesa2015.ru
ifirestarter.ru
ihc2015.info ihc2015.info
iinstalll-fii1leis.jus0wil.pp.ua iklysha.ml
ikritikimou.gr ilte.info
imagerydatabase.com imgarit.pw
impresagaia.it integritylandscapeservices.com
incolors.club interferencer.ru
increasewwwtraffic.info internetartfair.com
inet-traffic.com investingclub.ru
infobanks.ru iptool.xyz
intellego.info istizanidineanarcoticdrug.blogspot.com
investsuccess.org itag.pw
iopeninghours.co.uk itservicesthatworkforyou.com
irkutsk.zrus.org james13prix.info
isitwp.com javatex.co.id
ispac.org javspace.net
istizanidinelikexanax.blogspot.com jbl-charge.info
itch.io jerseyschinabizwholesale.us
ivearchenceinflu.cf jurajskie.info
iwantmyfreecash.com jwcialislrt.com
jamiembrown.com kaidalibor.de
japfm.com kazan.zrus.org
joessmogtestonly.com kemerovo.zrus.org
jyrxd.com kenaba.su
kalandranis.gr kinogolos.ru
karpun-iris.ru kinozapas.com
karusel-market.ru kongruan.com
kfon.eu kountrylife.com
knowsitall.info krassh.ru
kochanelli.com ks1234.com
ktotut.net kvartir-remont.biz
kupit-adenu.ru kvartira-sutochno.com
laptoper.net laptop-4-less.com
lawyersinfo.org lashstudia.ru
lechenie-gemorroya.com laxob.com
ledis.top lion.bolegapakistan.com
lenvred.org littlecity.ch
lexaprogeneric.link llastbuy.ru
li-er.ru loadingpages.me
linkarena.com lotto6888.com
linksharingt.com m.b00kmarks.com
littlesunraiser.com m0r0zk0-krava.ru
livetsomudvekslingstudent.bloggersdelight.dk macfix.life
locatellicorretor.com.br macrotek.ru
longadventure.com magento-crew.net
lovi-moment.com.ua magicalfind-a.akamaihd.net
lunamedia.co magnetic-bracelets.ru
lunchrock.co mailemedicinals.com
m1media.net mamasuper.prom.ua
macresource.co.uk marblestyle.ru
maranbrinfo.com.br
marinetraffic.com marinetraffic.com
mazda-roadsters.com masthopehomes.com
megahdporno.net matchpal-a.akamaihd.net
meget.co.za mecash.ru
migente.com medanestesia.ru
militarysale.pro medictube.ru
mir-limuzinov.ru medkletki.ru
mirtorrent.net meduza-consult.ru
misswell.net megakino.net
misterjtbarbers.com mexicosleevegastrectomy.com
mitrasound.ru mir-betting.ru
mlvc4zzw.space mirmedinfo.ru
mobifunapp.weebly.com mirzonru.net
mole.pluto.ro moivestiy.biz
moneyviking-a.akamaihd.net mojowhois.com
moomi-daeri.com monetizationking.net
mosdverka.ru moneyteam24.com
mossmesi.com morf.snn.gr
msk.afora.ru mrcsa.com.au
muz-shoes.ru mrpornogratis.xxx
mrsdalloways.com
mttwtrack.com
mustat.com
mwtpludn.review
myblogregistercm.tk myblogregistercm.tk
mydeathspace.com namecrumilchlet.tk
myghillie.info naphukete.ru
myphotopipe.com naturtreenspicerx.pw
naj-filmy24.pl naval.jislaaik.com
nastydollars.com neobux-bg.info
needtosellmyhousefast.com net-profits.xyz
netvouz.com
new-post.tk
newstraveller.ru newstraveller.ru
newyorkhotelsmotels.info
nibbler.silktide.com
nicovideo.jp
nightvision746.weebly.com
njkmznnb.ru
noclegonline.info
nodding-passion.tk nodding-passion.tk
nofreezingmac.work norththeface.store
nootrino.com noumeda.com
nottyu.xyz novatech.vn
o-o-11-o-o.com o-o-11-o-o.com
obiavo.by
obiavo.kz
obuv-kupit.ru
oddamzadarmo.eu oddamzadarmo.eu
oivcvx.website omgtnc.com
okmedia.sk onlinefilmz.net
one-gear.com ooo-gotovie.ru
onlainbesplatno.ru openfrost.com
online-hit.info openlibrary.org
onlinemeetingnow.com osb.se11.ru
onlinewritingjobs17.blogspot.ru ostrovtaxi.ru
orsonet.ru
outpersonals.com outpersonals.com
outrageousdeal-a.akamaihd.net paclitor.com
ozoz.it palvira.com.ua
pacificair.com parfusale.se
paparazzistudios.com.au pc-services.ru
paradontozanet.ru perm-profnastil.ru
partner-high.men photo-clip.ru
partner-pop.men picsearch.com
pcads.ru piluli.info
pearlisland.ru pivka.xyz
penisvergrotendepillennl.ovh platesauto.com
photokitchendesign.com platinumdeals.gr
pintattoos.com playlott.com
pipki.r.acdnpro.com pochtovyi-index.ru
pixell.club podshipniki-ntn.ru
pk-pomosch.ru
pl-vouchers.com
pl.id-forex.com
pod-muzyku.club
pokemongooo.ml pokemongooo.ml
porno-home365.com popmarker.com
pornodojd.ru popugauka.ru
pornoklad.ru porngalleries.top
pornosmola.info porno.simple-image.com.ua
pornoxxx.com.mx pornoblood.com
pornpost.in powenlite24.ru
poshiv-chehol.ru powitania.pl
pozdrawleniya.ru
pr0fit-b0x.com
prchecker.info
predmety.in.ua
predominant-invent.tk predominant-invent.tk
privacylocationforloc.com printdirectforless.com
privatamateure.com priora-2.com
profitfx.online professionaldieselcare.com
profitwithalex.info
prointer.net.ua prointer.net.ua
prom23.ru prospekt-st.ru
prostitutki-belgoroda.org
prostitutki-kharkova.org
prostitutki-novgoroda.org prostitutki-novgoroda.org
prostitutki-odessa.org qor360.com
purplestats.com quelle.ru
quangcaons.com quickbuck.com
quick-offer.com qwarckoine.com
razamicroelectronics.com ranksonic.com
rapevideosmovies.com
real-time-analytics.com real-time-analytics.com
reckonstat.info realizmobi.com
redhotfreebies.co.uk rebuildermedical.com
referencemoi.com redirlock.com
registry-clean-up.net regionshop.biz
remorcicomerciale.ro registrationdomainsite.com
resant.ru reklama-i-rabota.ru
rewardpoll.com remont-fridge-tv.ru
ricorsogiustizia.org replica-watch.ru
roleforum.ru resellerclub.com
royalvegascasino.com responsinator.com
rrutw.com restaurantlescampi.com
rewardit.com
ringtonepartner.com
ruex.org.ua
runstocks.com
ruscoininvest.company
rutor.group
rybalka-opt.ru
sabaapress.com sabaapress.com
sabizonline.com sabizonline.com
salut-camp.ru saddiechoua.com
sammyweaver.com sanidumps.com
samo-soznanie.ru sardinie.us
sanatorrii.ru sarf3omlat.com
sbprabooks.com savetubevideo.com
scanner-jack.top scanner-elena.top
scanner-walter.top scenarii-1-sentyabrya.uroki.org.ua
screentoolkit.com search.xtconnect.com
secretscook.ru searchimpression.com
see-your-website-here.com searchkut.com
seeingmeerkat.com searchwebknow-a.akamaihd.net
seeresultshub-a.akamaihd.net seminarykansas904.ml
seinterface.com
seksotur.ru
semprofile.com
seo-tools-optimizing.com seo-tools-optimizing.com
seobility.net seofied.com
seozoom.it serptehnika.ru
servicecenter.co.ua sex-tracker.de
serw.clicksor.com sexs-foto.com
sex.hotblog.top sexstream.pl
sexkrasivo.net shop.xz618.com
sexsaoy.com simply.net
sexspornotub.com sinestesia.host.sk
ship-marvel.co.ua small-game.com
shoppingjequiti.com.br snow.nvr163.com
site3.free-share-buttons.com soaksoak.ru
sitevaluation.org social-s-hhh.xyz
skincrate.net social-vestnik.ru
skypasss.com
slim.sellany.ru
slomm.ru
slowmac.tech
smichovbike.cz
smokewithrabbits.com
smstraf.ru
soc-econom-problems.ru
socialbuttons.xyz
socialseet.ru socialseet.ru
softtor.com socialtrade.biz
soserfis.com sockshare.net
spywareit.com soda.media
srecorder.com softwaretrend.net
sotkal.lark.ru
spravka130.ru
sps-shop.com
ssconstruction.co ssconstruction.co
star61.de starpages.net
startufa.ru
starwars.wikia.com starwars.wikia.com
stauga.altervista.org staticfs.host
sticken.co steelmaster.lv
stopnarco.ru storehouse.ua
streetfire.net strag-invest.ru
strana-krasoty.ru
strana-solnca.ru
strongholdsb.ru strongholdsb.ru
studiokamyk.com.pl
sugarkun.com sugarkun.com
suggest-keywords.com suggest-keywords.com
suhanpacktech.com superfish.com
superstarfloraluk.com superlist.biz
survival.betteroffers.review surflinksmedical.com
svarkagid.com svarbit.com
svetodiodoff.ru syvertsen-da.no
tampabaywatch.org
tandvardshuset.net
tedy.su
teenporn18.net
telsis.com
templates.radiodigital.co
thaisamkok.com thaisamkok.com
the-usa-games.blogspot.com thaismartloan.com
thedownloadfromwarez.blogspot.com thedownloadfromwarez.blogspot.com
theprofitsmaker.net thefotosgratis.eu
thin.me.pn theheroes.ru
timdreby.com thelottosecrets.com
tizanidineusedfor.blogspot.com thetardistimes.ovh
tnaionline.org tizanidine4mgstreetvalue.blogspot.com
top10registrycleaners.com tizanidinefibromyalgia.blogspot.com
topbestgames.com tizanidinehcl2mgsideeffects.blogspot.com
torrent-newgames.com tizanidineingredients.blogspot.com
tourcroatia.co.uk tizanidineoral.blogspot.com
trahic.ru tongkatmadura.info
top-study.work
top10-way.com
trkdf.com
truck-rece.life truck-rece.life
twittrading.com twitlinks.com
u-cheats.ru twu.com.ua
uchetunet.su ukkala.xyz
udsgame.online ultimateclassicrock.com
ugguk.online unrealcommander.org
umg-stroy.ru uptimechecker.com
uni.me url-extractor.xyz
unimodemhalfduplefw.pen.io url-img.link
univerfiles.com uzungil.com
uptime-as.net varikozdok.ru
us-america.ru vbtracker.net
utiblog.fr viagraneggrx.com
v24s.net viddyoze.com
vclicks.net vintontech.info
verymes.xyz vip-dom.in
vesnatehno.com vip2ch.com
videochat.ph vkak.ru
videospornogratisx.net vsexkontakte.net
vietimgy.pw vtcdns.com
vikistars.com vuclip.com
vip-parfumeria.ru vzlomfb.com
vitalads.net wahicbefa31.soup.io
vitoriacabos.com waterefficiency.co
vltai.com website-analyzer.info
vodkoved.ru whipme.yopoint.in
vvon.co.uk wholesalejerseys-cheapest.com
wallpapers-best.com whos.amung.us
webenlace.com.ar williamrobsonproperty.com
webpromotion.ae womensplay.net
webs.com wowas31.ucoz.ru
webshoppermac.com xcc24.pl
webtherapy.ru xep.info
weddingdresses.xyz xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
whatistizanidinehclusedfor.blogspot.com xn----7sbho2agebbhlivy.xn--p1ai
whatsappdownload10.com xn--c1acygb.xn--p1ai
whereverdesperate.gq xn--h1ahbi.com.ua
wikes.20fr.com xn--hxazdsfy.blogspot.com
wineration.com xsion.net
woman-tampon.ru xtremeeagles.net
woweb.com.ua xtube.com
wrz0iuebwhp5fg.freeddns.com yoshkarola.zrus.org
wurr.voila.net youbloodyripper.com
x-true.info youdesigner.kz
xn--24-glceagatoq7c2a6ioc.xn--p1ai youporn-forum.ga
xn--b1ag5cfn.xn--p1ai yourserverisdown.com
xtraffic.plus yugk.net
xvideospornoru.com zarabiaj-dzis.pl
xxx-treker.ru zastroyka.org
yachts-cruise.info zatjmuzu.info
yellocloud.be zeroredirect7.com
yes-com.com zigzog.ru
yunque.pluto.ro znaniyapolza.ru
yurgorod.ru
zaidia.xhost.ro
zeroredirect.com
zeroredirect5.com
zojirushi-products.ru zojirushi-products.ru
zoogdisany.com zoodrawings.com
zooggames.com zoominfo.com
zrizvtrnpale.tk zrizvtrnpale.tk
zskdla.site zs2vm.top
zvuker.net

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
007angels.com 00author.com
00it.com 03p.info
123kuma.com 4rent.ru
18ps.ru 5u.com
2daytrendingnews.com aa08daf7e13b6345e09e92f771507fa5f4.com
4senses.co admanaerofoil.com
4webmasters.com adult3dgames.com
5kstore.com alice.it
adktrailmap.com alvtank.se
adminshop.com anime.dougasouko.com
adsland.men appmsr.org
aimayangzhi.com arclk.net
alldubai.biz asrvvv-a.akamaihd.net
alot.com asseenontv.ru
amt-k.ru atofilms.com
apiadanaknet-a.akamaihd.net availit.weebly.com
apidiamondatanet-a.akamaihd.net avon-novosib.ru
arcadeplayhouse.com azbukafree.com
ascat.porn babyfactory.fr
asrv-a.akamoihd.net best-coupon-offer.com
atelielembrancaqueencanta.com.br bestcurs.org
auspolice.com bio-market.kz
auto-zapchasti.org blogqpot.com
autorn.ru bmw-ark.ru
balans.shahterworld.org bookmaker-bet.com
banki76.ru boom-celebs.com
barnfurnituremart.com bryansk.zrus.org
battle.net bugof.gq
best-seo-offer.com bugshoot.cn
bestfortraders.com burger-tycoon.com
bet-prognoz.com businesxxl.com
betune.onlinewebshop.net buzzzg.men
bfz.biz bvlgariwallet.xyz
bird1.ru
bpro1.top
brendbutik.ru
budilneg.xyz
buqyxa.rincian.info
bycontext.com bycontext.com
c-gainsbourg.com cand.jp
candy-glam-hp.com carapics.com
cheapmoncler.pw cartierreplica.top
cherrypointplace.ca cartiertrinity.xyz
chinese-amezon.com cheapsergiorossi.online
christianlouboutinreplica.pw choice-credit.ru
cialischsrx.com cialischstgerts.com
citetick.com cialiswithoutadoctor.net
citizenclsdriveri7.pen.io club-musics.ru
civilwartheater.com companies-catalog.com
cleanallvirus.com compliance-don.top
compliance-julianna.top compliance-jessica.top
comsysnet.com coolingoods.com
contentlook.co
continent-e.tv
coolbar.pro
copyrightclaims.org copyrightclaims.org
cottageofgrace.com czat.wp.pl
deshevo-nedorogo.ru d-black.bz
diusyawiga.tk dairyindia.in
divci-hry.info dayibiao.com
dividendo.ru dealighted.com
djihispano.com detmebel.su
dmmspy.com dfwu1019.info
domashneeruporno.com dignitasdata.se
doska-vsem.ru discountbarbour.online
dvervmoskvu.ru dodlive.mil
ekn-art.se dogoimage.com
elektrozigarette2.webs.com dokumentalkino.net
empirepoker.com dosugrostov.site
eredijovon.com downloaddy.net
erotik-kostenlos.net eduserver.net
ezigarettenshop2.postbit.com energydiet24.ru
fashion-mk.net extener.org
extrabot.com
fearcrow.com
fickluder69.com fickluder69.com
fidelityfunding.com findacheaplawyers.com
finstroy.net flprog.com
fitfloponline.store freevpn.space
fodelsedagspresenter.nu gcup.ru
forpostlock.ru gdebestkupit.ru
forums.toucharcade.com getmyads24.com
foxtechfpv.com given2.com
frameimage.org gkvector.ru
free-traffic.xyz go2album.com
freefoto.ca gojiberriess.apishops.ru
freejabs.com greamimgo.pw
freelotto.com hazardky.net
funnypica.com hermesreplica.win
galeria-zdjec.com hkladys.com
gay-file.com hoholikik.club
gnuetella.com houtings.xyz
goldpanningtools.com hunterboots.online
goodwriterssales.com idc.com.ua
goroda-vsego-mira.ru iklysha.ml
graphid.com imagefinder.site
greendream.com.ua intellektmedia.at
gsasearchenginerankerdiscount.com intimshop-fantasy.ru
hesteel.pl iradiology.ru
hidemyass.com irkutsk.zrus.org
hoporno.com jewelryandfiligree.com
hosting-tracker.com job.icivil.ir
howmuchdoestizanidinecost.blogspot.com ketoanhanoi.info
hunthillfarmtrust.org keywordsdoctor.com
ibb.com.ua kicknights.gq
interfucks.net komputers-best.ru
intermesh.net kopihijau.info
itrevolution.cf kovrenok.ru
jongose.ninja kredit-pod-zalog-krasnodar.ru
kanimage.com ktotut.net
keenoutlet.online letmacworkfaster.world
kino-rf.ru lida-ru.com
kinobest.pl linkrr.com
kinoplen.ru lionking-1994.blogspot.com
kutikomi.net losangeles-ads.com
lapitec.eu lotto6888.com
lasvegaslockandsafe.com low-format.ru
laxdrills.com makis.nu
lerporn.info mansparskats.com
lexiangwan.com mapquestz.us
lidoradio.com
lietaer.com
lirunet.ru
lisque.batcave.net
locksmith.jp
louboutinreplica.pw
louboutinshoes.xyz
maju.bluesalt.co
mantramusic.ru
maranbrinfo.com.br maranbrinfo.com.br
mecash.ru mastershef.club
medi-fitt.hu matchpal-a.akamaihd.net
minneapoliscopiers.com maximpartnerspr.com
mir-limuzinov.ru meendo-free-traffic.ga
mirobuvi.com.ua megakino.net
mixtapetorrent.com merryhouse.co.uk
mncrftpcs.com michaelkorssaleoutletonline.net
modnie-futbolki.net minecraft-neo.ru
monclerjacketsoutlet.win mmoguider.ru
moncleroutletonline.xyz moncleroutletonline.pw
monetizer.com-01.site mrbojikobi4.biz
msk-diplomat.com
mvpicton.co.uk mvpicton.co.uk
my-aladin.com mycaf.it
mydownloadengine.com nbsproject.ru
myftpupload.com negociosdasha.com
mylesosibirsk.ru netcheckcdn.xyz
mysex21.com netoil.no
negral.pluto.ro nevansk.ru
news-readers.ru nootrino.com
nikkiewart.ru nrjmobile.fr
nina.az o00.in
njkmznnb.ru online-hit.info
noclegonline.info online-zaymy.ru
ok-ua.info oren-cats.ru
ok.ru ourville.info
olvanto.ru ownshop.win
onlineslotmaschine.com ozas.net
onthemarch.co pertlocogasilk.tk
orhonit.com petedrummond.com
parajumpersoutlet.online pipki.r.acdnpro.com
partnersafe.men piski.top
pc-services.ru piter.xrus.org
pestomou.info pixgood.com
piulatte.cz playboyfiles.xblog.in
porno-raskazy.ru pontiacsolstice.info
pornobrazzers.biz pony-business.com
pornohd1080.online proprostatit.com
portside.xyz prostitutki-almata.org
priscilarodrigues.com.br pulseonclick.com
prizefestival.mobi
produkto.net
promgirldresses.xyz
prospekt-st.ru
quickbuck.com
razleton.com razleton.com
reelheroes.net reeyanaturopathy.com
remontbiz.ru referencemoi.com
rewardpoll.com rep-am.com
rutor.group rn-to-bsn.com
sbt-aqua.ru robertefuller.com
seansonline24.pl royal-investments.net
sexad.net sadaholding.com
sexyebonyteen.com sale-japan.com
shitmovs.com samo-soznanie.ru
siha.de savefrom.com
sildenafilcitratemed.com sbdl.no
sluganarodu.ru sdelatmebel.ru
sodexo.com seo-smm.kz
spin2016.cf seozoom.it
spravka130.ru sexkontakte-seite.com
spywarenuker.com sexobzor.info
srecorder.com sexytrend.ru
srgwebmail.nl shlyahten.ru
ssconstruction.co shopfishing.com.ua
streha-metalko.si simple-image.com.ua
strfls.com sisi-go.ru
sugarlyflex.pw site-analyzer.com
svbur.ru skachat-besplatno-obrazcy.ru
tam-gde-more.ru sky-mine.ru
tandvardshuset.net slutloadlive.com
templates.radiodigital.co smstraf.ru
theallgirlarcade.com snip.to
thebluenoodle.com songoo.wz.cz
stop-zavisimost.com
strigkaomsk.ru
swinginwithme.ru
taranerymagesswa.blogspot.com
taraz.xkaz.org
tattooreligion.ru
taximytishi.ru
td-l-market.ru
tecnoteakviareggio.it
tedxrj.com
theguardlan.com theguardlan.com
tizanidinenarcotic.blogspot.com timer4web.com
tizanidinesleepaid.blogspot.com timhost.ru
tizanidinevscyclobenzaprine.blogspot.com tizanidineshowupondrugtest.blogspot.com
tn811.us tomck.com
todohr.com toonfamilies.net
tongkatmadura.info topclickguru.com
topquality.cf torrents.life
turn-up-life.life traffique.net
unrealcommander.com trustl.life
url-img.link tryrating.com
usacasino.com turbabitload.weebly.com
ustion.ru twiclub.in
uzporno.mobi tzritel.tk
validdomain.xyz utrolive.ru
veopornogratis.xxx
versaut.xxx-cam.webcam
via-energy-acquistare.com
videochat.tv.br videochat.tv.br
videogamesecrets.com videokrik.net
vip-file.com vigrx-original.ru
vip2ch.com
visitcambridge.org visitcambridge.org
viveresaniesnelli.it vita.com.hr
vk-mus.ru vkgaleria.com
webstatsdomain.org vonradio.com
weburlopener.com vostoktrade.info
weekes.biz.tc vozbujdenie.com
weprik.ru vremya.eu
wildcattube.com vroze.com
withstandingheartwarming.com vseigry.fun
wormix-cheats.ru vsesubwaysurfers.com
xfluro.com vvon.co.uk
xkaz.org web-betting.ru
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai welcomeauto.ru
xn----7sbho2agebbhlivy.xn--p1ai wholesalejerseysgaa.com
xn--lifehacer-1rb.com wikes.20fr.com
xnxx699.com wineitudes.wordpress.com
xsion.net worldtraveler.world
xtremeeagles.net woweb.com.ua
yougetsignal.com x-diesel.com
youraticles.pl xblognetwork.com
zaim-pod-zalog-krasnodar.ru xdoza.com
zaimhelp.ru xerox-douglas.cf
zero1.it xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
zigarettenonlinekaufen1.blox.pl xtraffic.plus
znaniyapolza.ru yaderenergy.ru
zoogdiesney.com yottos.com
zvuker.net yougotanewdomain.com
yourads.website
yugo-star.ru
yun56.co
za-music.mymobiplanet.com
zaobao.com.sg
zeroredirect12.com
zhongwenlink.com
zixizop.net.ru
zmoda.hostreo.com
zojirushi-products.ru
zootravel.com
zs2vm.top
zvetki.ru

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.162 0; 10.1.0.168 0;
127.0.0.1 0; 127.0.0.1 0;

12
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:39 UTC 2021 ### Updated: Sat Aug 14 07:57:29 UTC 2021
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1141,6 +1141,8 @@ User-agent: cah.io.community
Disallow:/ Disallow:/
User-agent: check1.exe User-agent: check1.exe
Disallow:/ Disallow:/
User-agent: clark-crawler
Disallow:/
User-agent: coccocbot-web User-agent: coccocbot-web
Disallow:/ Disallow:/
User-agent: cognitiveseo User-agent: cognitiveseo
@ -1245,6 +1247,10 @@ User-agent: voyagerx.com
Disallow:/ Disallow:/
User-agent: webmeup-crawler User-agent: webmeup-crawler
Disallow:/ Disallow:/
User-agent: webpros.com
Disallow:/
User-agent: webprosbot
Disallow:/
User-agent: x09Mozilla User-agent: x09Mozilla
Disallow:/ Disallow:/
User-agent: x22Mozilla User-agent: x22Mozilla

12
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2523 ### Version: V4.2021.08.2524
### Updated: Fri Aug 13 22:01:39 UTC 2021 ### Updated: Sat Aug 14 07:57:29 UTC 2021
### Bad Bot Count: 620 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1141,6 +1141,8 @@ User-agent: cah.io.community
Disallow:/ Disallow:/
User-agent: check1.exe User-agent: check1.exe
Disallow:/ Disallow:/
User-agent: clark-crawler
Disallow:/
User-agent: coccocbot-web User-agent: coccocbot-web
Disallow:/ Disallow:/
User-agent: cognitiveseo User-agent: cognitiveseo
@ -1245,6 +1247,10 @@ User-agent: voyagerx.com
Disallow:/ Disallow:/
User-agent: webmeup-crawler User-agent: webmeup-crawler
Disallow:/ Disallow:/
User-agent: webpros.com
Disallow:/
User-agent: webprosbot
Disallow:/
User-agent: x09Mozilla User-agent: x09Mozilla
Disallow:/ Disallow:/
User-agent: x22Mozilla User-agent: x22Mozilla