vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.11.2735 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-11-25 07:30:03 +00:00
parent f6230c8ff9
commit 5119995fc1
56 changed files with 1161 additions and 1131 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2734 #### Version: V4.2021.11.2735
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.11.2734 #### Version: V4.2021.11.2735
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,8 +11,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.11.2734 #### Version: V4.2021.11.2735
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

6
_generator_lists/bad-referrers.list
View file

@ -1,7 +1,3 @@
duawitchrarato.tk
riralmolamsaca.tk
ru-mediaget.ru
lordzfilmz.me
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -3560,6 +3556,7 @@ longadventure.com
longgreen.info longgreen.info
longlifelomilomi.info longlifelomilomi.info
lookingglassemb.com lookingglassemb.com
lordzfilmz.me
losangeles-ads.com losangeles-ads.com
lost-alpha.ru lost-alpha.ru
lostaruban.com lostaruban.com
@ -5058,6 +5055,7 @@ roznica.com.ua
rp9.ru rp9.ru
rrutw.com rrutw.com
ru-dety.ru ru-dety.ru
ru-mediaget.ru
rubanners.com rubanners.com
rubbed.us rubbed.us
ruclicks.com ruclicks.com

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.11.2734 #### Version: V4.2021.11.2735
#### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7079](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [629](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-03.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-05.txt
View file

File diff suppressed because one or more lines are too long

2
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -3556,6 +3556,7 @@ domain:longadventure.com
domain:longgreen.info domain:longgreen.info
domain:longlifelomilomi.info domain:longlifelomilomi.info
domain:lookingglassemb.com domain:lookingglassemb.com
domain:lordzfilmz.me
domain:losangeles-ads.com domain:losangeles-ads.com
domain:lost-alpha.ru domain:lost-alpha.ru
domain:lostaruban.com domain:lostaruban.com
@ -5054,6 +5055,7 @@ domain:roznica.com.ua
domain:rp9.ru domain:rp9.ru
domain:rrutw.com domain:rrutw.com
domain:ru-dety.ru domain:ru-dety.ru
domain:ru-mediaget.ru
domain:rubanners.com domain:rubanners.com
domain:rubbed.us domain:rubbed.us
domain:ruclicks.com domain:ruclicks.com

8
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

8
conf.d/globalblacklist-testing-version.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

8
conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

8
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3603,6 +3603,7 @@
"~*(?:\b)longgreen\.info(?:\b)" 0; "~*(?:\b)longgreen\.info(?:\b)" 0;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 0; "~*(?:\b)longlifelomilomi\.info(?:\b)" 0;
"~*(?:\b)lookingglassemb\.com(?:\b)" 0; "~*(?:\b)lookingglassemb\.com(?:\b)" 0;
"~*(?:\b)lordzfilmz\.me(?:\b)" 0;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 0; "~*(?:\b)losangeles\-ads\.com(?:\b)" 0;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 0; "~*(?:\b)lost\-alpha\.ru(?:\b)" 0;
"~*(?:\b)lostaruban\.com(?:\b)" 0; "~*(?:\b)lostaruban\.com(?:\b)" 0;
@ -5101,6 +5102,7 @@
"~*(?:\b)rp9\.ru(?:\b)" 0; "~*(?:\b)rp9\.ru(?:\b)" 0;
"~*(?:\b)rrutw\.com(?:\b)" 0; "~*(?:\b)rrutw\.com(?:\b)" 0;
"~*(?:\b)ru\-dety\.ru(?:\b)" 0; "~*(?:\b)ru\-dety\.ru(?:\b)" 0;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 0;
"~*(?:\b)rubanners\.com(?:\b)" 0; "~*(?:\b)rubanners\.com(?:\b)" 0;
"~*(?:\b)rubbed\.us(?:\b)" 0; "~*(?:\b)rubbed\.us(?:\b)" 0;
"~*(?:\b)ruclicks\.com(?:\b)" 0; "~*(?:\b)ruclicks\.com(?:\b)" 0;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2734 2735

8
dev-tools/globalblacklist-testing.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.11.2734 ### Version: V3.2021.11.2735
### Updated: Thu Nov 25 02:53:48 UTC 2021 ### Updated: Thu Nov 25 07:24:15 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

8
dev-tools/globalblacklist.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -3556,6 +3556,7 @@
"~*(?:\b)longgreen\.info(?:\b)" 0; "~*(?:\b)longgreen\.info(?:\b)" 0;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 0; "~*(?:\b)longlifelomilomi\.info(?:\b)" 0;
"~*(?:\b)lookingglassemb\.com(?:\b)" 0; "~*(?:\b)lookingglassemb\.com(?:\b)" 0;
"~*(?:\b)lordzfilmz\.me(?:\b)" 0;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 0; "~*(?:\b)losangeles\-ads\.com(?:\b)" 0;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 0; "~*(?:\b)lost\-alpha\.ru(?:\b)" 0;
"~*(?:\b)lostaruban\.com(?:\b)" 0; "~*(?:\b)lostaruban\.com(?:\b)" 0;
@ -5054,6 +5055,7 @@
"~*(?:\b)rp9\.ru(?:\b)" 0; "~*(?:\b)rp9\.ru(?:\b)" 0;
"~*(?:\b)rrutw\.com(?:\b)" 0; "~*(?:\b)rrutw\.com(?:\b)" 0;
"~*(?:\b)ru\-dety\.ru(?:\b)" 0; "~*(?:\b)ru\-dety\.ru(?:\b)" 0;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 0;
"~*(?:\b)rubanners\.com(?:\b)" 0; "~*(?:\b)rubanners\.com(?:\b)" 0;
"~*(?:\b)rubbed\.us(?:\b)" 0; "~*(?:\b)rubbed\.us(?:\b)" 0;
"~*(?:\b)ruclicks\.com(?:\b)" 0; "~*(?:\b)ruclicks\.com(?:\b)" 0;

2
dev-tools/referrers-regex-format.txt
View file

@ -3556,6 +3556,7 @@
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -5054,6 +5055,7 @@
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.73.85 0; 20.124.210.154 0;

8
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3603,6 +3603,7 @@
"~*(?:\b)longgreen\.info(?:\b)" 0; "~*(?:\b)longgreen\.info(?:\b)" 0;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 0; "~*(?:\b)longlifelomilomi\.info(?:\b)" 0;
"~*(?:\b)lookingglassemb\.com(?:\b)" 0; "~*(?:\b)lookingglassemb\.com(?:\b)" 0;
"~*(?:\b)lordzfilmz\.me(?:\b)" 0;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 0; "~*(?:\b)losangeles\-ads\.com(?:\b)" 0;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 0; "~*(?:\b)lost\-alpha\.ru(?:\b)" 0;
"~*(?:\b)lostaruban\.com(?:\b)" 0; "~*(?:\b)lostaruban\.com(?:\b)" 0;
@ -5101,6 +5102,7 @@
"~*(?:\b)rp9\.ru(?:\b)" 0; "~*(?:\b)rp9\.ru(?:\b)" 0;
"~*(?:\b)rrutw\.com(?:\b)" 0; "~*(?:\b)rrutw\.com(?:\b)" 0;
"~*(?:\b)ru\-dety\.ru(?:\b)" 0; "~*(?:\b)ru\-dety\.ru(?:\b)" 0;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 0;
"~*(?:\b)rubanners\.com(?:\b)" 0; "~*(?:\b)rubanners\.com(?:\b)" 0;
"~*(?:\b)rubbed\.us(?:\b)" 0; "~*(?:\b)rubbed\.us(?:\b)" 0;
"~*(?:\b)ruclicks\.com(?:\b)" 0; "~*(?:\b)ruclicks\.com(?:\b)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.73.85 0; 20.124.210.154 0;

8
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.73.85 0; 20.124.210.154 0;

8
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:47 UTC 2021 ### Updated: Thu Nov 25 07:24:14 UTC 2021
### Bad Referrer Count: 7077 ### Bad Referrer Count: 7079
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4614,6 +4614,7 @@ map $http_referer $bad_referer {
"~*(?:\b)longgreen\.info(?:\b)" 1; "~*(?:\b)longgreen\.info(?:\b)" 1;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 1; "~*(?:\b)longlifelomilomi\.info(?:\b)" 1;
"~*(?:\b)lookingglassemb\.com(?:\b)" 1; "~*(?:\b)lookingglassemb\.com(?:\b)" 1;
"~*(?:\b)lordzfilmz\.me(?:\b)" 1;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 1; "~*(?:\b)losangeles\-ads\.com(?:\b)" 1;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 1; "~*(?:\b)lost\-alpha\.ru(?:\b)" 1;
"~*(?:\b)lostaruban\.com(?:\b)" 1; "~*(?:\b)lostaruban\.com(?:\b)" 1;
@ -6112,6 +6113,7 @@ map $http_referer $bad_referer {
"~*(?:\b)rp9\.ru(?:\b)" 1; "~*(?:\b)rp9\.ru(?:\b)" 1;
"~*(?:\b)rrutw\.com(?:\b)" 1; "~*(?:\b)rrutw\.com(?:\b)" 1;
"~*(?:\b)ru\-dety\.ru(?:\b)" 1; "~*(?:\b)ru\-dety\.ru(?:\b)" 1;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 1;
"~*(?:\b)rubanners\.com(?:\b)" 1; "~*(?:\b)rubanners\.com(?:\b)" 1;
"~*(?:\b)rubbed\.us(?:\b)" 1; "~*(?:\b)rubbed\.us(?:\b)" 1;
"~*(?:\b)ruclicks\.com(?:\b)" 1; "~*(?:\b)ruclicks\.com(?:\b)" 1;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 1; 10.1.1.59 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test_units/custom-bad-referrers.conf
View file

@ -3603,6 +3603,7 @@
"~*(?:\b)longgreen\.info(?:\b)" 0; "~*(?:\b)longgreen\.info(?:\b)" 0;
"~*(?:\b)longlifelomilomi\.info(?:\b)" 0; "~*(?:\b)longlifelomilomi\.info(?:\b)" 0;
"~*(?:\b)lookingglassemb\.com(?:\b)" 0; "~*(?:\b)lookingglassemb\.com(?:\b)" 0;
"~*(?:\b)lordzfilmz\.me(?:\b)" 0;
"~*(?:\b)losangeles\-ads\.com(?:\b)" 0; "~*(?:\b)losangeles\-ads\.com(?:\b)" 0;
"~*(?:\b)lost\-alpha\.ru(?:\b)" 0; "~*(?:\b)lost\-alpha\.ru(?:\b)" 0;
"~*(?:\b)lostaruban\.com(?:\b)" 0; "~*(?:\b)lostaruban\.com(?:\b)" 0;
@ -5101,6 +5102,7 @@
"~*(?:\b)rp9\.ru(?:\b)" 0; "~*(?:\b)rp9\.ru(?:\b)" 0;
"~*(?:\b)rrutw\.com(?:\b)" 0; "~*(?:\b)rrutw\.com(?:\b)" 0;
"~*(?:\b)ru\-dety\.ru(?:\b)" 0; "~*(?:\b)ru\-dety\.ru(?:\b)" 0;
"~*(?:\b)ru\-mediaget\.ru(?:\b)" 0;
"~*(?:\b)rubanners\.com(?:\b)" 0; "~*(?:\b)rubanners\.com(?:\b)" 0;
"~*(?:\b)rubbed\.us(?:\b)" 0; "~*(?:\b)rubbed\.us(?:\b)" 0;
"~*(?:\b)ruclicks\.com(?:\b)" 0; "~*(?:\b)ruclicks\.com(?:\b)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Ankit ChinaClaw
DomCopBot Dragonfly
EMail Siphon Flunky
Lftp Iblog
Name Intelligence LNSpiderguy
Offline Explorer NetSpider
Scanbot RepoMonkey
VCI SEOkicks-Robot
Zade Surfbot
cah.io.community Voil

284
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
ADmantX 404enemy
AIBOT
ALittle Client ALittle Client
ASPSeek
Abonti Abonti
Aboundexbot Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Alligator AiHitBot
Anarchie Aipbot
Anarchy Alexibot
Anarchy99 AllSubmitter
Ankit Ankit
Apexoo Anthill
Aspiegel
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BackStreet BBBike
Backlink-Ceck BackDoorBot
BackWeb
BacklinkCrawler
Badass
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga Battleztar Bazinga
Black Hole Blow
BlackWidow
BlowFish
Bolt Bolt
BotALot Brandwatch
Buck Buck
CSHttp Bullseye
Calculon BunnySlippers
CATExplorador
CCBot
CODE87
Cegbfeieh Cegbfeieh
CheeseBot CheTeam
CherryPicker
Chlooe
Claritybot Claritybot
Cliqzbot Cloud mapping
Cogentbot
Copier
CopyRightCheck
Craftbot
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
Curious CrunchBot
Custo DIIbot
DTS Agent DSearch
DataCha0s Deusu
DatabaseDriverMysqli Disco
DigitalPebble Discobot
Discoverybot
DnBCrawler-Analytics DnBCrawler-Analytics
DomainCrawler
DomainStatsBot DomainStatsBot
Domains Project
Dotbot Dotbot
EMail Wolf EMail Wolf
EasyDL
Ebingbong Ebingbong
EirGrabber EirGrabber
Exabot
Extractor
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
FDM FHscan
FemtosearchBot FemtosearchBot
Fimap Flunky
G-i-g-a-b-o-t Freeuploader
GT::WWW Fyrebot
GermCrawler
Getintent
Go!Zilla Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GrabNet
Grabber Grabber
Grafula GrapeshotCrawler
HEADMasterSEO HEADMasterSEO
HTMLparser HTTP::Lite
HTTrack
Haansoft Haansoft
Havij
Heritrix
HybridBot HybridBot
IDBTE4M
IDBot IDBot
Iblog IRLbot
InterGET Iria
JamesBOT Iskanie
Jbrofuzz JetCar
Jetty Jetty
JikeSpider
Joomla Joomla
Jorgee Jorgee
JustView
Jyxobot Jyxobot
Kozmosbot Keyword Density
LWP::Simple LWP::Simple
Larbin
LeechFTP LeechFTP
LexiBot
Libwhisker
LieBaoFast LieBaoFast
LinkScan
Linkbot Linkbot
Linkdexbot
LinkpadBot LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider Lipperhey Spider
MFC_Tear_Sample Litemage_walker
MQQBrowser Lmspider
MTRobot MIIxpc
Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic12
MarkMonitor MarkMonitor
Mass Downloader MarkWatch
Mb2345Browser Masscan
Mata Hari
Meanpathbot Meanpathbot
Microsoft Data Access Microsoft URL Control
Minefield
Moblie Safari Moblie Safari
Mozlila Mojolicious
Name Intelligence Morfeus Fucking Scanner
NICErsPRO
NPbot
Nameprotect Nameprotect
NearSite
Needle
Nessus Nessus
NetAnts NetSpider
Not Netvibes
Nutch Nibbler
Nikto
NimbleCrawler
Nimbostratus
Octopus Octopus
Offline Explorer OnCrawl
Offline Navigator
OpenLinkProfiler
Openfind Openfind
Openvas
OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl PHPCrawl
Page Analyzer Page Analyzer
PageGrabber PageAnalyzer
PageScorer
PageThing.com PageThing.com
Pandalytics Pandalytics
Panscient Panscient
Papa Foto Petalbot
Pavuk
PeoplePal
Pi-Monster
Picsearch
PictureFinder
Piepmatz Piepmatz
Pixray Probethenet
PleaseCrawl Psbot
Pu_iN PxBroker
QueryN Metasearch QueryN Metasearch
RSSingBot RankFlex
RankingBot RankingBot
Rankivabot
RankurBot RankurBot
Re-re
ReGet ReGet
Recorder Recorder
RedesScrapy
RepoMonkey
Ripper Ripper
RocketCrawler SEOlyticsCrawler
Rogerbot SEOprofiler
SMTBot SEOstats
SISTRIX
SalesIntelligent SalesIntelligent
Scanbot Scanbot
ScoutJet
ScreenerBot ScreenerBot
ScrepyBot SemanticJuice
SemrushBot
SentiBot SentiBot
SeobilityBot Seomoz
Site Sucker Siphon
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSucker SiteSucker
Sitebeam
Siteimprove
Sitevigil Sitevigil
Sogou web spider SlySearch
Sosospider SmartDownload
SpaceBison SocialRankIOBot
Spammen Spammen
Spbot Spanner
Sqlmap
Sqlworm
Stripper Stripper
Sucuri
SuperBot
SuperHTTP SuperHTTP
Swiftbot Surfbot
Szukacz Szukacz
T8Abot
TeleportPro TeleportPro
Telesoft Telesoft
Telesphoreo
Telesphorep Telesphorep
The Intraformant Titan
Thumbor Toata
TightTwatBot
Toweyabot Toweyabot
Tracemyfile Trendictionbot
Turingos True_Robot
TurnitinBot
TwengaBot
Twice Twice
Typhoeus
URLy Warning URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT V-BOT
VB Project VCI
Vacuum
Vagabondo Vagabondo
Voil VeriCiteCrawler
WWW-Collector-E WEBDAV
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers Wallpapers
Wallpapers/3.0 WallpapersHD
WeSEE WebCopier
Web Enhancer
WebFetch WebFetch
Web Fuck WebImageCollector
Web Pix
Web Sauger
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher WebLeacher
WebPix WebPix
WebZIP WebReaper
WebSauger
WebStripper
Webalta Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Website Quester
Whacker WebsiteQuester
Whatweb Whatweb
Who.is Bot Who.is Bot
Widow Widow
Woobot Xenu
Wotbox Zeus
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
Zitebot
ZmEu ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZyBorg ZumBot
adscanner
archive.org_bot archive.org_bot
arquivo.pt arquivo-web-crawler
backlink-check
check1.exe
clark-crawler
coccocbot-web coccocbot-web
cognitiveseo crawler.feedback
com.plumanalytics
domainsproject.org
eCatch
evc-batch evc-batch
gopher gopher
heritrix
instabid instabid
ips-agent
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
pcBrowser
plumanalytics plumanalytics
polaris version
s1z.ru s1z.ru
satoristudio.net
scalaj-http scalaj-http
seoscanners seostar
sitechecker.pro
sogouspider sogouspider
sp_auditbot sp_auditbot
spyfu spyfu
sysscan
trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
webpros.com
webprosbot webprosbot
x09Mozilla zauba.io
zgrab

320
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy ASPSeek
80legs Abonti
ADmantX Aboundexbot
AiHitBot AiHitBot
Aipbot
Alexibot Alexibot
Anarchie AlphaBot
Aspiegel Anarchy
Anthill
Apexoo
Asterias Asterias
AwarioRssBot BDCbot
AwarioSmartBot BDFetch
BBBike
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Bandit BatchFTP
Battleztar Bazinga Bitacle
BetaBot
Bigfoot
Black Hole Black Hole
Blow BlowFish
Boardreader Bullseye
Bolt BunnySlippers
Brandprotect
Buck
BuiltBotTough
BuzzSumo BuzzSumo
CATExplorador CATExplorador
CODE87 CazoodleBot
CSHttp
CensysInspect CensysInspect
CheeseBot CheTeam
CherryPicker ChinaClaw
Cliqzbot
Cloud mapping Cloud mapping
Collector Copyscape
Copier Cosmos
CopyRightCheck Craftbot
CrazyWebCrawler
Crescent Crescent
CrunchBot CyotekWebCopy
Curious
Custo
DIIbot DIIbot
DSearch
DTS Agent DTS Agent
DataCha0s DatabaseDriverMysqli
Demon
Devil Devil
Discobot Digincore
Dispatch Discoverybot
DittoSpyder DnyzBot
DomCopBot DomainAppender
DomainCrawler DomainCrawler
Domains Project DomainStatsBot
Drip Dotbot
ECCP/1.0 Download Wonder
EMail Siphon
EMail Wolf
EasyDL EasyDL
EirGrabber Ebingbong
Ecxi
Evil Evil
ExtractorPro Express WebPictures
FDM Extractor
FHscan Ezooms
Fimap Flunky
Firefox/7.0
Foobot Foobot
Freeuploader
Fuzz
Fyrebot Fyrebot
G-i-g-a-b-o-t GT::WWW
GrabNet GalaxyBot
Grabber GetWeb
GrapeshotCrawler Getintent
GridBot Go-Ahead-Got-It
HTMLparser Gotit
Grafula
GrapeFX
HEADMasterSEO
HMView
HTTrack HTTrack
Harvest Harvest
Havij
Humanlinks Humanlinks
IDBTE4M IDBTE4M
IDBot
IRLbot IRLbot
Iblog Iblog
Id-search Id-search
Image Fetch IlseBot
Image Sucker InfoNaviRobot
Internet Ninja Internet Ninja
InternetSeer InternetSeer
JOC Web Spider JamesBOT
JikeSpider JennyBot
Jorgee JetCar
Lanshanbot Joomla
Larbin Kenjin Spider
Leap LNSpiderguy
LeechFTP LexiBot
Libwhisker
Likse Likse
LinkScan LinkScan
Linkdexbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 MIDown tool
MIIxpc
MJ12bot MJ12bot
MSFrontPage
MTRobot MTRobot
Mail.RU_Bot Magnet
Majestic SEO MarkMonitor
Majestic-SEO Mass Downloader
MarkWatch
MauiBot MauiBot
Mb2345Browser Mb2345Browser
MicroMessenger MeanPath Bot
Mister PiX Mediatoolkitbot
MegaIndex.ru
Metauri
Minefield
Mojolicious Mojolicious
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Msrabot
Musobot
NICErsPRO NICErsPRO
Name Intelligence NPbot
Nameprotect Needle
Navroad Nessus
NetMechanic NetAnts
NetSpider
NetZIP NetZIP
Netvibes
NextGenSearchBot NextGenSearchBot
Nikto Nibbler
Niki-bot
NimbleCrawler NimbleCrawler
Ninja Not
Nuclei
Nutch Nutch
OrangeBot Octopus
OnCrawl
OpenVAS
Openfind
OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Petalbot Petalbot
Pi-Monster
Picscout Picscout
Picsearch PictureFinder
Piepmatz Piepmatz
Pixray Pixray
PxBroker PleaseCrawl
ProPowerBot
Pump
PyCurl
RSSingBot RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankingBot RankingBot
RankingBot2 RankurBot
Rankivabot RedesScrapy
RealDownload
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks SEOstats
SEOlyticsCrawler
SEOprofiler
SMTBot SMTBot
ScoutJet SalesIntelligent
ScanAlert
Scanbot
Scrapy
Searchestate Searchestate
SearchmetricsBot
SemanticJuice SemanticJuice
SemrushBot SemrushBot
SiteExplorer SeoSiteCheckup
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
SiteSnagger SlySearch
Sitebeam Sociscraper
Sitevigil
Snoopy
Sogou web spider
Sosospider Sosospider
Sottopop Sottopop
SpankBot Spammen
Spanner Spbot
Sucuri SputnikBot
Surfbot Sqlworm
Sqworm
Steeler
SurveyBot SurveyBot
T8Abot Teleport
TeleportPro
Telesphoreo Telesphoreo
Telesphorep TheNomad
The Intraformant
Titan
Toweyabot Toweyabot
True_Robot Tracemyfile
TurnitinBot Trendictionbot
TwengaBot
Twice
Typhoeus Typhoeus
UnisterBot URLy.Warning
VCI
Vagabondo Vagabondo
VelenPublicWebCrawler VidibleScraper
VeriCiteCrawler
VoidEYE
Voil
Voltron
WISENutbot WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers
WallpapersHD WallpapersHD
Web Auto Web Collage
Web Enhancer Web Enhancer
Web Fetch
Web Fuck Web Fuck
Web Pix Web Sauger
Web Sucker
WebAuto WebAuto
WebBandit WebBandit
WebEnhancer WebFetch
WebFuck
WebImageCollector
WebLeacher WebLeacher
WebPix
WebReaper WebReaper
WebSauger WebWhacker
Webalta WebmasterWorldForumBot
Webshag
WebsiteQuester WebsiteQuester
Webster Webster
Whack Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Xaldon_WebSpider Wotbox
Xenu Zauba
YoudaoBot Zermelo
Zeus ZmEu
Zitebot ZoominfoBot
ZumBot
ZyBorg ZyBorg
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
clark-crawler autoemailspider
cah.io.community
check1.exe
coccocbot-web
cognitiveseo cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback
eCatch eCatch
heritrix instabid
internetVista monitor
ips-agent
isitwp.com isitwp.com
lwp-request meanpathbot
lwp-trivial
mediawords
oBot
page scorer page scorer
satoristudio.net plumanalytics
ripz
scalaj-http
seobility seobility
sexsearcher seocompany.store
siteripz seostar
sitechecker.pro
sogouspider
sp_auditbot sp_auditbot
sysscan trendiction.de
tAkeOut
voyagerx.com
webmeup-crawler webmeup-crawler
x22Mozilla webpros.com
webprosbot

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
biglistofwebsites.com 57883.net
bizru.info ahhjf.com
dojki-hd.com bestprofits-there.com
elektronischezi.livejournal.com bobinoz.com
free-fb-traffic.com boom-celebs.com
karting196.ru candycrushshop.com
lutherstable.org dentalpearls.com.au
partybunny.ru hexpilot.com
qualitymarketzone.com hidemyass.com
topsy.com websiteaccountant.de

946
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
100searchengines.com 123any.com
178evakuator178.ru 2728fb936f0.com
18ps.ru 3xforum.ro
202ch.com 4kplayer.pl
3rbseyes.com 57883.net
3th.co.in 777-club.ru
4rent.ru 7a2rnuey1tw9ar.ru
66cpwgln.space 7wind.ru
7yue.org 8jn.dating-app.ru
888.com academia-nsk.org
a1security.com.ua adbetclickin.pink
aab94f698f36684c5a852a2ef272e031bb.com addray.pro
aadroid.net adktrailmap.com
above.com adman.gr
abovetherivernc.com adsfresh.men
absugars.com adsref.men
abwa.tk adtech.de
adman.se adultgalls.com
admeasures.com adventureparkcostarica.com
adrunnr.com advokat-grodno.by
adult3dgames.com advokateg.xyz
afora.ru adzerg.com
ageofclones.com airlandsea.info
ahhjf.com
aktobe.xkaz.org
alarmobninsk.ru
albumsuper.info albumsuper.info
alice.it alekseevec.ru
allforminecraft.ru alert-fdm.xyz
alphaforum.ru alessandraleone.com
aludecor.info alevinefesleri.com
am-se.com alfa-medosmotr.ru
am15.net alfa9.com
amazon-adsystem.com alive-ua.com
anabolics.shop alkoravto.ru
anal-acrobats.hol.es alpinism.ru
ananumous.ru amazingpic.net
androids-store.com amt-k.ru
angry-fermi-7633.arukascloud.io anaseracresar.tk
apiadanaknet-a.akamaihd.net anlimebel.kiev.ua
apibatbrowsecom-a.akamaihd.net apartmentbay.ru
apibetweenlinesn-a.akamaihd.net apibrowsesmartne-a.akamaihd.net
apiqualitinknet-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
apispringsmartne-a.akamaihd.net asscenihotosidea.blogspot.com
app5.letmacworkfaster.world astrochicks.com
appfixing.space auspolice.com
appiq.mobi autoplate.info
apple.com-cleaner.systems autoseo-traffic.com
appmsr.org autoua.top
approvedlocal.co.za ayakino.net
arabsexxxtube.com azartmix.com
arenda-yeisk.ru baersaratov.ru
arquapetrarca.info balitouroffice.com
ascat.porn bankcrediti.ru
asociatia-tipografilor-transilvania.ro battlecarnival.su
aviapanda.ru bavsac.com
azbukadiets.ru bestdraws.com
babosas.com besthoro.ru
babyfactory.fr bestpriceninja.com
baladur.ru bestwebsitesawards.com
bambi.ck.ua beta.hotkeys.com
barnfurnituremart.com betteroffers.review
bbsoldes.fr bigpictures.club
begalka.xyz bioscorp.ru
berdasovivan.ru birzha-truda.eu
beremenyashka.com bizfly.info
best-businessman.ru bizru.info
bestfortraders.com blackcurranthumidifiers.site
bestserials.com blog-hits.com
bestwaystogetpaid.us blog.axant.it
bet365.com blog.remote-computer.de
beztuberkuleza.ru blogsfunky672.weebly.com
bigcareer.info bochemit.com.ua
biketank.ga bonkers.name
bitcoins-live.ru bristolhostel.com
bitnote.co bugof.gq
blacktwhite.com bugshoot.cn
bloglag.com buigas.00it.com
blogrankers.com burger-tycoon.com
bloke.com burkesales.com
bluejays-jerseys.us buy-cheap-pills-order-online.com
bmsco.co buyscabiescream.com
bmw.afora.ru cah.io.community
boeuklad.com candiceloves.us
bolitgorlo.net capacitacionyaprendizaje.com
bombla.org ccjp.eu
bongacams.com celebsopics.com
boom-celebs.com
brainboostingsupplements.org
braindaily.xyz
brakehawk.com
brandov.ru
brg8.com
btnativenav.com
bupropion-sr-150-mg.us
bvlgaribracelet.xyz
callejondelpozo.es
callmd5map.com
calstaterealty.us
canrole.com
capture-room.com
cardsdumps.com
carson.getenjoyment.net
caveavins.fr
cayado.snn.gr
cdnanalytics.xyz
centre-indigo.org.ua
ceotrk.com ceotrk.com
chee-by.biz chelnytruck.ru
christianlouboutinoutlet.win
christianlouboutinsaleoutletonline.us christianlouboutinsaleoutletonline.us
cjmc.info cialis-samples.com
civilwartheater.com
clarithromycin500mg.com
classiquebijoux.ru
cleanmypc.com cleanmypc.com
cobaltpro.ru clickbanksites.info
codq.info clickhype.com
com-supportcenter.website clickprotects.com
compliance-fred.xyz clicksor.net
compliance-olga.top clmforexeu.com
confib.ifmo.ru cntravelre.com
continent-e.tv cometorussia.net
crynet.cc compliance-barak.top
cryptoswap.biz compucelunlock.net
comsysnet.com
contentsexpress.com
coolwallpapers-hd.com
coolwallpapers4k.info
costablue.xyz
credit-respect.ru
culturevie.info culturevie.info
custom-electric-guitar.com cyclobenzaprinevstizanidine.blogspot.com
cyprusbuyproperties.com data-mining.tk
davebestdeals.com decorazilla.com
dcj-nn.ru dev78.dioniqlabb.se
dealitright.click
decenttools.com
dekorkeramik.ru
dellalimov.com
dentalpearls.com.au
designdevise.com
detmebel.su
deutschehobbyhuren.net
dev33.dioniqlabb.se
dieswaene.com dieswaene.com
dnsrsearch.com directivepub.com
docs4all.com djekxa.ru
domain-tracker.com djihispano.com
djstools.com
dktr.ru
docstoc.com
doktoronline.no
dokumentalkino.net
dollartree.info
domaincdn.xyz domaincdn.xyz
downloaddy.net downtuptv.gq
downloadeer.net draniki.org
dverimegapolis.ru e-avon.ru
easytuningshop.ru earn-from-articles.com
ec-file.info easyukraine.com
editmedios.com ecookna.com.ua
ee77ee.com edudocs.net
egvar.net electricwheelchairsarea.com
ekspresihati.info elitedollars.com
elektir.ru emailaccountlogin.co
elektronischezi.livejournal.com erot.co
elitesportsadvisor.com erotikchat-24.com
empirepoker.com errorfixing.space
energy-ua.com espaceinventoristes.com
erotag.com etur.ru
eshop4u.jp eu-cookie-law.blogspot.com
evehemming.blogspot.com.au everypony.ru
extstat.com evrotekhservis.ru
eyemagination.com exct.net
ezigarettenshop1.yolasite.com exdocsfiles.com
f012.de expdom.com
facecup.top expolicenciaslatam.co
falllow.gq exportshop.us
faracontrol.ir eyessurgery.ru
fashionavenuegame.com ezigarettekaufen2.mpbloggar.se
fast-wordpress-start.com ezigarettekaufen2.yolasite.com
f07.de
f1nder.org
factorynightclub.com
family1st.ca
fanoboi.com
fastfixing.tech
fbdownloader.com
fearcrow.com fearcrow.com
fettefrauen.net feel-planet.com
fighrofacciufreesig.ga femdom.twiclub.in
fillmewithhappiness.com film-one.ru
filmania-x.ru financehint.eu
filmi-onlain.info finemanteam.com
flirt4free.com flex4launch.ru
forex-indextop20.ru flprog.com
forex21.ru fodelsedagspresenter.nu
forpostlock.ru formulaantiuban.com
forum.tvmir.org fortunejack.com
foto-sisek.porngalleries.top forum-engineering.ru
freevpn.space forum.doctissimo.fr
freewebs.com forum20.smailik.org
freshberry.com.ua foto-telok.net
frvo.alptandem.ru foxjuegos.com
fym.com.ru free-share-buttons.top
gallerylisting.com free-stock-illustration.com
gamebackyard.com free411games.com
gazobeton-p.com.ua freemags.cc
gazoblok.net.ua fun2cell.net
gdcentre.ru fusoradio.info
get-free-traffic-now.com fxund.us
ghazel.ru fyxabomiw.ru
gidonline.one g33.org
girlspicsa.com gamblingnerd.com
gk170.ru gameonasia.com
global-ics.co.za garciniaxt.us
gogalleryawesome.com gelezki.com
gorabagrata.ru gembird.com
gourcy.altervista.org generalporn.org
greatzip.com generic-pills-online.com
gsmtlf.ru gentamicineyedrops.blogspot.com
guidefs.ru gettpromos.com
goldandcard.ru
golden-catalog.pro
goodnightjournal.com
goodwinmetals.co
gratuitbaise.com
guildebzh.info guildebzh.info
harmonyglen.us hamacapty.com
hasshe.com hatedriveapart.com
hauleddes.com hdfreeporno.net
healthcarestore.info hdxnxxtube.mobi
heliko.no healgastro.com
hexpilot.com hermesbirkinhandbagoutlets.com
hidefiles.org hidemyass.com
homeart.space highland-homes.com
host-protection.com highstairs-a.akamaihd.net
hostingclub.lk hmywwogw.bloger.index.hr
hotelcrocenzi.sm hoholikik.club
housediz.com homik.pw
hoverboard360.de hop.clickbank.net
hoverboard360.se hostcritique.com
hoverboardforsaledirect.com hothor.se
humbmosquina.tk howopen.ru
hybrid.ru hscsscotland.com
idc.com.ua iinstalll-fii1leis.jus0wil.pp.ua
idealtits.net ilbe.club
ikritikimou.gr ilmen.net
imadedinner.net images-free.net
images-graphics-pics.com inet-traffic.com
imagez.co instasexyblog.com
imicrovision.com internetproviderstucson.com
imk.com.ua iscblog.info
immigrational.info ispac.org
imperia31.ru istock-mebel.ru
impisr.ru james13prix.info
infoupdate.org
innodgfdriverhm.aircus.com
inspiring-desperate.tk
intimshop-fantasy.ru
itis4you.com
itservicesthatworkforyou.com
ivanstroi.ru
ivoiretechnocom.ci
jackwolfskinoutlet.online
jamiembrown.com jamiembrown.com
janavibekken.no javxxx18.com
jasonpartington.com jerseyschinabizwholesale.us
jav-fetish.site journeydownthescale.info
javcoast.com joyceblog.top
javrip.net kamagragelusa.net
jikoman.info kamorel.com
jobmarket.com.ua kaz.kz
johnnyhaley.top kerwinandcariza.com
kaac.ru kevblog.top
kabbalah-red-bracelets.com kidd.reunionwatch.com
kemerovo.zrus.org kino-rf.ru
kinozapas.org
kirov.zrus.org kirov.zrus.org
knowsitall.info kladrus.ru
komp-pomosch.ru klejonka.info
krasnodar-avtolombards.ru klin3952.ru
krynica.info klosetkitten.com
kung-fu-ru.com kndxbkdx.bloger.index.hr
kuzinsp.ru kovesszucs.atw.hu
kwzf.net kvartira-sutochno.com
lanasshop.ru lanadelreyfans.us
larchik.net languagecode.com
law-check-eight.xyz lazymanyoga.com
lawyers.cafe lexaprogeneric.link
lego4x4.ru linkbolic.com
lernur.net linkpulse.com
life.biz.ua lion.misba.us
linkrr.com locimge.pw
liveu.infoteka.hu lotto6888.com
llastbuy.ru mafa-free.com
locationdesaison.com maladot.com
lockerz.com mantramusic.ru
louboutinreplica.xyz maranbrinfo.com.br
lovasszovetseg.hu mcar.in.ua
mail.allnews24.in me-ke.com
makenahartlin.com mediaoffers.click
malwareremovalcenter.com medicines-choice.com
mararoom.ru medizinreisen.de
marcowebonyodziezowe.pl megagrabber.ru
maslenka.kz megaindex.ru
matrixalchemy.com micasainvest.com
maximilitary.ru midst.eu
meteostate.com militarysale.pro
mini-modus.ru minecraft-neo.ru
mirmedinfo.ru minharevisao.com
mirzonru.net misterjtbarbers.com
missis.top mmostrike.ru
mlf.hordo.win mncrftpcs.com
mmog-play.ru mnogabukaff.net
mobplayer.net monetizationking.net
mobstarr.com moneyviking-a.akamaihd.net
mojpregled.com moscow-region.ru
monclercheap.xyz moscow.xrus.org
moneyzzz.ru mototsikl.org
mosdverka.ru movies-in-theaters.net
moz.com mp3ritm.top
mrvideospornogratis.xxx mriyadh.com
muznachas-service.ru mrlmedia.net
myanyone.net mulberryoutletonlineeu.com
myhydros.org mxgetcode.com
myperiod.club mydeathspace.com
mysex21.com myfreemp3.eu
narutonaruto.ru myiptest.com
neks.info myplaycity.com
netanalytics.xyz myseoconsultant.com
nfljerseysforsalewholesaler.com nailsimg.com
national-today-winning-winner.club
netcheckcdn.xyz
newhairstylesformen2014.com
next-dentists.tk
nicefloor.co.uk
nikitsyringedrivelg.pen.io
nlfjjunb5.ru nlfjjunb5.ru
nsatc.net nordvpn.com
nrv.co.za
nudejapan.net nudejapan.net
obiavo.net nuup.info
office-windows.ru o-o-6-o-o.com
offtopic.biz o.light.d0t.ru
onemantrip.com obiavo.kz
onescreen.cc ofanda.com
online-x.ru offf.info
oxotl.com okout.ru
ozoz.it online-hit.info
pandroid.co online-podarki.com
parfusale.se online-sbank.ru
partner-print.men openfrost.com
partnerads.men osoznanie-narkotikam.net
pensplan.com outpersonals.com
petitions.whitehouse.gov oz-offers.com
pic-re.blogspot.com p-business.ru
picmoonco.pw partner-pop.men
picture-group.com perfection-pleasure.ru
pintattoos.com perfectplanned.com
pix-hd.com pliks.pl
pixgood.com plusnetwork.com
pk-services.ru pomoc-drogowa.cba.pl
plastjulgranar.se pontiacsolstice.info
play-movie.pl popugauka.ru
poptool.net porndairy.in
porngalleries.top pornhive.org
pornhubforum.tk pornhub-ru.com
porno-video-chati.ru pornobrazzers.biz
pornoblood.com pornonik.com
prchecker.info pornosok.ru
prom23.ru porodasobak.net
promover.org portnoff.od.ua
prpops.com pro-okis.ru
pussyfleet.com productarium.com
pyramidlitho.webs.com projefrio.com.br
qcstrtvt.bloger.index.hr promgirldresses.xyz
qpypcx.com pronekut.com
rabot.host.sk puzzleweb.ru
ragecash.com quebec-bin.com
quickloanbank.com
rainbowice.ru
rank-checker.online
ranksonic.info ranksonic.info
ranksonic.org rapevideosmovies.com
rating-casino2021.ru
razyboard.com
realizmobi.com realizmobi.com
realtytimes.com rednise.com
reckonstat.info reimageplus.com
renecaovilla.online relatodelpresente.com.ar
rentaremotecomputer.com remote-dba.de
repeatlogo.co.uk rentehno.ru
rethinkwasteni.info replica-watch.ru
reversing.cc responsive-test.net
revistaindustria.com revistaindustria.com
rocketchange.ru ric.info
royalcar-ufa.ru rockingclicks.com
ru-dety.ru rosbalt.com.ua
ruspdd.com royal-betting.net
russia-tao.ru running-line.ru
rusvideos.su rusenvironmental.net
sa-live.com sa-rewards.co.za
sakhboard.ru sabaapress.com
sandhillsonline.com samoiedo.it
santasgift.ml santechnik.jimdo.com
sayyoethe.blogspot.co.za sayyoethe.blogspot.co.za
sbprabooks.com sbprabooks.com
scanner-barak.top sbwealthsolutions.ca
scanner-jess.top scanner-brian.top
scanner-julia.top scanner-ivan.top
scanner-walt.top scanner-josh.top
schlampen-treffen.com scanner-mark.top
scmor.ilxc.cc scanner-nelson.top
seminarygeorgia59.ga sdi-pme.com
semprofile.com sdrescher.net
seasonvar.ru
seo-smm.kz
seoanalyses.com
seozoom.it seozoom.it
serdcenebolit.com shemalegalls.blogporn.in
serptehnika.ru shiksabd.com
sexkontakte-seite.com shillyourcoins.com
shijian.ac.cn shmetall.com.ua
shymkent.xkaz.org shop.xz618.com
si-unique.com shoplvlv.us
signal03.ru similardeals.net
siha.de site-speed-check.site
silktide.com siteaero.com
site-analyzer.com skutecznetabletkinaporostwlosow.pl
skanninge.se sky-mine.ru
slavkokacunko.de skylta.com
slowmacfaster.trade slujbauborki.ru
smart-balancewheel.com smallseotools.com
smartbalanceworld.com smstraf.ru
smichovbike.cz snjatie-geroinovoy-lomki.ru
social-fun.ru softomix.com
soft-terminal.ru solmarket.by
softlinesolutions.me solnplast.ru
softwaretrend.net
solicita.info
sotkal.lark.ru sotkal.lark.ru
spin2016.cf soundfrost.org
sports-supplements.us spabali.org
spywarespy.com speechfoodie.com
standardchartered-forex.com spinnerco.ca
stopnarco.ru spywareit.com
stpolice.com stal-rulon.ru
streetfire.net stanthonyscatholicchurch.org
strongsignal-a.akamaihd.net starwars.wikia.com
subj.ukr-lit.com stauga.altervista.org
suhanpacktech.com staynplay.net
surfbuyermac.com stmassage.ru
svarbit.com stockquotes.wooeb.com
swsociety.se stop-gepatit.te.ua
symphonyintegratedhealthcare.com studworks.org
t3chtonic.com sugarlyflex.pw
taranerymagesswa.blogspot.com superstats.com
td-33.ru suralink.com
tecnoteakviareggio.it syndicate.fun
teenporn18.net szucs.ru
telefonsexi.com technopellet.gr
thenews-today.info telsis.com
thesmartsearch.net terraclicks.com
titelhelden.eu tgtclick.com
tizanidinehcl2mg.blogspot.com thaismartloan.com
tizanidinehcl4mgtab.blogspot.com theautoprofit.ml
tkanorganizma.ru themestotal.com
tnaionline.org tivolibasket.it
topbestgames.com tizanidine4mguses.blogspot.com
totu.info tizanidinehcl4mgtablet.blogspot.com
tovaroboom.vast.ru tizanidinehydrochloride2mg.blogspot.com
tizanidineinteractions.blogspot.com
tizanidinestreetprice.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com
tk-assortiment.ru
tobeyouday.win
token-lab.org
toonfamilies.net
topvidos.ru
toursmaps.com
toyota.7zap.com toyota.7zap.com
tpu.ru traffic2money.com
traffic-club.info trafficfactory.biz
trailer.cinemaflix.website trahvid.com
truck-addzilla.life trk-4.net
tryrating.com twelvevisionspartyofcolorado.com
tupper-posuda.ru u-cheats.ru
turbo-suslik.org ugguk.online
turvgori.ru ukkelberg.no
typimga.pw ukrtextbook.com
tzritel.tk um-razum.ru
uginekologa.com univerfiles.com
uroki.net url2image.com
usacasino.com uzungil.com
ussearche.cf valueclick.com
utiblog.fr vasileostrovsky-rayon.ru
uzporno.mobi vchulkax.com
viandpet.com veerotech.com
videositename.com vekzdorov.ru
videtubs.pl videochat.mx
vip.51.la videospornogratisx.net
vitoriacabos.com virtualbb.com
vladhistory.com vkgaleria.com
vladimir.xrus.org vrnelectro.ru
vmnmvzsmn.over-blog.com w-journal.ru
vpnmouse.com wardreapptokone.tk
vuclip.com waycash.net
wallpaperstock.net
we-are-gamers.com we-are-gamers.com
webix.biz web-betting.ru
webix.me web.cvut.cz
webkeyit.com webkeyit.com
webmasters.stackexchange.com website-analyzer.info
webtherapy.ru wejdz-tu.pl
wechatdownload10.com wellcome2slovenia.ru
wedding0venues.tk westen-v.life
wemedinc.com westen-z.life
whos.amung.us westum.se
williamrobsonproperty.com whatsappbot.flyland.ru
withstandingheartwarming.com windowssearch-exp.com
word-vorlagen.xyz wingsoffury2.com
works.if.ua winterclassichockeyjerseys.com
worldlovers.ru wnhjavlhezp.gq
wosik-dach.service-for-web.de word-vorlagen.net
writersgroup580.web.fc2.com www.jbetting.com
www.kabbalah-red-bracelets.com x-musics.com
www.souvenirua.com
www.timer4web.com
wzgyyq.com
x-lime.com
xbaboon.com
xchangetrak.com
xitjw.info
xjlottery.com xjlottery.com
xmlinde.com xmlinde.com
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
xn--80aeahghtf8ac5i.xn--p1ai xn--80aeahghtf8ac5i.xn--p1ai
xn--80aikhbrhr.net
xn--b1addnj3cah.xn--p1ai
xn--d1aifoe0a9a.top xn--d1aifoe0a9a.top
xn--lifehacer-1rb.com xolodremont.ru
xxxnatelefon.ru xxlargepop.com
yopoint.in xxxkaz.org
youresponsive.com yaminecraft.ru
za-fun-offer.com yebocasino.com
zaapplesales.blogspot.com youjizz.com
zawyna.ua yourporn.com
zeikopay.com zapatosenventa.info
zeroredirect.com zigarettenonlinekaufen2.drupalgardens.com
zeroredirect11.com zojirushi-products.ru
zoogdiesney.com zootravel.com

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1kdailyprofit.me 21h2o.com
51.la 4k-player.pl
add-add.men 5tey7463.weebly.com
admatic.com.tr aab94f698f36684c5a852a2ef272e031bb.com
adultgalls.com abcdefh.xyz
ahmedabadwebs.com actices.com
alfa-img.com adktrailmap.com
algarveglobal.com adman.gr
allcredits.su adpremium.org
alphahoverboards.com advocatemsk.ru
apidiamondatanet-a.akamaihd.net aimayangzhi.com
apidigidocketnet-a.akamaihd.net akita.kz
arkartex.ru aktobe.xkaz.org
asophoto.com albamargroup.com
azbaseimages.net alert-jdh.xyz
bard-real.com.ua allnews.md
battle.net aludecor.info
bazaronline24.ru amateurgalls.com
belsetirehafi.tk amazon-seo-service.com
bensbargains.net amigobulls.com
berdasovivan.ru ample-awards-today.us
beremenyashka.com animalrank.com
bestofferswalkmydogouteveryday.gq antons-transporte.de
bet365.com apispringsmartne-a.akamaihd.net
big-cash.net appsecurityr.com
blog.f00kclan.de apptester.tk
boeuklad.com arendatora.ru
brainsandeggs.blogspot.com artdestshop.eu
buchananshardware.com artparquet.ru
bukleteg.xyz asiavirtualsolutions.com
buqayy0.livejournal.com asrv-a.akamaihd.net
bytimedance.ru autotop.com.ua
cactussoft.biz aviav.ru
carsplate.com avkzarabotok.com
casinorewards.info awaybird.ru
cheapmoncler.pw azarttoto.com
christianlouboutinreplica.pw babyguns.ru
cleanmypc.com beclean-nn.ru
clickprotects.com bestwrinklecreamnow.com
clippingphotoindia.com betteroffers.review
compliance-jess.top blackle.com
compliance-viktor.top blogqpot.com
cosmetic.donna7753191.ru blogsfunky672.weebly.com
cougfan.info brillianty.info
creams.makeforum.eu buehne-fuer-menschenrechte.de
cscwtalkto.site buqyxa.rincian.info
cubs-jerseys.us burger-imperia.com
culturevie.info buy-meds24.com
cv.wallhade.co buyhoverboard.com
decorationspcs.com bvlgariwallet.xyz
degerlund.net cah.io.community
delta-line.men candy-glam-hp.com
detsky-nabytek.info carsdined.org
diminishedvalueoforegon.com carson.getenjoyment.net
download-walpaperhd.blogspot.com cartierlove2u.com
edwinkonijn.com.au cfcl.co.uk
elektrischezigarette1.blog.pl chlooe.com
elexies.info cialgenisrx.com
ertelecom.ru club-lukojl.ru
etm-consult.de coderstate.com
exchanges-bet.com colobit.biz
exoclick.com com-onlinesupport.site
extremez.net comeondog.info
ezigarettekaufen2.mpbloggar.se commoncrawl.org
fickkontakte.org compiko.info
findanysex.com custom-product-labels.com
finuse.com ddpills.com
forpackningsutveckling.se dear-diary.ru
fortwosmartcar.pw dfwu1019.info
forum69.info diegolopezcastan.com
franch.info diusyawiga.tk
free-social-buttons.xyz dogbreedspicture.net
freelifetimefuckbook.com dood.live
fxgallery.com dotnetdotcom.org
fyl.com.ru downloadeer.net
golmau.host.sk elektrischezigarette2.devhub.com
googlemare.com elektrozigaretten2.yn.lt
gosarhivrt.ru encodable.com
gq-catalog.gq eshop.md
graphid.com eugenevaultstorage.com
growshop.es exdocsfiles.com
gsou.cf factorynightclub.com
health-medical-portal.info faithe.top
helvetia.com.ua filkhbr.com
hermesbelts.xyz financeloan.us
hermesbirkinhandbagoutlets.com finstroy.net
fivedwld.cf
floridamobilebillboards.com
fototravel.eu
foxinsocks.ru
frivgame250.com
gael-s.ru
games.kolossale.ru
gateway.zscalertwo.net
gdzkurokam.ru
ge0ip.org
geilehausfrauen.net
getlamborghini.ga
go2jump.org
gogps.me
goosefishpost.bid
guidefs.ru
guruofcasino.com
hd-film.pl
headpharmacy.com
help.tpu.ru
hermesreplica.pw hermesreplica.pw
hitcpm.com horoshieokna.com
hobbyhuren24.net humanelydrew.com
hostnow.men images.gyffu.com
howlongdoestizanidinestayinyoursystem.blogspot.com inspiring-desperate.tk
hulfingtonpost.com instakink.com
hut1.ru iqoption.pro
imagecoolpub.com itronics.ca
impotentik.com iweblist.info
inboundlinks.win jeremyeaton.co
indiakino.net jetsli.de
japfm.com jofucipiku.tk
javspace.net jolic2.com
jerseywholesalechinabiz.com juliadiets.com
jrcigars.com justprofit.xyz
jyrxd.com kamorel.com
karadene.com karadene.com
kaz.kz kletkimehan.ru
kino-fun.ru kmd-pto.ru
kostenlos-sexvideos.com kountrylife.com
landoftracking.com kozhniebolezni.com
landscapebackgrounds.blogspot.com languagecode.com
likrot.com leftofcentrist.com
lirunet.ru ltvperf.com
liupis.com lutherstable.org
louboutinshoes.xyz m1media.net
makenahartlin.com mafa-free.com
managerpak204.weebly.com maglid.ru
masserect.com magnetpress.sk
matsdale.com manifestation.betteroffers.review
mearns-tractors.co.uk moesonce.com
methodsmarketing.com monitorwebsitespeed.com
mhi-systems.ru mosrif.ru
minharevisao.com mountainstream.ms
mlf.hordo.win mygameplus.ru
more-letom.ru myra.top
morf.snn.gr netpics.org
mozello.ru nicefloor.co.uk
music7s.me obiavo.kz
musicas.baixar-musicas-gratis.com ohmyrings.com
mycaf.it onlinadverts.com
mydirtystuff.com
myperiod.club
narosty.com
office2web.com
online-hit.info online-hit.info
origin-my.ru onlyporno.ru
pammik.ru parajumpersjakkesalgnorge.info
pateaswing.com pastaleads.com
pcimforum.com perfection-pleasure.ru
pdamods.ru pic-re.blogspot.com
phelissota.xyz pinkduck.ga
piccdata.com pisanieprac.info
pix24x7.com pk-services.ru
plastweb.ru plastgran.com
popup-hgd.xyz polcin.de
porno-chaman.info pornophoto.xyz
pornokorol.com pornoplen.com
priscilarodrigues.com.br pornosee.info
privatefx-in.ru proekt-mos.ru
profitfx.online
promalp-universal.ru
pronekut.com pronekut.com
pssucai.info r-control.ru
pussysaga.com razamicroelectronics.com
qexyfu.bugs3.com recinziireale.com
ranking2017.ga refererx.com
rcpmda.ikan1080.xyz registratciya-v-moskve.ru
rebuildermedical.com relayblog.com
reckonstat.info rennlist.com
remontvsamare.su replicaclub.ru
rewardpoll.com
rfd-split.hr
rialp.getenjoyment.net rialp.getenjoyment.net
rospromtest.ru riralmolamsaca.tk
royalcar-ufa.ru
royalvegascasino.com royalvegascasino.com
runofilms.ru roznica.com.ua
rusexy.xyz ru-mediaget.ru
scalerite.co.za s-forum.biz
scanner-george.top saecsa.co
scanner-irvin.top sanyuprojects.com
scanner-olga.top scanmyphones.com
se.bnt-team.com sdsjweb.com
searchkut.com seorankinglinks.com
senger.atspace.co.uk sexkontakte-seite.com
seomarketings.online sexpornotales.net
seoprofiler.com shemale-sex.net
sexkvartal.com shitting.pro
shemalegalls.blogporn.in shop.acim.org
shoppingjequiti.com.br simplepooltips.com
simplesite.com sitebeam.net
simply.net sitopreferito.it
sindragosa.comxa.com sivs.ru
site-speed-check.site skanninge.se
site3.free-share-buttons.com
skatestick.bid
slonechka.ru slonechka.ru
socialseet.ru soheavyblog.com
socialsignals24.com spasswelt.xyz
sosdepotdebilan.com sptslmtrafms.com
ssconstruction.co srdrvp.com
stanthonyscatholicchurch.org sstroy44.ru
star61.de stackthatbucks.com
stathat.com stop-gepatit.te.ua
statustroll.com stpicks.com
stevemonsen.com styro.ru
stopnarco.ru sudexpert66.ru
suchenindeutschland.com swiped.su
supermama.top theallgirlarcade.com
superstats.com thebluffs.com
tandvardshuset.net thepokertimer.com
tengohydar.tk theporndude.com
terrafootwear.us tizanidineandgabapentin.blogspot.com
thebestweightlosspills.ovh tizanidineformigraines.blogspot.com
thetardistimes.ovh tizanidinezanaflex.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com tobeyouday.win
top-deal.com.pl trubywriting.com
top10-online-games.com tube8.com
torrnada.ru
touchmods.fr
toys.erolove.in
traffictrade.life
traffpartners.com
trahvid.com
triplepanda.xyz
trudogolik.net
trustl.life
twinderbella.com
ugguk.online ugguk.online
umnovocaminho.com unece.org
v-doc.co ustion.ru
vektorpress.ru vduplo.ru
velen.io venta-prom.ru
videonsk.com videooko.weebly.com
videtubs.pl visa-china.ru
vilingstore.net voloslove.ru
vip-dom.in vsexkontakte.net
vod.com.ua wdfdocando.com
vostoktrade.info we-are-gamers.com
vpnmouse.com webnode.me
vykupavto-krasnodar.ru
watchinf.com
webix.biz
webshoppermac.com webshoppermac.com
website-datenbank.de wetgames.ru
whatsappbot.flyland.ru whipme.yopoint.in
wildnatureimages.com wholesalecheapjerseysfree.com
witclub.info wholesalenfljerseys.us.com
wineitudes.wordpress.com
witherrom55.eklablog.fr witherrom55.eklablog.fr
withstandingheartwarming.com wyniki-lista.pl
wnhjavlhezp.gq x-diesel.org
womensterritory.ru xaylapdiendanang.com
www.jbetting.com
xchangetrak.com xchangetrak.com
xn----7sbaphztdjeboffeiof6c.xn--p1ai xev.ru
xn----9sbubg3ambdfl1j.xn--p1ai xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
xportvusbdriver8i.snack.ws xn----7sbifcamovvfggw9d.xn--p1ai
xsfetish.org xsion.net
xwatt.ru xxxtube69.com
xxx-cam.webcam yourothersite.com
youghbould.wordpress.com zeroredirect10.com
zaapplesales.blogspot.com zetgie.com.pl
zapatosenventa.info zootravel.com
zarenica.net zscalerone.net
zoogdinsney.com
zophim.me

12
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,21 +1,11 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html> ml><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.151 0; 10.1.1.59 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:49 UTC 2021 ### Updated: Thu Nov 25 07:24:16 UTC 2021
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.11.2734 ### Version: V4.2021.11.2735
### Updated: Thu Nov 25 02:53:49 UTC 2021 ### Updated: Thu Nov 25 07:24:16 UTC 2021
### Bad Bot Count: 629 ### Bad Bot Count: 629
################################################### ###################################################
### Version Information ## ### Version Information ##