vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.08.2508 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-08-07 11:07:02 +00:00
parent f43636830a
commit 89e4dbdc90
56 changed files with 1167 additions and 1095 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2507 #### Version: V4.2021.08.2508
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,8 +4,8 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.08.2507 #### Version: V4.2021.08.2508
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -11,8 +11,8 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.08.2507 #### Version: V4.2021.08.2508
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

9
_generator_lists/bad-referrers.list
View file

@ -1,7 +1,3 @@
perfectplanned.com
lionking-1994.blogspot.com
pic-re.blogspot.com
track.deriv.com
000free.us 000free.us
007angels.com 007angels.com
00author.com 00author.com
@ -3498,6 +3494,7 @@ lion.conboy.us
lion.misba.us lion.misba.us
lion.playtap.us lion.playtap.us
lion.snapmap.us lion.snapmap.us
lionking-1994.blogspot.com
liquimondo.com liquimondo.com
liran-locks.com liran-locks.com
lirunet.ru lirunet.ru
@ -4463,6 +4460,7 @@ pepperstyle.ru
percin.biz.ly percin.biz.ly
perederni.net perederni.net
perfection-pleasure.ru perfection-pleasure.ru
perfectplanned.com
perfectpracticeweb.com perfectpracticeweb.com
perl.dp.ua perl.dp.ua
perm-profnastil.ru perm-profnastil.ru
@ -6092,6 +6090,7 @@ tozup.com
tpu.ru tpu.ru
tracfone.com tracfone.com
track-rankings.online track-rankings.online
track.deriv.com
track112.site track112.site
track2.shop track2.shop
tracklead.net tracklead.net
@ -7076,4 +7075,4 @@ zygophyceous.womanstars.site
zynax.ua zynax.ua
zytpirwai.net zytpirwai.net
zzbroya.com.ua zzbroya.com.ua
zzlgxh.com zzlgxh.com

4
_google_analytics_ghost_spam/README.md
View file

@ -3,8 +3,8 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.08.2507 #### Version: V4.2021.08.2508
#### Bad Referrers Blocked: [7074](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7077](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [618](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

2
_google_analytics_ghost_spam/google-exclude-03.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-04.txt
View file

File diff suppressed because one or more lines are too long

2
_google_analytics_ghost_spam/google-exclude-05.txt
View file

File diff suppressed because one or more lines are too long

3
_google_webmaster_disavow_links/google-disavow.txt
View file

@ -3494,6 +3494,7 @@ domain:lion.conboy.us
domain:lion.misba.us domain:lion.misba.us
domain:lion.playtap.us domain:lion.playtap.us
domain:lion.snapmap.us domain:lion.snapmap.us
domain:lionking-1994.blogspot.com
domain:liquimondo.com domain:liquimondo.com
domain:liran-locks.com domain:liran-locks.com
domain:lirunet.ru domain:lirunet.ru
@ -4459,6 +4460,7 @@ domain:pepperstyle.ru
domain:percin.biz.ly domain:percin.biz.ly
domain:perederni.net domain:perederni.net
domain:perfection-pleasure.ru domain:perfection-pleasure.ru
domain:perfectplanned.com
domain:perfectpracticeweb.com domain:perfectpracticeweb.com
domain:perl.dp.ua domain:perl.dp.ua
domain:perm-profnastil.ru domain:perm-profnastil.ru
@ -6088,6 +6090,7 @@ domain:tozup.com
domain:tpu.ru domain:tpu.ru
domain:tracfone.com domain:tracfone.com
domain:track-rankings.online domain:track-rankings.online
domain:track.deriv.com
domain:track112.site domain:track112.site
domain:track2.shop domain:track2.shop
domain:tracklead.net domain:tracklead.net

9
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

9
conf.d/globalblacklist-testing-version.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

9
conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

9
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/beta_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3541,6 +3541,7 @@
"~*(?:\b)lion\.misba\.us(?:\b)" 0; "~*(?:\b)lion\.misba\.us(?:\b)" 0;
"~*(?:\b)lion\.playtap\.us(?:\b)" 0; "~*(?:\b)lion\.playtap\.us(?:\b)" 0;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 0; "~*(?:\b)lion\.snapmap\.us(?:\b)" 0;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 0;
"~*(?:\b)liquimondo\.com(?:\b)" 0; "~*(?:\b)liquimondo\.com(?:\b)" 0;
"~*(?:\b)liran\-locks\.com(?:\b)" 0; "~*(?:\b)liran\-locks\.com(?:\b)" 0;
"~*(?:\b)lirunet\.ru(?:\b)" 0; "~*(?:\b)lirunet\.ru(?:\b)" 0;
@ -4506,6 +4507,7 @@
"~*(?:\b)percin\.biz\.ly(?:\b)" 0; "~*(?:\b)percin\.biz\.ly(?:\b)" 0;
"~*(?:\b)perederni\.net(?:\b)" 0; "~*(?:\b)perederni\.net(?:\b)" 0;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0;
"~*(?:\b)perfectplanned\.com(?:\b)" 0;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 0; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 0;
"~*(?:\b)perl\.dp\.ua(?:\b)" 0; "~*(?:\b)perl\.dp\.ua(?:\b)" 0;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 0; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 0;
@ -6135,6 +6137,7 @@
"~*(?:\b)tpu\.ru(?:\b)" 0; "~*(?:\b)tpu\.ru(?:\b)" 0;
"~*(?:\b)tracfone\.com(?:\b)" 0; "~*(?:\b)tracfone\.com(?:\b)" 0;
"~*(?:\b)track\-rankings\.online(?:\b)" 0; "~*(?:\b)track\-rankings\.online(?:\b)" 0;
"~*(?:\b)track\.deriv\.com(?:\b)" 0;
"~*(?:\b)track112\.site(?:\b)" 0; "~*(?:\b)track112\.site(?:\b)" 0;
"~*(?:\b)track2\.shop(?:\b)" 0; "~*(?:\b)track2\.shop(?:\b)" 0;
"~*(?:\b)tracklead\.net(?:\b)" 0; "~*(?:\b)tracklead\.net(?:\b)" 0;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2507 2508

9
dev-tools/globalblacklist-testing.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2021.08.2507 ### Version: V3.2021.08.2508
### Updated: Sat Aug 7 10:03:16 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

9
dev-tools/globalblacklist.template
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

3
dev-tools/referrers-regex-format-whitelist-test.txt
View file

@ -3494,6 +3494,7 @@
"~*(?:\b)lion\.misba\.us(?:\b)" 0; "~*(?:\b)lion\.misba\.us(?:\b)" 0;
"~*(?:\b)lion\.playtap\.us(?:\b)" 0; "~*(?:\b)lion\.playtap\.us(?:\b)" 0;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 0; "~*(?:\b)lion\.snapmap\.us(?:\b)" 0;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 0;
"~*(?:\b)liquimondo\.com(?:\b)" 0; "~*(?:\b)liquimondo\.com(?:\b)" 0;
"~*(?:\b)liran\-locks\.com(?:\b)" 0; "~*(?:\b)liran\-locks\.com(?:\b)" 0;
"~*(?:\b)lirunet\.ru(?:\b)" 0; "~*(?:\b)lirunet\.ru(?:\b)" 0;
@ -4459,6 +4460,7 @@
"~*(?:\b)percin\.biz\.ly(?:\b)" 0; "~*(?:\b)percin\.biz\.ly(?:\b)" 0;
"~*(?:\b)perederni\.net(?:\b)" 0; "~*(?:\b)perederni\.net(?:\b)" 0;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0;
"~*(?:\b)perfectplanned\.com(?:\b)" 0;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 0; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 0;
"~*(?:\b)perl\.dp\.ua(?:\b)" 0; "~*(?:\b)perl\.dp\.ua(?:\b)" 0;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 0; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 0;
@ -6088,6 +6090,7 @@
"~*(?:\b)tpu\.ru(?:\b)" 0; "~*(?:\b)tpu\.ru(?:\b)" 0;
"~*(?:\b)tracfone\.com(?:\b)" 0; "~*(?:\b)tracfone\.com(?:\b)" 0;
"~*(?:\b)track\-rankings\.online(?:\b)" 0; "~*(?:\b)track\-rankings\.online(?:\b)" 0;
"~*(?:\b)track\.deriv\.com(?:\b)" 0;
"~*(?:\b)track112\.site(?:\b)" 0; "~*(?:\b)track112\.site(?:\b)" 0;
"~*(?:\b)track2\.shop(?:\b)" 0; "~*(?:\b)track2\.shop(?:\b)" 0;
"~*(?:\b)tracklead\.net(?:\b)" 0; "~*(?:\b)tracklead\.net(?:\b)" 0;

3
dev-tools/referrers-regex-format.txt
View file

@ -3494,6 +3494,7 @@
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -4459,6 +4460,7 @@
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -6090,6 +6092,7 @@
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.43.228.26 0; 20.191.70.3 0;

9
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/test1_conf_files_whitelist/bots.d/custom-bad-referrers.conf
View file

@ -3541,6 +3541,7 @@
"~*(?:\b)lion\.misba\.us(?:\b)" 0; "~*(?:\b)lion\.misba\.us(?:\b)" 0;
"~*(?:\b)lion\.playtap\.us(?:\b)" 0; "~*(?:\b)lion\.playtap\.us(?:\b)" 0;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 0; "~*(?:\b)lion\.snapmap\.us(?:\b)" 0;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 0;
"~*(?:\b)liquimondo\.com(?:\b)" 0; "~*(?:\b)liquimondo\.com(?:\b)" 0;
"~*(?:\b)liran\-locks\.com(?:\b)" 0; "~*(?:\b)liran\-locks\.com(?:\b)" 0;
"~*(?:\b)lirunet\.ru(?:\b)" 0; "~*(?:\b)lirunet\.ru(?:\b)" 0;
@ -4506,6 +4507,7 @@
"~*(?:\b)percin\.biz\.ly(?:\b)" 0; "~*(?:\b)percin\.biz\.ly(?:\b)" 0;
"~*(?:\b)perederni\.net(?:\b)" 0; "~*(?:\b)perederni\.net(?:\b)" 0;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0;
"~*(?:\b)perfectplanned\.com(?:\b)" 0;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 0; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 0;
"~*(?:\b)perl\.dp\.ua(?:\b)" 0; "~*(?:\b)perl\.dp\.ua(?:\b)" 0;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 0; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 0;
@ -6135,6 +6137,7 @@
"~*(?:\b)tpu\.ru(?:\b)" 0; "~*(?:\b)tpu\.ru(?:\b)" 0;
"~*(?:\b)tracfone\.com(?:\b)" 0; "~*(?:\b)tracfone\.com(?:\b)" 0;
"~*(?:\b)track\-rankings\.online(?:\b)" 0; "~*(?:\b)track\-rankings\.online(?:\b)" 0;
"~*(?:\b)track\.deriv\.com(?:\b)" 0;
"~*(?:\b)track112\.site(?:\b)" 0; "~*(?:\b)track112\.site(?:\b)" 0;
"~*(?:\b)track2\.shop(?:\b)" 0; "~*(?:\b)track2\.shop(?:\b)" 0;
"~*(?:\b)tracklead\.net(?:\b)" 0; "~*(?:\b)tracklead\.net(?:\b)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

9
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.43.228.26 0; 20.191.70.3 0;

9
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
104.43.228.26 0; 20.191.70.3 0;

9
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,9 +4,9 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:15 UTC 2021 ### Updated: Sat Aug 7 11:01:16 UTC 2021
### Bad Referrer Count: 7074 ### Bad Referrer Count: 7077
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### VERSION INFORMATION ## ### VERSION INFORMATION ##
@ -4541,6 +4541,7 @@ map $http_referer $bad_referer {
"~*(?:\b)lion\.misba\.us(?:\b)" 1; "~*(?:\b)lion\.misba\.us(?:\b)" 1;
"~*(?:\b)lion\.playtap\.us(?:\b)" 1; "~*(?:\b)lion\.playtap\.us(?:\b)" 1;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 1; "~*(?:\b)lion\.snapmap\.us(?:\b)" 1;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 1;
"~*(?:\b)liquimondo\.com(?:\b)" 1; "~*(?:\b)liquimondo\.com(?:\b)" 1;
"~*(?:\b)liran\-locks\.com(?:\b)" 1; "~*(?:\b)liran\-locks\.com(?:\b)" 1;
"~*(?:\b)lirunet\.ru(?:\b)" 1; "~*(?:\b)lirunet\.ru(?:\b)" 1;
@ -5506,6 +5507,7 @@ map $http_referer $bad_referer {
"~*(?:\b)percin\.biz\.ly(?:\b)" 1; "~*(?:\b)percin\.biz\.ly(?:\b)" 1;
"~*(?:\b)perederni\.net(?:\b)" 1; "~*(?:\b)perederni\.net(?:\b)" 1;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 1;
"~*(?:\b)perfectplanned\.com(?:\b)" 1;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 1; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 1;
"~*(?:\b)perl\.dp\.ua(?:\b)" 1; "~*(?:\b)perl\.dp\.ua(?:\b)" 1;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 1; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 1;
@ -7137,6 +7139,7 @@ map $http_referer $bad_referer {
"~*(?:\b)track112\.site(?:\b)" 1; "~*(?:\b)track112\.site(?:\b)" 1;
"~*(?:\b)track2\.shop(?:\b)" 1; "~*(?:\b)track2\.shop(?:\b)" 1;
"~*(?:\b)track\-rankings\.online(?:\b)" 1; "~*(?:\b)track\-rankings\.online(?:\b)" 1;
"~*(?:\b)track\.deriv\.com(?:\b)" 1;
"~*(?:\b)tracklead\.net(?:\b)" 1; "~*(?:\b)tracklead\.net(?:\b)" 1;
"~*(?:\b)trackmedia101\.com(?:\b)" 1; "~*(?:\b)trackmedia101\.com(?:\b)" 1;
"~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1; "~*(?:\b)tracksurf\.daooda\.com(?:\b)" 1;

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 1; 10.1.0.92 1;
127.0.0.1 1; 127.0.0.1 1;

3
dev-tools/test_units/custom-bad-referrers.conf
View file

@ -3541,6 +3541,7 @@
"~*(?:\b)lion\.misba\.us(?:\b)" 0; "~*(?:\b)lion\.misba\.us(?:\b)" 0;
"~*(?:\b)lion\.playtap\.us(?:\b)" 0; "~*(?:\b)lion\.playtap\.us(?:\b)" 0;
"~*(?:\b)lion\.snapmap\.us(?:\b)" 0; "~*(?:\b)lion\.snapmap\.us(?:\b)" 0;
"~*(?:\b)lionking\-1994\.blogspot\.com(?:\b)" 0;
"~*(?:\b)liquimondo\.com(?:\b)" 0; "~*(?:\b)liquimondo\.com(?:\b)" 0;
"~*(?:\b)liran\-locks\.com(?:\b)" 0; "~*(?:\b)liran\-locks\.com(?:\b)" 0;
"~*(?:\b)lirunet\.ru(?:\b)" 0; "~*(?:\b)lirunet\.ru(?:\b)" 0;
@ -4506,6 +4507,7 @@
"~*(?:\b)percin\.biz\.ly(?:\b)" 0; "~*(?:\b)percin\.biz\.ly(?:\b)" 0;
"~*(?:\b)perederni\.net(?:\b)" 0; "~*(?:\b)perederni\.net(?:\b)" 0;
"~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0; "~*(?:\b)perfection\-pleasure\.ru(?:\b)" 0;
"~*(?:\b)perfectplanned\.com(?:\b)" 0;
"~*(?:\b)perfectpracticeweb\.com(?:\b)" 0; "~*(?:\b)perfectpracticeweb\.com(?:\b)" 0;
"~*(?:\b)perl\.dp\.ua(?:\b)" 0; "~*(?:\b)perl\.dp\.ua(?:\b)" 0;
"~*(?:\b)perm\-profnastil\.ru(?:\b)" 0; "~*(?:\b)perm\-profnastil\.ru(?:\b)" 0;
@ -6135,6 +6137,7 @@
"~*(?:\b)tpu\.ru(?:\b)" 0; "~*(?:\b)tpu\.ru(?:\b)" 0;
"~*(?:\b)tracfone\.com(?:\b)" 0; "~*(?:\b)tracfone\.com(?:\b)" 0;
"~*(?:\b)track\-rankings\.online(?:\b)" 0; "~*(?:\b)track\-rankings\.online(?:\b)" 0;
"~*(?:\b)track\.deriv\.com(?:\b)" 0;
"~*(?:\b)track112\.site(?:\b)" 0; "~*(?:\b)track112\.site(?:\b)" 0;
"~*(?:\b)track2\.shop(?:\b)" 0; "~*(?:\b)track2\.shop(?:\b)" 0;
"~*(?:\b)tracklead\.net(?:\b)" 0; "~*(?:\b)tracklead\.net(?:\b)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Dispatch Boardreader
GrabNet BotALot
Iria Meanpathbot
Kenjin Spider SBIder
Metauri Scanbot
NetAnts Twice
SlySearch WallpapersHD
Sociscraper Whatweb
WiseGuys Robot check1.exe
crawler4j sitechecker.pro

272
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
ADmantX 80legs
ALittle Client Aboundexbot
ASPSeek
Abonti
Acunetix Acunetix
AhrefsBot AfD-Verbotsverfahren
Alexibot
AllSubmitter AllSubmitter
AlphaBot AlphaBot
Anarchie
Anarchy99 Anarchy99
Anthill Anthill
Apexoo Apexoo
Asterias Asterias
AwarioSmartBot AwarioRssBot
BLEXBot BDCbot
BackDoorBot BDFetch
BackStreet
BackWeb BackWeb
Badass Badass
Bandit
Barkrowler Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bigfoot
Bitacle Bitacle
Black Hole Black Hole
BlackWidow
Blackboard Blackboard
Blow
BlowFish
Bolt Bolt
Brandprotect Brandprotect
Brandwatch Buddy
Bullseye BuzzSumo
CCBot
CODE87
CazoodleBot
Cegbfeieh
Chlooe Chlooe
Cogentbot Claritybot
Copyscape Copier
CrazyWebCrawler CopyRightCheck
DSearch CrunchBot
DataCha0s Custo
DatabaseDriverMysqli CyotekWebCopy
DTS Agent
Demon
Digincore
DigitalPebble DigitalPebble
Discobot Discobot
DittoSpyder DittoSpyder
DnyzBot DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot Dotbot
Download Wonder Download Wonder
Drip ECCP/1.0
EasyDL EasyDL
Ecxi Ebingbong
EroCrawler EirGrabber
Evil
Express WebPictures
ExtLinksBot
Extractor Extractor
EyeNetIE Extreme Picture Finder
FDM
Fimap
Firefox/7.0 Firefox/7.0
Flunky Flunky
Foobot Foobot
Freeuploader
FrontPage FrontPage
Fuzz Fuzz
GalaxyBot Fyrebot
Gigablast
Gigabot Gigabot
Go!Zilla Go!Zilla
GoZilla Go-Ahead-Got-It
Gotit GrabNet
Grafula Grabber
GrapeshotCrawler GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HMView
HTMLparser
HTTrack HTTrack
HaosouSpider Harvest
Heritrix Heritrix
Hloader Humanlinks
IDBot IRLbot
Iblog Iblog
Id-search
IlseBot IlseBot
Indy Library
InfoTekies InfoTekies
Intelliseek InterGET
InternetSeer Iria
JamesBOT
JennyBot JennyBot
JetCar
Joomla
Jorgee Jorgee
Kenjin Spider Kinza
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple LWP::Simple
Larbin Lanshanbot
LeechGet LeechGet
LexiBot Libwhisker
Lftp
Lightspeedsystems
Likse Likse
LinkWalker
Linkdexbot
LinkextractorPro
LinksManager LinksManager
LinqiaRSSBot Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MJ12bot
MIIxpc
Mag-Net
Majestic SEO Majestic SEO
Mata Hari MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru
Metauri Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX Mister PiX
Moblie Safari
Mojeek Mojeek
Morfeus Fucking Scanner Mojolicious
Msrabot Mozlila
Musobot Musobot
Nameprotect Navroad
NearSite
Net Vampire Net Vampire
NetLyzer NetAnts
NetZIP NetMechanic
NetSpider
Netvibes Netvibes
Nibbler Nibbler
Niki-bot
Nikto Nikto
Nutch Nmap
Openfind Openfind
Openvas
OrangeBot OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PageScorer PageScorer
PageThing.com Pandalytics
Pavuk Pavuk
Petalbot Petalbot
Pu_iN Pixray
PleaseCrawl
ProWebWalker
Probethenet
Pump Pump
PxBroker
Quick-Crawler
RSSingBot
RankActive RankActive
RankingBot RankingBot
RankingBot2
Rankivabot Rankivabot
RankurBot
Re-re Re-re
ReGet Recorder
RealDownload
Reaper
RepoMonkey
Ripper Ripper
Rogerbot SBIder
SMTBot SEOprofiler
SISTRIX
SalesIntelligent SalesIntelligent
ScanAlert ScanAlert
ScoutJet ScoutJet
Scrapy Searchestate
Screaming SearchmetricsBot
Semrush Semrush
SentiBot
SeoSiteCheckup SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
Sitebeam
Sitevigil
SlySearch SlySearch
SmartDownload SmartDownload
Snake
Snoopy Snoopy
Sociscraper SocialRankIOBot
Sogou web spider
SpaceBison SpaceBison
SpankBot Spammen
Spinn3r
SputnikBot
Sqlmap Sqlmap
Steeler Sqworm
SuperBot Stripper
SurveyBot Sucker
TeleportPro Szukacz
The Intraformant Teleport
Telesoft
Telesphoreo
Telesphorep
Thumbor Thumbor
Tracemyfile Toata
Trendiction Toweyabot
Trendictionbot
True_Robot True_Robot
Turingos
TurnitinBot
TwengaBot TwengaBot
Twice Twice
UnisterBot URLy Warning
URLy.Warning
Upflow
V-BOT
VCI VCI
Vacuum Vacuum
Vagabondo VidibleScraper
VelenPublicWebCrawler
VoidEYE VoidEYE
Voil Voil
Voltron Voltron
WBSearchBot WASALive-Bot
WISENutbot WEBDAV
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
Web Auto WeSEE
Web Enhancer Web Fetch
WebAuto Web Fuck
WebCollage Web Sauger
WebCopier Web Sucker
WebEnhancer WebBandit
WebFetch WebFetch
WebGo IS WebFuck
WebLeacher WebPix
WebReaper WebReaper
WebSauger WebSauger
WebSucker
WebWhacker WebWhacker
Website Quester Webshag
Whack Whacker
WinHTTrack WinHTTrack
Wotbox Woobot
Wprecon YoudaoBot
Xaldon WebSpider Zade
Zermelo Zermelo
Zitebot Zitebot
ZmEu
archive.org_bot archive.org_bot
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider
backlink-check
coccocbot-web coccocbot-web
crawl.sogou.com
demandbase-bot demandbase-bot
domainsproject.org
eCatch eCatch
evc-batch evc-batch
facebookscraper facebookscraper
heritrix gopher
instabid instabid
ips-agent
isitwp.com
lwp-request lwp-request
lwp-trivial mediawords
magpie-crawler netEstate NE Crawler
oBot oBot
page scorer
pcBrowser pcBrowser
polaris version
satoristudio.net
scalaj-http
scan.lol scan.lol
seobility seobility
seostar seostar
serpstatbot serpstatbot
sexsearcher sitechecker.pro
sogouspider webmeup-crawler
sysscan x09Mozilla
trendiction.de xpymep1.exe
x22Mozilla
zgrab zgrab

284
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 80legs
ALittle Client ADmantX
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
AhrefsBot
AiHitBot AiHitBot
Aipbot Alexibot
AllSubmitter
Alligator Alligator
AlphaBot
Anarchie Anarchie
Ankit Anarchy
Anthill
Aspiegel Aspiegel
Attach Attach
AwarioSmartBot AwarioSmartBot
BBBike
BLEXBot BLEXBot
BackDoorBot BackWeb
BacklinkCrawler BacklinkCrawler
Badass
Barkrowler Barkrowler
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bigfoot Bigfoot
Bitacle
BlackWidow BlackWidow
BlowFish Boardreader
Bolt Bolt
BotALot
Brandwatch
Buck Buck
BuiltBotTough BuzzSumo
Bullseye
CATExplorador CATExplorador
CCBot CCBot
Calculon CODE87
CazoodleBot Cegbfeieh
ChinaClaw CheeseBot
Chlooe CherryPicker
Cogentbot Claritybot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
CrazyWebCrawler
CrunchBot
Custo Custo
CyotekWebCopy
DIIbot
DSearch DSearch
DTS Agent
Deusu
Devil Devil
Digincore DigitalPebble
Dirbuster
Disco
Discoverybot Discoverybot
DittoSpyder
DnyzBot
DomainAppender DomainAppender
DomainCrawler Dotbot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder Download Wonder
Dragonfly ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf
Ecxi
EroCrawler EroCrawler
Express WebPictures Evil
ExtractorPro ExtractorPro
Firefox/7.0 Ezooms
Freeuploader FHscan
FlashGet
FrontPage
Fuzz Fuzz
FyberSpider
Fyrebot Fyrebot
G-i-g-a-b-o-t GT::WWW
GermCrawler GermCrawler
Getintent Getintent
Go-Ahead-Got-It Gigablast
Gotit GoZilla
GrapeshotCrawler GrabNet
HEADMasterSEO GrapeFX
Haansoft
HaosouSpider HaosouSpider
Harvest Harvest
Heritrix Hloader
Humanlinks HybridBot
IDBTE4M Id-search
Iblog
IlseBot IlseBot
Image Fetch
IndeedBot IndeedBot
Indy Library
Intelliseek Intelliseek
InterGET InternetSeer
Iria
Iskanie Iskanie
IstellaBot IstellaBot
Jbrofuzz
JetCar JetCar
Joomla Jorgee
Kozmosbot Jyxobot
Kenjin Spider
LNSpiderguy LNSpiderguy
Larbin Lanshanbot
Leap
LeechFTP
LeechGet LeechGet
LibWeb LexiBot
LieBaoFast Likse
LinkWalker
Linkbot Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Litemage_walker LinqiaScrapeBot
Lmspider Lipperhey
Ltx71 Lipperhey Spider
MFC_Tear_Sample MSIECrawler
MIDown tool Majestic SEO
MJ12bot
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
Mass Downloader Mass Downloader
MauiBot MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Meanpathbot
Metauri MegaIndex.ru
Microsoft Data Access Microsoft URL Control
Mister PiX
Moblie Safari Moblie Safari
Mojeek Mojeek
Mojolicious Msrabot
Musobot
NPbot NPbot
Nameprotect
NearSite
Needle
Nessus
NetAnts NetAnts
NetZIP NetMechanic
Netcraft
Nettrack
Netvibes Netvibes
Niki-bot NextGenSearchBot
Nimbostratus Nimbostratus
OnCrawl Nuclei
OpenLinkProfiler Offline Explorer
Openfind Offline Navigator
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer PageScorer
PeoplePal Petalbot
PictureFinder Picsearch
Piepmatz Pimonster
Pixray ProPowerBot
Probethenet
Psbot
Pump Pump
PxBroker PxBroker
QueryN Metasearch QueryN Metasearch
RankActive
RankFlex RankFlex
RankingBot RankingBot
Rankivabot
ReGet ReGet
RealDownload
RebelMouse RebelMouse
RepoMonkey RocketCrawler
SEOkicks Rogerbot
SEOkicks-Robot SBIder
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SISTRIX
SEOstats SMTBot
SalesIntelligent
ScanAlert ScanAlert
ScoutJet ScrepyBot
Screaming
ScreenerBot
SearchmetricsBot SearchmetricsBot
Semrush Siphon
SentiBot
SeobilityBot
Seomoz
Site Sucker Site Sucker
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SmartDownload SiteLockSpider
Snapbot Sitebeam
Snoopy SlySearch
SocialRankIOBot Snake
Sosospider Spammen
Spanner Spanner
Sqlmap
Sqlworm Sqlworm
Stripper Sqworm
Steeler
Sucuri
SuperBot SuperBot
SuperHTTP SuperHTTP
Surfbot
SurveyBot SurveyBot
Suzuran
TeleportPro TeleportPro
Telesphorep Telesphorep
Titan
Toata
Tracemyfile Tracemyfile
Trendiction
Trendictionbot
True_Robot True_Robot
Typhoeus Turnitin
URLy.Warning TwengaBot
V-BOT UnisterBot
Upflow
VCI
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie
VoidEYE VoidEYE
Voltron WBSearchBot
WPScan WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers Wallpapers
WallpapersHD Wallpapers/3.0
Web Auto Web Auto
Web Collage Web Collage
Web Enhancer
Web Fetch Web Fetch
WebAuto Web Sucker
WebCollage WebEnhancer
WebCopier WebImageCollector
WebFetch WebLeacher
WebPix WebPix
WebReaper WebReaper
WebStripper
WebWhacker WebWhacker
Webalta
WebmasterWorldForumBot
Webshag Webshag
Website Quester Website Quester
WebsiteExtractor Whack
Widow Whacker
WiseGuys Robot Whatweb
Xenu Wprecon
Zade Zade
Zauba
Zermelo Zermelo
Zitebot Zeus
ZmEu ZmEu
ZoomBot
ZyBorg
archive.org_bot archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider autoemailspider
coccocbot-web crawler.feedback
cognitiveseo
com.plumanalytics
demandbase-bot demandbase-bot
eCatch
evc-batch
facebookscraper facebookscraper
heritrix
ips-agent ips-agent
isitwp.com
lwp-request lwp-request
netEstate NE Crawler lwp-trivial
oBot magpie-crawler
page scorer meanpathbot
probe-image-size mediawords
muhstik-scan
plumanalytics
s1z.ru
scan.lol scan.lol
serpstatbot seobility
seostar
sexsearcher sexsearcher
sitechecker.pro sitechecker.pro
siteripz siteripz
tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com voyagerx.com
x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
elektrischezigarette1.blog.pl 2drittel.de
fz139.ttk.ru docstoc.com
glass-msk.ru elektir.ru
gsasearchengineranker.site naj-filmy24.pl
lunchrock.co putevka24.ru
morlat.altervista.org remedyotc.com
pastaleads.com remont-ustanovka-tehniki.ru
pc-services.ru whatistizanidinehclusedfor.blogspot.com
sitiz.club xn----9sbebi2bvzr7h.xn--p1ai
td-l-market.ru zscaler.net

944
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us 0daymusic.org
0912701309f8ce.com
1-free-share-buttons.com
1000n1.ru
1001watch.com.ua 1001watch.com.ua
101billion.com 123any.com
1314dh.com 1314dh.com
1adult.com
1j7740kd.website 1j7740kd.website
1kinobig.ru 2daytrendingnews.com
20pascals.nl 2kata.ru
24x7-server-support.site 3-letter-domains.net
2girls1cup-free.com 3w24.com
2x2fan.ru 72-news.com
40cg.com a96527gi.beget.tech
4k-player.pl abcguru.xyz
5-steps-to-start-business.com actices.com
999webdesign.com ad-words.ru
aaronabel.com adclickservice.com
acads.net addtoadd.men
adbetclickin.pink adloads.net
adpremium.org adman.se
adzerg.com adssafeprotected.com
akuhni.by adultgalls.com
alevinefesleri.com adviceforum.info
alkoravto.ru advocatemsk.ru
allblogroll.com afftrack001.com
allsilver925.co.il afmuseum.com
amt-k.ru aimayangzhi.com
anabolics.shop airlandsea.info
ananumous.ru aksonural.ru
androids-store.com aktivator-windows10.blogspot.com
animal-drawings.com alibestsale.com
anlimebel.kiev.ua allwidewallpapers.com
apartment.ru alphaforum.ru
apibatbrowsecom-a.akamaihd.net alvtank.se
apilinkswiftco-a.akamaihd.net amazingninja.com
apiluckyleapnet-a.akamaihd.net amazon-seo-service.com
appearance-cool.com ameblo.jp
approvedlocal.co.za angigreene.com
arius.tech angkortours.vn
artpicso.com apibrowsesmartne-a.akamaihd.net
aruplighting.com apishops.ru
asseenontv.ru appfixing.space
aviav.eu appleid-verification.com
aviav.org arabgirls.adultgalls.com
avkzarabotok.info asseenontvonline.ru
australia-opening-times.com
autotrends.today
avon-novosib.ru avon-novosib.ru
avon-ukraine.com avramstroy.ru
avto-oligarh.ru axbocz.net
babyfactory.fr ayeartoforget.com
backlink4u.net b00kmarks.com
bannerspace.com b2b-lounge.com
bannerswap.com babyguns.ru
basedecor.ru baikaleminer.com
battlecarnival.su banki76.ru
beatifullandscape.co bannerads.de
bensbargains.net belinka.com.ua
bestbuy.ca beremenyashka.com
bestmobilityscooterstoday.com bestdraws.com
bestofpicture.com bestimagecoollibrary.com
bestpornuha.com bet365.com
bestprofits-there.com bharatdefencekavach.com
betterhdporn.com bin-brokers.com
bidbuy.co.kr blackwitchcraft.ru
binomo.com blog.yam.com
biocn.dx.am bloggen.be
bird1.ru bloglag.com
biznesluxe.ru bobinoz.com
blockety.co
blog.remote-computer.de
blogqpot.com
blpmovies.com
bluerobot.info
bluesalt.co
boc.kz boc.kz
bongacams.com brainsandeggs.blogspot.com
bradleylive.xyz
briomotor.co briomotor.co
bronzeaid-a.akamaihd.net brus.city
budilneg.xyz btc4u.ru
bumascloset.com buchananshardware.com
bumble.cheapwebsitehoster.com buzz-porno.info
buron.pw c-gainsbourg.com
buytizanidineonlinenoprescription.blogspot.com calvet.altervista.org
bvlgariring.xyz candlehandmade.com
bycontext.com carabela.com.do
cacheimages.com carloans.com
candelluxsklep.pl castingbank.ru
cannibalcheerleader.com caveavins.fr
cardiosport.com.ua ccjp.eu
carmuffler.net chastnoeporno.com
cartierbracelet.xyz cheapcigarettesc.info
cartierlove.xyz checkm8.com
cartujano-pre.de chocolateslim-original.com
ccbill.com citizenclsdriveri7.pen.io
censys.io compliance-barak.xyz
cerev.info
changde.58.com
charmstroy.info
cheapbarbour.online
check-host.net
checktext.org
chidporn.com
chimiver.info
cialgenisrx.com
clickcash.com
clipartnew.com
clksite.com
comeondog.info
compliance-donald.xyz
compliance-fred.top
compliance-george.xyz compliance-george.xyz
compliance-jessica.top compliance-john.top
construmac.com.mx computernetworksonline.com
contentsexpress.com concealthyself.com
cookie-law-enforcement-aa.xyz connectingsingles.com
coop-gamers.ru contentlook.co
copenergo.ru cougfan.info
counter.bloke.com cpajunkies.com
creams.makeforum.eu crirussian.ru
credit-respect.ru culturevie.info
credit.co.ua customchocolate.business-for-home.com
customboxes4less.com cxpromote.com
customcatchcan.com cyprusbuyproperties.com
customsua.com.ua d-black.bz
czeshop.info dafatiri.com
daisye.top darodar.com
darkbooks.org dating-app.ru
date-withme.com dayibiao.com
daymusam.com decoratinghomes.ga
ddlmega.net descargar-musica-gratis.net
dev.citetick.com detmebel.su
dev33.dioniqlabb.se dev78.dioniqlabb.se
digital-sale.su dfwu1019.info
dipstar.org dieswaene.com
dirtpics.pw digest-project.ru
dneprsvet.com.ua digitalfaq.com
documentsite.net discovertreasure-a.akamaihd.net
discovertreasurenow.com
djihispano.com
dogsrun.net dogsrun.net
dolohen.com domaineaneblanc.com
domain.webkeyit.com domznaniy.ru
domainroam.win download-of-the-warez.blogspot.com
dorratex.tn downloaddy.net
dprtb.com downloads-whatsapp.com
dtnlyss.com drugstoreforyou.com
e-collantes.com dtm-spain.com
ed-shop01.ru dustyorate.com
ee77ee.com dverimegapolis.ru
elektrischezigarette2.onsugar.com eachdayisagift.review
elektrischezigarettekaufen2.cowblog.fr ecxtracking.com
elektrischezigaretten1.blogse.nl edge.sharethis.com
elektrozigarette2.wordpressy.pl eduserver.net
elmacho.xyz ekspertmed.com
elvel.com.ua election.interferencer.ru
empirepoker.com elitedollars.com
eng-lyrics.com elvenmachine.com
eropho.com englate.com
erot.co erotik0049.com
erotikchat-24.com essay-writing.work
errorfixing.space evaashop.ru
estelight.ru ezofest.sk
etm-consult.de ezrvrentals.com
eugenevaultstorage.com
europages.com.ru
event-tracking.com
eyemagination.com
f1nder.org f1nder.org
fandlr.com fanpagerobot.com
fickblock18.com fetroshok.ru
figuringmoneyout.com fidelityfunding.com
fil.ru filmetricsasia.com
film-one.ru filmi-v.online
filmania-x.ru finemanteam.com
filmfanatic.com firma-legion.ru
findclan.org flashbannernow.com
findsexguide.com fok.nl
firstsiteguide.com forum.doctissimo.fr
fishingwholesale.us fotosfotos.eu
fitness-video.net foxydeal.com
fiverr.com free-gluten.ru
flprog.com freemags.cc
free-traffic.xyz freenode.info
freeseedsonline.com fuel-gas.com
front.ru gamerextra.com
front.to gaming-journal.com
fugarif.ga gardene.ru
fusoradio.info gcup.ru
galaxys6manual.info getoutofdebtfree.org
galeon.com gk170.ru
gallerily.com globatur.ru
gamedayassist.com goldandcard.ru
gameonasia.com greatdealshop.com
gameprimary.com gta-club.ru
gamevalue7.weebly.com gyffu.com
gemara.com hacktougroup.ru
gg.zzyjxs.com hasfun.com
gilbertbanda.net hawaiisurf.com
girlporn.ru hdwallpapers-free.com
glall.ru help.tpu.ru
globetrotting-culture.ru hermesreplica.pw
golmau.host.sk hidefiles.org
googst2.ru high-speed1.net
gorabagrata.ru hoholikik.club
gov.yanao.ru homemade.gq
greatzip.com hostingclub.lk
gungamesz.com hotshoppymac.com
gwagka.com houtings.xyz
gwebtools.com.br hustoon.over-blog.com
hawaiielectriclight.com hydropump.su
hdseriale.pl hystersister.com
healbio.ru i4track.net
healing-dysplasia.ru igtools.club
healthcarestore.info ikearugs.xyz
himgaws.pw ikritikimou.gr
hobbyhuren24.net ilovevitaly.com
hotblog.top ilovevitaly.xyz
hotdl.in imgarcade.com
houseofrose.com impisr.ru
https-legalrc.biz infektsii.com
hut1.ru infoupdate.org
hyipmanager.in instabid.tech
ilikevitaly.com instasexyblog.com
images-free.net insurple.com
imperiafilm.ru intimshop-fantasy.ru
infospot.pt investingclub.ru
internetartfair.com investmac.com
invitefashion.com investzalog.ru
istizanidinelikexanax.blogspot.com ipchicken.com
istock-mebel.ru iqbazar.ru
itag.pw irkutsk.zrus.org
iwantmyfreecash.com
jacago.com
james13prix.info james13prix.info
jikoman.info jerseyswholesalechinalimited.com
jolic2.com jovencitas.gratis
kanimage.com jus0wil.pp.ua
kenaba.su justkillingti.me
kerch.site jyrxd.com
kerei.ru kaac.ru
kerwinandcariza.com kevblog.top
kicknights.gq khafre.us
kimcurlrvsms.com kihi.gdn
kinosed.net kinoplen.ru
kinostorm.net kleine-titten.biz
kinotorka.ru koleso24.com.ua
kiskinhouse.com kosova.de
kliksaya.com
klin3952.ru
kol-energo.ru
komputernaya-pomosh-moscow.ru
kovrenok.ru kovrenok.ru
kredit-pod-zalog-krasnodar.ru kumuk.info
kriokomora.info kung-fu-ru.com
lacapilla.info kw21.org
ladov.ru lampokrat.ws
lafriore.ru
lancheck.net
laptop-4-less.com
larutti.ru
laudit.ru laudit.ru
layola.biz.tc ldrtrack.com
lazy-z.com leboard.ru
leadwayau.com lennatin.info
letslowbefast.today
lezbiyanki.net
lida-ru.com
limads.men limads.men
linkarena.com linkredirect.biz
linkbolic.com liran-locks.com
livejasmin.com littlecity.ch
liver-chintai.org ljusihus.se
locatellicorretor.com.br locustdesign.co
lockerz.com
louboutinbooties.xyz louboutinbooties.xyz
lovasszovetseg.hu
lulea-auktionsverk.se
lumb.co lumb.co
lunchrock.co lunamedia.co
luxup.ru lutherstable.org
macdamaged.space m.b00kmarks.com
mackeeper-center.club mabdoola.blogspot.com
mactechinfo.info magnetpress.sk
mainhp.net makemoneyonline.com
manifestation.betteroffers.review manuscript.su
maximilitary.ru markjaybeefractal.com
mediawhirl.net maximpartnerspr.com
megavolt.net.ua mediafresh.online
members.ghanaweb.com meduza-consult.ru
mensandals.xyz megaapteka.ru
mesbuta.info merryhouse.co.uk
mezaruk.info michaelkorsoutlet.store
midst.eu microstatic.pl
migente.com milblueprint.com
mixed-wrestling.ru minecraft-neo.ru
mmog-play.ru minecraft-rus.org
mojpreskumanie.com mnogabukaff.net
mokrayakiska.com mobilierland.com
mole.pluto.ro moesexy.com
monarchfind-a.akamaihd.net mojpregled.com
moncleronline.xyz monarhs.info
moncleroutletonline.pw
monitorwebsitespeed.com
more-letom.ru
morpicert.pw
moscow-clining.ru
moz.com moz.com
multgo.ru mrinsidesales.com
muznachas-service.ru mrvideospornogratis.xxx
myonigroup.com mtmtv.info
na-telefon.biz mydownlodablefiles.com
nelc.edu.eg myliveblog.ru
networkcheck.xyz myyour.eu
news-readers.ru nalogovyykodeks.ru
nufaq.com naturalbreakthroughsresearch.com
obesidadealgarve.com naughtyconnect.com
obiavo.kz nevansk.ru
nextlnk12.com
nfljerseyscheapchinabiz.com
nibbler.silktide.com
nikitsyringedrivelg.pen.io
nikkiewart.ru
nina.az
njpalletremoval.com
notebook-pro.ru
novosibirsk.xrus.org
nucia.biz.ly
nullrefer.com
nw-servis.ru
o.light.d0t.ru
obiavo.uz obiavo.uz
ochistka-stokov.ru offtime.ru
odesproperty.com offtopic.biz
oil-td.ru onclickpredictiv.com
onlinefilmz.net oneminutesite.it
onlyporno.ru onetravelguides.com
onstrapon.purplesphere.in
ontargetseo.us ontargetseo.us
ooo-olni.ru
openmediasoft.com openmediasoft.com
optom-deshevo.ru oren-cats.ru
orgasmatrix.com orenburg-gsm.ru
orion-code-access.net origin-my.ru
outrageousdeal-a.akamaihd.net pandroid.co
outshop.ru parajumpersjakkesalgnorge.info
panchro.co.uk parajumpersstore.online
parajumpersoutlet.online partner-cdn.men
partner-stop.men pateaswing.com
pastaleads.com pcboa.se
pix-hd.com perl.dp.ua
pk-services.ru pharmacyincity.com
photorepair.ru
physfunc.ru
picsearch.com
pipki.r.acdnpro.com
pkr1hand.com pkr1hand.com
plastjulgranar.se play-mp3.com
pliks.pl playlott.com
plusnetwork.com playtap.us
poem-paying.gq pobeiranie.pl
pogosh.com podshipniki-ntn.ru
polytopesexempt.com pokemon-go-play.online
porn555.com pomoc-drogowa.cba.pl
porno-raskazy.ru popmarker.com
pornosok.ru popup-hgd.xyz
pornozhara.com poquoson.org
postclass.com porno-video-chati.ru
pozdravleniya-c.ru pornokorol.com
proftests.net portnoff.od.ua
progonrumarket.ru positive2b.ru
progress-upakovka.ru preg.marketingvici.com
prom23.ru pregnant.guru
pulse33.ru privacylocationforloc.com
quit-smoking.ga privatefx-in.ru
raisedseo.com prizefestival.mobi
randki-sex.com pronorm.fr
rapidokbrain.com propranolol40mg.blogspot.com
reklamuss.ru prostitutki-almata.org
relayblog.com pyrodesigns.com.au
quick-seeker.com
quickloanbank.com
rapidgator-porn.ga
rating-bestcasino.com
realitykings.com
recordpage-a.akamaihd.net
reelheroes.net
regionshop.biz
registrydomainservices.com
remont-ustanovka-tehniki.ru remont-ustanovka-tehniki.ru
rentalcarnavi.info renhacklids.tk
rfd-split.hr resant.ru
rfserial.net responsive-test.net
rosbalt.com.ua resultshub-a.akamaihd.net
royal-betting.net robertefuller.com
rusoft-zone.ru robotixix.com
rybalka-opt.ru ros-ctm.ru
sabaapress.com rusenvironmental.net
saveriopiazza.it saecsa.co
savetubevideo.com sanidumps.com
sbdl.no sarf3omlat.com
scanner-alexa.top sawin.beth.webd.pl
scanner-don.top scanner-alex.top
scanner-fred.top scanner-jessica.top
scanner-mark.top scanner-john.top
scoopquest.com scanner-margo.top
screentoolkit.com scanner-marwin.top
sdsjweb.com scansafe.net
segol.tv scrapy.org
sei80.com sdelatmebel.ru
selectads.men seasaltwithfood.com
seobility.net servisural.ru
seoexperimenty.ru sex-watch.com
sexkontakteao.info sexyteens.hol.es
sexs-foto.com sfj-ror.no
sexstream.pl sharebutton.to
sexy.babes.frontend-stack.top ship-marvel.co.ua
shijian.ac.cn simple-share-buttons.com
shoesonlinebuy.xyz sindragosa.comxa.com
shopvilleroyboch.com.ua skachat-besplatno-obrazcy.ru
shymkent.xkaz.org
sibdevice.ru
sibecoprom.ru
sientalyric.co
sildenafil-tadalafil.info
sirpornogratis.xxx
skutecznetabletkinaporostwlosow.pl
sky-mine.ru
skylta.com skylta.com
slavia.info slayerlife.com
slomm.ru smart-scripts.com
snts.shell-pmr.ru snjatie-geroinovoy-lomki.ru
socialmonkee.com solmarket.by
solinf.co spywarenuker.com
spbchampionat.ru srdrvp.com
spidtest.org star61.de
spidtest.space statoutlook.info
spravka130.ru staynplay.net
stard.shop streetfooduncovered.com
stardevine.com sugarkun.com
stockquotes.wooeb.com superoboi.com.ua
stockspmb.info swiped.su
store-rx.com sygraem.com
strana-solnca.ru taxi-v-eisk.ru
streamin.to telefonsexkostenlos.tk
strongsignal-a.akamaihd.net templates.radiodigital.co
stroyhelp-dv.ru tengohydar.tk
sukarame.net thelottosecrets.com
suralink.com theplacetoupdating.pw
svtrd.com thesmartsearch.net
symphonyintegratedhealthcare.com titslove.yopoint.in
takeflyte.com tizanidine6mg.blogspot.com
tam-gde-more.ru tizanidinedrugtest.blogspot.com
taraz.xkaz.org tizanidinehcl2mgtablet.blogspot.com
tastyfoodideas.com
technika-remont.ru
tecspb.ru
telemetryverification.net
teslathemes.com
textads.men
thedownloadfreeonlinegames.blogspot.com
theporndude.com
ticketsys.inetwd.com
timhost.ru
tizanidinecost.blogspot.com
tizanidinehclsideeffects.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com tizanidineoral.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidinesleepaid.blogspot.com
top10-way.com tmearegion26.com
toys.erolove.in tnctrx.com
trackzapper.com toonfamilies.net
tradgardspartner.se tooplay.com
traffic2money.com topquality.cf
traffpartners.com tracfone.com
tramadolandtizanidine.blogspot.com track.deriv.com
trumpetedextremes.com traffic-club.info
ttrraacckkrr.com traffique.net
tube8.com tripper.de
trkdf.com
truck-rece.life
trustedhealthtips.com
tupper-shop.ru
turbo-suslik.org turbo-suslik.org
tversvet.ru turbodsp.com
tvoystartup.ru turist-strani.ru
turizm.bz
turvgori.ru
tvand.ru
tvorozhnaja-zapekanka-recept.ru
tvory.predmety.in.ua
ua.tc ua.tc
uasb.ru uchebavchehii.ru
ucsol.ru ucsol.ru
ultramart.biz ugogo.info
unitexindia.com uhod-za-sobakoj.ru
umekana.ru
unitygame3d.com unitygame3d.com
universals.com.ua uprour.com
urengoy.pro uroki.net
usadacha.net varikozdok.ru
ussearche.cf
v720hd.ru
vedomstvo.net vedomstvo.net
vegan-foods.us vellings.info
vekzdorov.ru vgoloveboli.net
venerologiya.com via-gra.webstarts.com
versaut.xxx-cam.webcam vilingstore.net
viagraneggrx.com visa-china.ru
videosbox.ru visitcambridge.org
viven.host.sk voronezh.xrus.org
vkak.ru vsexkontakte.net
vkmusics.ru vtcdns.com
vodkoved.ru vysigy.su
vseigry.fun wahicbefa31.soup.io
vsesubwaysurfers.com wait3sec.org
vzubah.com wallpapers-best.com
w7s.ru wardreapptokone.tk
warezkeeper.com warningzscaler.heraeus.com
waysbetter.cn web-betting.ru
webradiology.ru webads.co.nz
weburlopener.com webalan.ru
wesharepics.info websites-reviews.com
whatistizanidine2mg.blogspot.com westen-v.life
wholesalejerseyscheapjerseys.us.com westermarkanjou.se
win-spy.com wetgames.ru
wineitudes.wordpress.com wfb.hatedriveapart.com
winx-play.ru whatsupinfoley.com
worldinternetauthority.com whatzmyip.net
wowcasinoonline.ooo whengirlsgowild.com
wttavern.com wholesalejerseychinaoutlet.com
ww1943.ru wildnatureimages.com
www.888.com woman-orgasm.ru
www.labves.ru world-mmo.com
x-diesel.info wormix-cheats.ru
xev.ru www.wohnkabinen-shop.de
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xkaz.org
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf xlovecam.com
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai xmladserver.com
xn----9sbubg3ambdfl1j.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xsion.net xn--80aanaardaperhcem4a6i.com
xxart.ru xn--80aodinpgi.xn--p1ai
xxxtubesafari.com xn--80atua3d.xn--p1ai
yebocasino.com xn--d1abj0abs9d.in.ua
youjizz.com xn--l1aengat.xn--p1ai
yugo-star.ru xolodremont.ru
zarenica.net xtremeeagles.net
zixizop.net.ru yellowstonevisitortours.com
zona-aqua.ru youporn-forum.ga
zrelaya.pw zebradudka.com
zverokruh-shop.cz zebramart.ru
zvetki.ru zhacker.net
znakom.sibtest.ru
zophim.me
zx6.ru
zytpirwai.net
zzbroya.com.ua

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00author.com 1001desert.com
101raccoon.ru 10bet.com
1adult.com 12masterov.com
300richmond.co.nz 14b.info
4ur.click 28n2gl3wfyb0.ru
4k-player.pl
7minuteworkout.com
9icmzvn6.website 9icmzvn6.website
aa08daf7e13b6345e09e92f771507fa5f4.com
aa8b68101d388c446389283820863176e7.com aa8b68101d388c446389283820863176e7.com
akusherok.ru academiacsmendoza.org
albumsuper.info adssafeprotected.com
aliexpresscashback.club advertex.info
allboard.xobor.de allforminecraft.ru
allornamenti.com amanda-porn.ga
apibrowsesmartne-a.akamaihd.net apiwoodensealcom-a.akamaihd.net
apispringsmartne-a.akamaihd.net apple.com-cleaner.systems
apptester.tk appsaurus.com
atmovs.com appsecurityr.com
atovh.local-finders.com asacopaco.tk
autobrennero.it astana.xxxkaz.org
autoloans.com auto-zapchasti.org
avon-ukraine.com aviva-limoux.com
azbukadiets.ru avto-oligarh.ru
baditri.com backgroundpictures.net
bankiem.pl banki76.ru
bankofthewext.com basedecor.ru
bcmp.org bestbrainprod.win
bestbuy.ca bestmobilityscooterstoday.com
bezsporno.ru bestsexyblog.com
binomo.com bizru.info
biznesschat.net bocoarchives.org
blackplanet.com bonkers.name
boazpower.com bracketsmackdown.com
bombla.org braip.com.br
boo-arts.com buckspar.gq
bookmark4you.com budilneg.xyz
braindaily.xyz byme.se
brainxs.us cactussoft.biz
brg8.com calvet.altervista.org
bugof.gq cars-modification.net
bumble.cheapwebsitehoster.com caveavins.fr
cakesplus.com.au chocolateslim-en-france.com
camel-beach.com cialgenisrx.com
carina-sy.de cialischsrx.com
cartierlovebraceletreplica.xyz cibpenonptib.flu.cc
cheapjerseysa.com classicakuhni.ru
codq.info cognitiveseo.com
compliance-don.top comeondog.info
compliance-don.xyz compliance-irvin.xyz
compliance-elena.top compliance-margo.top
connectingsingles.com coolgramgoods.com
coolbar.pro cryptoswap.biz
country-chic.ru cymbaltaandtizanidine.blogspot.com
creatives.adbetclickin.pink daneshetabiat.com
customboxes4less.com darkbooks.org
customsua.com.ua data1.scopich.com
cyprusbuyproperties.com dating-app.ru
cyse.tk dekorkeramik.ru
dalavia.ru dgfitness.co
ddsoldes.fr dichvuvesinhhanoi.com
deadlinkchecker.com directrev.com
deniven.1bb.ru dokfilms.net
deutschland123.de dolohen.com
diffbot.com domaincrawler.com
dignitasdata.se donna7753191.ru
dividendo.ru doxysexy.com
domain.webkeyit.com e-buyeasy.com
domainroam.win educatemetv.com
dostavka-v-krym.com efnor-ac.com
dosugrostov.site ekspresihati.info
draniki.org elektronischezigarettekaufen2.tumblr.com
dyt.net elidelcream.weebly.com
e-c.al eshop.md
egovaleo.it esopini.com
elektrischezigaretten2.beeplog.com eugenevaultstorage.com
empathica.com extremez.net
empirepoker.com fakehandbags.xyz
eng-lyrics.com familyphysician.ru
envaseslotusama.com fearcrow.com
eralph.tk fidelityfunding.com
etm-consult.de fil.ru
evidencecleanergold.com findacheaplawyers.com
extener.org forex.osobye.ru
ezigarettekaufen2.mpbloggar.se forexgb.ru
f07.de freelotto.com
favorcosmetics.com freshmac.space
favoritemoney.ru gamedayassist.com
fellowshipoftheminds.com gameonasia.com
fertilitetsradgivningen.se getresponse.com
filesclub.net ghernnqr.skyrock.com
finteks.ru girlsatgames.ru
freejabs.com goodhousekeeping.com
galleryawesome.com google-liar.ru
ge0ip.net gorodservis.ru
geoads.com graphics8.info
getoutofdebtfree.org growboxbl.ru
good-mummy.ru growshop.es
goodprotein.ru gta-top.ru
googleseo.com.tr highland-homes.com
haikuware.com hildinghr.se
hard-porn.mobi hitsbox.info
hasshe.com ifmo.ru
hdwallpapers-free.com images-free.net
himgaws.pw imagine-ex.co
hop.clickbank.net imfamous.info
hoverboard360.de javstock.com
hut1.ru jillepille.com
ibb.com.ua ketrzyn.pl
iccornacircri.cf kfon.eu
iflycapetown.co.za kinocccp.net
ihc2015.info koversite.info
imediadesk.com laparfumotec.com
in-tandem.co ldrtrack.com
infospot.pt lion.conboy.us
int.search.mywebsearch.com lion.playtap.us
int.search.tb.ask.com m292.info
irunfar.com manifestyourmillion.com
istock-mebel.ru manualterap.roleforum.ru
iusstf.org manyresultshub-a.akamaihd.net
jav-fetish.site marcowebonyodziezowe.pl
jolic2.com marketingvici.com
junketjuice.blogspot.com mediafresh.online
justbcause.com medizinreisen.de
kalandranis.gr megaapteka.ru
keywordblocks.com memberty.com
keywordhut.com message-warning.net
kino-filmi.com mezaruk.info
kino-fun.ru michaelkorsoutletstore.net
kiskinhouse.com mir-limuzinov.ru
kredit-pod-zalog-krasnodar.ru mmostrike.ru
lampokrat.ws moneymaster.ru
lechenie-gemorroya.com monthlywinners.com
lifeinsurancekb.com
linkbolic.com
macdamaged.tech
makenahartlin.com
marblestyle.ru
marinetraffic.com
marketland.ml
masserect.com
mega-bony2017.pl
meteocast.net
mobioffertrck.com
mojowhois.com
mole.pluto.ro
mosrif.ru mosrif.ru
moz.com
mug-na-chas-moscow.ru mug-na-chas-moscow.ru
music.utrolive.ru myfreemp3.eu
mybinaryoptionsrobot.com myonigroup.com
next-dentists.tk myxdate.info
o-o-6-o-o.ru naj-filmy24.pl
obiavo.su new-post.tk
obsessionphrases.com officedocuments.net
of-ireland.info okayimage.com
oil-td.ru okuos.com
onlywoman.org onlainbesplatno.ru
ossmalta.com onlineku.com
ourtherapy.ru oralsexfilme.net
paighambot.com ourville.info
papasdelivery.ru partner-pop.men
pc-virus-d0l92j2.pw pc-virus-d0l92j2.pw
petsblogroll.com pelfind.me
pizza-tycoon.com perl.dp.ua
pic2fly.com
pl-top.pl
pl.id-forex.com pl.id-forex.com
plastweb.ru poiskzakona.ru
popcash.net popunder.ru
popserve.adscpm.net pornonik.com
porno-transsexuals.ru pozdrawleniya.ru
pornoelita.info prosperent.com
pornotubs.com prostitutki-novgoroda.org
pornowarp.info psoriasis-file.trade
pornzone.tv quelle.ru
propranolol40mg.blogspot.com rabotaetvse.ru
prostitutki-odessa.org radiodigital.co
pukaporn.com referencemoi.com
qwertty.net relayblog.com
qwesa.ru rep-am.com
rapidokbrain.com reversing.cc
rcb101.ru roznica.com.ua
reining.lovasszovetseg.hu ryetaw.com
rfserial.net sadaholding.com
riralmolamsaca.tk sanatorrii.ru
rockma.se saneyes.com
rootandroid.org scanner-donald.top
s8-nowy-wygraj.comli.com sdi-pme.com
saddiechoua.com sexkvartal.com
sandhillsonline.com sextracker.be
sankt-peterburg.nodup.ru sextracker.de
saratov.xrus.org
scanner-jack.top
search.alot.com
searchtooknow-a.akamaihd.net
seokicks.de
seorank.info
sergiorossistore.online
serw.clicksor.com
sexsaoy.com
sherlock.se sherlock.se
shoppytoolmac.com shmetall.com.ua
shop-electron.ru
shymkent.xkaz.org
simul.co
siteimprove.com siteimprove.com
snsdeainavi.info skyway24.ru
sr-rekneskap.no slayerlife.com
sucsesofinspiration.com sloopyjoes.com
superiends.org small-game.com
tacbibirfa.tk spywarenuker.com
tgtclick.com strfls.com
the-usa-games.blogspot.com stroy-portal22.ru
timdreby.com sugarlyflex.pw
timetorelax.biz svtrd.com
tizanidinesideeffectsweightloss.blogspot.com tamada69.com
top-deal.com.pl teastory.co
top-karkas.ru telemetryverification.net
torrnada.ru thecoral.com.br
traffique.net thetoiletpaper.com
trudogolik.net thewomenlife.com
twittruth.com tilido.com
twodollarshows.com titangel-vietnam.com
umaseh.com tizanidinedosageforsleep.blogspot.com
utrolive.ru tizanidineoral.blogspot.com
vbikse.com tizanidinevsvalium.blogspot.com
venta-prom.ru topquality.cf
versaut.xxx-cam.webcam topvidos.ru
video--production.com torture.ml
videochat.cafe toursmaps.com
videospornogratisx.net track2.shop
vigrx-original.ru trafficjunky.com
vodkoved.ru trahic.ru
voprosotvet24.ru tramadolandtizanidine.blogspot.com
vostoktrade.info tsyndicate.com
vpnmouse.com ttsq.fr
vvon.co.uk tvand.ru
w3javascript.com uni.me
webenlace.com.ar urengoy.pro
webmasters.stackexchange.com urlcut.ru
webradiology.ru urlopener.blogspot.com.au
website-speed-checker.site uroki.net
wechatdownload10.com uzungil.com
weightatraining.com varbergsvind.se
wellcome2slovenia.ru vbabule.net
world-mmo.com vintontech.info
wyniki-lista.pl vip-parfumeria.ru
x-diesel.com voloomoney.com
xpresscare.ru warningzscaler.heraeus.com
xxxasianporn.net webcamtalk.net
xxxtube69.com wejdz-tu.pl
yellowads.men wesharepics.info
yellowfootprints.com westsextube.com
youresponsive.com wildworld.site
yur-p.ru womensplay.net
zaloadi.ru www.ehscloud.cn
zaloro.com x-rates.ru
zdesformula.ru xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xxart.ru
yatrk.xyz
yottos.com
youdao.com
yugo-star.ru
zajm-zalog-krasnodar.ru
zeroredirect11.com
zhongwenlink.com
zigzog.ru
zona-aqua.ru
zoolubimets.ru
zoomovies.org
zytpirwai.net

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.5 0; 10.1.0.92 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:17 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.08.2507 ### Version: V4.2021.08.2508
### Updated: Sat Aug 7 10:03:17 UTC 2021 ### Updated: Sat Aug 7 11:01:17 UTC 2021
### Bad Bot Count: 618 ### Bad Bot Count: 618
################################################### ###################################################
### Version Information ## ### Version Information ##