vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 11:10:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.12.3512 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-12-09 10:18:37 +00:00
parent cde37804a7
commit 6aaa40e3fe
46 changed files with 1178 additions and 1156 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3511 #### Version: V4.2022.12.3512
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.12.3511 #### Version: V4.2022.12.3512
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.12.3511 #### Version: V4.2022.12.3512
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.12.3511 #### Version: V4.2022.12.3512
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

5
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3511 3512

5
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2022.12.3511 ### Version: V3.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8545,6 +8545,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.137.4 0; 20.237.138.140 0;

5
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.137.4 0; 20.237.138.140 0;

5
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.137.4 0; 20.237.138.140 0;

5
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:00 UTC 2022 ### Updated: Fri Dec 9 10:12:46 UTC 2022
### Bad Referrer Count: 7097 ### Bad Referrer Count: 7097
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
@ -8547,6 +8547,7 @@ geo $validate_client {
# START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # START KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 1; 10.1.0.117 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Copyscape Boardreader
Go!Zilla Crawling at Home Project
Intelliseek DomCopBot
RankingBot IDBTE4M
Recorder Keybot Translation-Search-Machine
SalesIntelligent LWP::Simple
Sucker MSFrontPage
Voltron Thumbor
Webster Web Collage
instabid meanpathbot

302
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
Aboundexbot Abonti
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AiHitBot AiHitBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anthill Anthill
Apexoo
Aspiegel Aspiegel
Asterias Asterias
Attach
BBBike
BLEXBot BLEXBot
BackStreet BackStreet
BackWeb Bigfoot
Backlink-Ceck Black Hole
Badass Blackboard
Battleztar Bazinga Blow
BetaBot
Bitacle
BlowFish BlowFish
Bolt Boardreader
Brandprotect
Brandwatch
Buck Buck
Buddy BuiltWith
CATExplorador BunnySlippers
CODE87 CODE87
Calculon
CazoodleBot CazoodleBot
CensysInspect
CheeseBot
Chlooe Chlooe
Claritybot Claritybot
Cloud mapping Cliqzbot
Cogentbot Cocolyzebot
Collector CopyRightCheck
Copier
Copyscape Copyscape
CrazyWebCrawler Craftbot
Crescent Crawling at Home Project
Custo CrunchBot
CyotekWebCopy Curious
DataCha0s DataCha0s
Demon Deusu
Digincore
DigitalPebble DigitalPebble
Disco Dirbuster
Discoverybot Discoverybot
DnBCrawler-Analytics Dispatch
DnyzBot DnyzBot
DomCopBot DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot Domains Project
Dragonfly Download Wonder
Drip Drip
Ecxi ECCP/1.0
Ebingbong
EirGrabber
EroCrawler EroCrawler
ExtLinksBot Exabot
Express WebPictures
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot FemtosearchBot
Flunky Firefox/7.0
Fuzz Foobot
GermCrawler FrontPage
GetRight FyberSpider
Getintent GalaxyBot
Genieo
GetWeb
Gigabot Gigabot
Go!Zilla Go!Zilla
GrabNet GoZilla
GrapeFX GrapeshotCrawler
HEADMasterSEO GridBot
HTTrack
HaosouSpider
Harvest Harvest
Havij Havij
Heritrix Hloader
Humanlinks HonoluluBot
HybridBot
IDBot IDBot
IlseBot Image Sucker
Image Fetch
IndeedBot IndeedBot
Indy Library Indy Library
InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer InternetSeer
Iria
IstellaBot IstellaBot
JennyBot JikeSpider
JetCar JustView
Jorgee Keybot Translation-Search-Machine
Kinza Keyword Density
Kozmosbot
LWP::Simple LWP::Simple
LeechFTP Larbin
LeechGet LeechGet
LibWeb LexiBot
LieBaoFast Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinksManager LinksManager
LinqiaRSSBot LinqiaMetadataDownloaderBot
MFC_Tear_Sample Lipperhey
MJ12bot Lipperhey Spider
Lmspider
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler MSIECrawler
Mail.RU_Bot MTRobot
MarkMonitor Magnet
Majestic12
MarkWatch MarkWatch
Mass Downloader Mass Downloader
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Mister PiX Morfeus Fucking Scanner
Mojolicious Mozlila
NICErsPRO Mr.4x3
Name Intelligence NPbot
Nameprotect Nameprotect
Needle Navroad
Net Vampire
NetMechanic NetMechanic
NetSpider NetSpider
Netcraft
Nettrack Nettrack
NextGenSearchBot
Nibbler Nibbler
NimbleCrawler Niki-bot
Nuclei Nuclei
Offline Navigator
OnCrawl OnCrawl
Openfind OpenLinkProfiler
OpenVAS
Openvas
OrangeBot OrangeBot
OrangeSpider OutclicksBot
PECL::HTTP PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer PageScorer
PageThing.com PageThing.com
Pi-Monster Papa Foto
Pavuk
Picscout Picscout
Picsearch
Piepmatz
PleaseCrawl PleaseCrawl
Pockey
ProWebWalker ProWebWalker
RankActive Probethenet
Rankivabot RankFlex
RankingBot
RankurBot
RebelMouse
RedesScrapy RedesScrapy
SEOkicks RocketCrawler
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
ScoutJet
Scrapy
Screaming Screaming
ScrepyBot ScreenerBot
Seekport Searchestate
SearchmetricsBot
SemanticJuice
Semrush Semrush
SeobilityBot
Seomoz Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteSnagger
SiteSucker SlySearch
SmartDownload SmartDownload
Snapbot Snoopy
Sogou web spider Sottopop
Spbot Spammen
SputnikBot Spanner
Sqlmap Sqlmap
Sqlworm Sqworm
Steeler
Sucuri Sucuri
SuperBot
SuperHTTP
Szukacz
T0PHackTeam T0PHackTeam
TeleportPro TeleportPro
Telesphorep Telesphoreo
TheNomad TheNomad
Thumbor Thumbor
Titan Titan
Tracemyfile Toweyabot
Trendiction Trendictionbot
Turnitin True_Robot
TurnitinBot
TwengaBot TwengaBot
Twice Twice
Typhoeus
UnisterBot
V-BOT V-BOT
VB Project Vacuum
VelenPublicWebCrawler VeriCiteCrawler
Virusdie VidibleScraper
VoidEYE Voltron
Voil
WASALive-Bot
WBSearchBot
WEBDAV WEBDAV
WWW-Collector-E WISENutbot
Wallpapers WWW-Mechanize
WallpapersHD WeSEE
Web Auto Web Auto
Web Fetch Web Collage
Web Pix
Web Sucker
WebBandit
WebFetch
WebFuck
WebImageCollector WebImageCollector
WebLeacher
WebPix WebPix
WebReaper WebSauger
WebStripper Webshag
WebSucker Webster
Webalta
WebmasterWorldForumBot
Whack
Whacker Whacker
Who.is Bot Whatweb
Widow
WinHTTrack WinHTTrack
WiseGuys Robot
Wonderbot
Woobot Woobot
Wprecon Xaldon WebSpider
Xenu Xaldon_WebSpider
YoudaoBot
Zauba Zauba
Zeus Zermelo
ZyBorg Zitebot
ZumBot
adscanner adscanner
backlink-check archive.org_bot
cah.io.community
clark-crawler clark-crawler
crawl.sogou.com coccocbot
crawler.feedback dataforseo.com
evc-batch evc-batch
gopher gopher
heritrix
internetVista monitor internetVista monitor
isitwp.com ips-agent
iubenda-radar linkdexbot
lwp-request magpie-crawler
lwp-trivial
meanpathbot meanpathbot
muhstik-scan
oBot oBot
page scorer ripz
plumanalytics s1z.ru
satoristudio.net
seocompany.store
seostar
serpstatbot serpstatbot
sexsearcher sitechecker.pro
sogouspider sogouspider
spyfu spyfu
tAkeOut tAkeOut
webpros.com trendiction.com
zauba.io voyagerx.com
webgains-bot
x22Mozilla
zgrab

278
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404enemy 404enemy
ADmantX 80legs
ASPSeek AIBOT
Aboundex Aboundex
Aboundexbot
AiHitBot
Alexibot
AllSubmitter AllSubmitter
Anarchy
Anarchy99
Anthill Anthill
Apexoo
Asterias Asterias
BBBike Attach
BLEXBot BDCbot
BackDoorBot BackDoorBot
BackStreet
Backlink-Ceck
BetaBot BetaBot
Bigfoot
BlackWidow BlackWidow
BlowFish Boardreader
Bolt
Brandprotect
Brandwatch Brandwatch
Buddy
BuiltWith
Bullseye Bullseye
BunnySlippers
BuzzSumo BuzzSumo
CCBot
CODE87 CODE87
Calculon Calculon
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
CheeseBot
Citoid Citoid
Collector
Copier
Copyscape Copyscape
Craftbot
Crawling at Home Project Crawling at Home Project
Curious Custo
CyotekWebCopy
DBLBot DBLBot
DSearch
DTS Agent DTS Agent
Discobot DataCha0s
DigitalPebble
Discoverybot Discoverybot
DomainAppender DnBCrawler-Analytics
DomainCrawler DomainCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot
Download Wonder Download Wonder
Dragonfly EMail Siphon
EMail Wolf EirGrabber
Ebingbong EroCrawler
ExtLinksBot Exabot
Express WebPictures
Extractor Extractor
ExtractorPro
EyeNetIE
Ezooms Ezooms
FDM Firefox/7.0
FlashGet
FrontPage
Fuzz
G-i-g-a-b-o-t
Genieo
GermCrawler GermCrawler
GetRight GetRight
Go!Zilla GetWeb
Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Grabber
Grafula Grafula
GrapeshotCrawler HEADMasterSEO
HTMLparser
HTTP::Lite HTTP::Lite
HaosouSpider HTTrack
Havij Haansoft
Hloader Heritrix
IDBTE4M IDBTE4M
IDBot IDBot
IRLbot IRLbot
Iblog Iblog
Id-search Id-search
Image Fetch IlseBot
Image Sucker InterGET
Internet Ninja
InternetSeer InternetSeer
IstellaBot IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot JennyBot
JikeSpider
Jorgee
JustView JustView
Jyxobot
Kenjin Spider Kenjin Spider
Kozmosbot Keyword Density
Lanshanbot Leap
LeechFTP LeechFTP
Libwhisker LexiBot
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
LinkScan LinkScan
LinkWalker LinkWalker
Linkbot Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 Ltx71
MSFrontPage MFC_Tear_Sample
Mag-Net MIDown tool
MJ12bot
MQQBrowser
MarkMonitor MarkMonitor
Masscan MarkWatch
Mata Hari Mass Downloader
MauiBot MauiBot
MeanPath Bot Mb2345Browser
Meanpathbot Meanpathbot
Mediatoolkitbot Microsoft Data Access
MicroMessenger
Minefield Minefield
Mister PiX
Moblie Safari Moblie Safari
Mojeek Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mozlila Mozlila
Msrabot
Musobot Musobot
NICErsPRO NPbot
Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
Needle NearSite
Nessus Net Vampire
NetLyzer NetLyzer
NetMechanic
NetZIP
Nettrack
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
Nikto
NimbleCrawler NimbleCrawler
Not Nimbostratus
Nuclei Offline Navigator
Nutch
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS OpenVAS
Openfind
Openvas
OrangeSpider OrangeSpider
OutclicksBot PHPCrawl
OutfoxBot Panscient
PageAnalyzer Pavuk
PageThing.com Petalbot
Pandalytics Picscout
Papa Foto PictureFinder
Pi-Monster Pimonster
Pockey
Probethenet Probethenet
Psbot PyCurl
Pump
RankActive RankActive
RankingBot RankFlex
RankingBot2
RankurBot RankurBot
Re-re
ReGet ReGet
RealDownload RocketCrawler
Reaper SEOkicks-Robot
RedesScrapy
Rogerbot
SBIder
SEOlyticsCrawler SEOlyticsCrawler
SalesIntelligent SEOstats
ScanAlert
Scanbot
ScoutJet
Screaming Screaming
ScrepyBot ScrepyBot
SemanticJuice SearchmetricsBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot
Seomoz Seomoz
Shodan Shodan
Siphon
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer Sitevigil
SiteSnagger Snapbot
SiteSucker
Sitebeam
SlySearch
Snake
Snoopy
Sociscraper Sociscraper
Sogou web spider
Sosospider Sosospider
Sottopop SpaceBison
Spinn3r Spammen
Spanner
SputnikBot
Sqlworm Sqlworm
Sqworm Sucuri
Sucker Szukacz
SuperHTTP T8Abot
Swiftbot
T0PHackTeam
Teleport Teleport
TeleportPro TeleportPro
The Intraformant TheNomad
TightTwatBot Thumbor
Toata
Toweyabot Toweyabot
Tracemyfile
Trendictionbot Trendictionbot
True_Robot
Turnitin Turnitin
Twice TwengaBot
URLy.Warning Typhoeus
Upflow Upflow
VeriCiteCrawler V-BOT
Vacuum
Virusdie Virusdie
Wallpapers WBSearchBot
WallpapersHD WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Auto Web Auto
Web Collage Web Collage
Web Enhancer Web Sauger
Web Fuck WebBandit
WebCopier
WebEnhancer WebEnhancer
WebFuck WebFetch
WebImageCollector
WebReaper
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
Webshag Website Quester
WebsiteExtractor Widow
WebsiteQuester Wprecon
Whack Xaldon_WebSpider
WiseGuys Robot YoudaoBot
Wotbox
Xenu
Zade Zade
Zauba
Zermelo Zermelo
Zeus
ZmEu
ZumBot ZumBot
ZyBorg
adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt backlink-check
cah.io.community
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler.feedback
dataforseo.com crawler4j
demandbase-bot instabid
ips-agent
isitwp.com isitwp.com
iubenda-radar
linkdexbot
lwp-request lwp-request
magpie-crawler
muhstik-scan muhstik-scan
netEstate NE Crawler
pcBrowser pcBrowser
polaris version
ripz
satoristudio.net
scalaj-http scalaj-http
seobility seocompany.store
seoscanners
seostar seostar
sexsearcher sexsearcher
siteripz sitechecker.pro
sogouspider sogouspider
spyfu
trendiction.com
trendiction.de trendiction.de
voyagerx.com webmeup-crawler
webpros.com webpros.com
webprosbot webprosbot
x09Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
downloaddy.net arendas.net
earl-brown.info bannerbank.ru
filmgo.ru fym.com.ru
gate5.co.za highland-homes.com
hollywoodactress.info hundejo.com
laptoper.net likesdesign.com
osoznanie-narkotikam.net pb-dv.ru
tmtrck.com thaismartloan.com
wholesalejerseys-cheapest.com txxx.com
xn--lifehacer-1rb.com zeroredirect5.com

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
100searchengines.com 0912701309f8ce.com
101lesbian.xyz 101lesbian.xyz
123locker.com
1hwy.com 1hwy.com
4ureyesonly.com 1millionusd.xyz
6128786.com 40cg.com
8558l.jobs.net 5-steps-to-start-business.com
991mostfm.co.id 55wmz.ru
academiacsmendoza.org abcguru.xyz
adhome.biz acgs.tk
admanaerofoil.com activepr.ru
admatic.com.tr actulite.com
adsref.men adanih.com
adultgalls.com admitad.com
advancedcleaner.com adtiger.tk
adverster.com agardomains.com
advokateg.ru aibolita.com
adzpower.com alarmobninsk.ru
aihelen.net alfa-img.com
akita.kz algarveglobal.com
ald2014.org allornamenti.com
alif-ba-ta.com allproblog.com
all4invest.ru allsilver925.co.il
all4wap.ru amyfoxfitness.com
allbizne.co.ua anal-acrobats.hol.es
allforminecraft.ru analnoeporno.tv
alloysteel.ru animali.deagostinipassion.it
allstatesugarbowl.org anime.dougasouko.com
alphahoverboards.com animenime.ru
amoi.tn anmysite.com
animal-drawings.com aquarium-pro.ru
animal36.com arabgirls.adultgalls.com
apidigidocketnet-a.akamaihd.net architecturebest.com
artefakct.com arclk.net
arenanews.com.ua
arendatora.ru
arius.tech
atelielembrancaqueencanta.com.br atelielembrancaqueencanta.com.br
audiofree.ru atlasvkusov.ru
auspolice.com aviav.eu
australia-opening-times.com avitocars.ru
auto-zapchasti.org aviva-limoux.com
auto.rusvile.lt avkzarabotok.com
autoloans.com avtolombard-krasnodar.ru
aviav.co ayodhya.co
avtovolop.ru azadnegar.com
backiee.com azbukafree.com
backuperwebcam.weebly.com azinoofficial777.ru
bagsonsale.online babosas.com
baixar-musicas-gratis.com bad-stars.net
baksman.com bannerconnect.net
bannerswap.com battlecarnival.su
bbtec.net bbtec.net
berdasovivan.ru berlininsl.com
best-mam.ru bestmarriages.com
bet-prognoz.com bestpornuha.com
bet365.com bestwebsiteawards.com
biketank.ga bezlimitko.xyz
bikini-image.com bfz.biz
binomo.kz binaryoptionscops.info
bitcoinpile.com biznesluxe.ru
bitporno.sx biznesschat.net
bizcheapjerseyswholesalechina.com bjanshee.ru
blobar.org blogig.org
blog.axant.it blue-square.biz
bluerobot.info bluejays-jerseys.us
bmwhighperformers.com bluesman.nu
bongacams.com bnt-team.com
boobsimge.com bolegapakistan.com
bouda.kvalitne.cz bonzybuddy.com
brainsandeggs.blogspot.com
brandbucket.com brandbucket.com
brandimensions.com
bravegirlsclub.com bravegirlsclub.com
brewdom.ru brillianty.info
brothers-smaller.ru brimstonehillfortress.org
browsepulse-a.akamaihd.net
businesxxl.com businesxxl.com
buttons-for-website.com butstrap.space
buyviagraa.blogspot.com buyessay3.blogspot.ru
c-gainsbourg.com buzzzg.men
cacheimages.com cablecar.us
call-of-duty.info calc-for-credit.ru
callejondelpozo.es callmd5map.com
callstevens.com
calstaterealty.us calstaterealty.us
capture-room.com calvet.altervista.org
cardsharp1.ru canvas.gloverid.site
carrauterie.be canyougethighofftizanidine.blogspot.com
cartierreplica.top capacitacionyaprendizaje.com
casablancamanor.co.za cartierlove2u.com
caveavins.fr cartierring.xyz
cdn.walkme.com cartiertrinity.xyz
cdncash.com casinopinup-wins.com
centre-indigo.org.ua cb.iphantom.com
cercacamion.it cdnanalytics.xyz
checkm8.com cheap-pills-norx.com
chee-by.biz cheapjerseysfootballshop.com
cherubinimobili.it chorus.terakeet.com
chiptuninger.com christianlouboutinoutlet.win
christianlouboutinreplica.pw circlesl.com
clickpapa.com citizenclsdriveri7.pen.io
clippingphotoindia.com clean-start.net
clips.ua.ac.be clickintext.net
cocyq.inwtrade.com compliance-alexa.xyz
collegeessay19.blogspot.ru compliance-george.top
comissionka.net compliance-ivan.xyz
commoncrawl.org compliance-julia.top
compliance-andrew.top compliance-margo.top
compliance-donald.xyz compliance-mark.top
contentsexpress.com compliance-mary.top
coolwallpapers4k.info compliance-viktor.top
coop-gamers.ru conboy.us
counter.yadro.ru contextualyield.com
crackguru.tk continent-e.tv
crest-poloski.ru coolingoods.com
cwetochki.ru copblock.org
czat.wp.pl copypaste.traderzplanet.in
dailyrank.net cowblog.fr
date-withme.com creatives.adbetclickin.pink
datract.com cryptoswap.biz
de.zapmeta.com cupday.com
dealitright.click custodieva.ru
decorationspcs.com dailyfinancefix.com
demenageur.com dame-ns.kz
detoxmed24.ru dangphoto.trade
dimfour.com darkbooks.org
discovertreasure-a.akamaihd.net data-mining.tk
dkvorota.ru data-ox.com
dnepr-avtospar.com.ua datadepths.com
docs4all.com dating-app.ru
domcran.net davebestdeals.com
domznaniy.ru ddpills.com
donna7753191.ru dellalimov.com
den-noch24.ru
deniven.1bb.ru
designdevise.com
digitalfaq.com
djekxa.ru
djihispano.com
dlya-android.org
dolohen.com
domaincheck.io
domik-derevne.ru
dostavimvdom.ru dostavimvdom.ru
downloaddy.net drhomes.biz
downloader12.ru drugs-no-rx.info
downtuptv.gq duawitchrarato.tk
drillsaw.ru e-poker-2005.com
drupa.com ee77ee.com
dvd-famille.com elmacho.xyz
dvr.biz.ua englishgamer.com
e-kwiaciarz.pl epicbrogaming.com
earl-brown.info eshop.md
editmedios.com eugenevaultstorage.com
emerson-rus.ru ewebarticle.info
eng-lyrics.com expdom.com
enthuse.computernetworksonline.com eywords-monitoring-your-success.com
etotupo.ru ezigarettekaufen1.hpage.com
everypony.ru
expolicenciaslatam.co
expresstoplivo.ru
extener.org
extlabs.io
ez8motelseaworldsandiego.com
ezb.elvenmachine.com
ezigarettekaufen.myblog.de
ezigarettenkaufen1.pagina.gr
ezigarettenshop1.yolasite.com ezigarettenshop1.yolasite.com
fable.in.ua ezigaretteshop2.mywapblog.com
farm26.ru ezigaretteshop2.vefblog.net
fashionindeed.ml fickluder69.com
faz99.com filmbokep69.com
financetip.eu filmci.pro
findsexguide.com filmidivx.com
flirt4free.com finansov.info
flytourisme.org florida-tourism.net
foodgid.net flowwwers.com
footballfarrago.com fm-upgrade.ru
focalink.com
foodcrafts.website
forex-procto.ru forex-procto.ru
forexgb.ru forum.tvmir.org
forexunion.net forumprofi.de
foxtechfpv.com fotosfotos.eu
free-floating-buttons.com foxjuegos.com
freejabs.com franecki.net
freemaintenancesysforpcandmac.top free411games.com
freecamdollars.com
freenom.link freenom.link
freeuploader.com front.to
fungamelands.com fuckmill.com
girls-ufa.ru fym.com.ru
global-ics.co.za gagrasector.ru
goforexvps.com galeria-zdjec.com
golmau.host.sk gallery.rennlist.com
green-tea.tv gamedayassist.com
greendream.com.ua gameprimary.com
gwebtools.com.br gamevalue7.weebly.com
gz2.bbsoldes.fr gamezblox.com
handsandlegs.ru geile-lelly.eu
hausfrauensex18.com gk-atlant.info
hdhc.ru goldadpremium.com
hdpixent.com gonextmedia.com
help.tpu.ru gq-catalog.gq
hermesreplica.win grtyi.com
hamacapty.com
hard-porn.mobi
hccoder.info
hesteel.pl
hetmanship.xyz
hobild.net hobild.net
hoholikik.club hollywoodactress.info
hostcritique.com horoshieokna.com
hosting-tracker.com host-tracker.com
hostingclub.lk hoverboard360.es
hotenergy.ru hoverboard360.se
hotxnights.info hoztorg-opt.ru
howmuchdoestizanidinecost.blogspot.com
hulfingtonpost.com hulfingtonpost.com
humbmosquina.tk humbmosquina.tk
i-service.kz hydropump.su
ico.re
idc.com.ua idc.com.ua
iklysha.ml ideoworld.org
imagecoolpub.com ihtec2019.org
images-free.net imadedinner.net
imagine-ex.co imagui.eu
imgata.com
imguramx.pw
imperia31.ru imperia31.ru
impisr.edunsk.ru in-tandem.co
indiasourcemart.in incomekey.net
inome.com.ua indianmedicaltourismshop.com
insider.pro infokonkurs.ru
insurple.com informatiecentro.be
investingclub.ru intellego.info
istanbulit.com intellekt21.ru
istizanidinelikexanax.blogspot.com investpamm.ru
istmira.ru iron-age.info
istock-mebel.ru iwantmyfreecash.com
itbc.kiev.ua javxxx18.com
itronics.ca jerseyschinabizwholesale.us
itservicesthatworkforyou.com juliaworld.net
james13prix.info jurajskie.info
javatex.co.id kaac.ru
job.icivil.ir kaliningrad.zrus.org
kambasoft.com keki.info
kamen-e.ru kellyonline.xyz
keyhantercume.com ketrzyn.pl
keywesthideaways.co
keywordhouse.com
keywordsking.com
kino-rating.ru
kinomaniatv.pl
kinopolet.net
kladrus.ru
klumba55.ru klumba55.ru
knogg.net kol-energo.ru
kongoultry.net kollekcioner.ru
kredit-blog.ru komp-pomosch.ru
kutikomi.net koversite.info
lafourmiliaire.com kraljeva-sutjeska.com
lampokrat.ws krasivoe-hd.net
landoftracking.com krassh.ru
laptop-4-less.com kustanay.kz
laulini.soclog.se lacasamorett.com
legionalpha.com lanasshop.ru
laxob.com
lego4x4.ru
lemon-ade.site lemon-ade.site
lenpipet.ru levaquin750mg.blogspot.com
letmacwork.world li-er.ru
lflash.ru linksharingt.com
liffa.ru lion.playtap.us
limads.men lion.snapmap.us
liumimgx.pw live-sexcam.tk
live-cam6.info ljusihus.se
livefixer.com localmatchbook.com
livejasmin.com lonerangergames.com
lmrauction.com lonfon.xyz
lomb.co love-baby.cz
lombia.co lsex.xyz
lostfilm-online.ru m-google.xyz
lovelycraftyhome.com m5home.ru
mac-shield.com macdamaged.tech
machicon-ueno.info mainlinehobby.net
manipulyator-peterburg.ru maju.bluesalt.co
mantramusic.ru makenahartlin.com
marinetraffic.com
masterseek.com masterseek.com
masturbate.co.uk max-eclat.men
matchpal-a.akamaihd.net mebel-vstroika.ru
mebel-alait.ru mebelcomplekt.ru
megahdporno.net meddesk.ru
meget.co.za meds-online24.com
member-quiz.com meduza-consult.ru
merryhouse.co.uk meetingrainstorm.bid
mesto-x.com menetie.ru
metascephe.com methodsmarketing.com
mielec.pl mielec.pl
mil-stak.com mikrobiologies.ru
millionare.com militarysale.pro
mini-modus.ru minyetki.ru
miniature.io missvietnam.org
mixtapetorrent.com mister-shop.com
mixx.com mobilemedia.md
mnogolok.info
money-every-day.com
monitorwebsitespeed.com
montredemarque.nl
movies-in-theaters.net
mrcsa.com.au mrcsa.com.au
mrpornogratis.xxx mrinsidesales.com
msk-diplomat.com
muabancantho.info
muschisexbilder.com muschisexbilder.com
my-aladin.com myanyone.net
mybinaryoptionsrobot.com mygameplus.com
myfreetutorials.com mygameplus.ru
myperiod.club mzdish.site
na15.ru narkologiya-penza.ru
needtosellmyhousefast.com nash-krym.info
newstraveller.ru netanalytics.xyz
nippon-bearings.ru next-dentists.tk
nonews.co nfljerseyscheapbiz.us
norththeface.store nikkiewart.ru
nudejapan.net niroo.info
o-dachnik.ru nodding-passion.tk
o-o-8-o-o.com nodup.ru
ok-ua.info nordstar.pro
okeinfo.online npoet.ru
nudepatch.net
nzfilecloud.weebly.com
o-o-11-o-o.com
o-o-6-o-o.ru
oakridgemo.com
obiavo.su
ochistka-stokov.ru
offside2.5v.pl
offtime.ru
okroshki.ru okroshki.ru
old-rock.com
onlinedomains.ru
onlineporno.site
onload.pw onload.pw
ooomeru.ru oops-cinema.ru
open-odyssey.org openfrost.com
osagonline.ru opinionreelle.com
outrageousdeal-a.akamaihd.net ossmalta.com
oxotl.com otbelivanie-zubov.com
ozoz.it ozas.net
paintingplanet.ru paidonlinesites.com
paleohub.info paphoselectricianandplumber.com
paydayonlinecom.com paramountmarble.co.uk
perm.xrus.org partner-stop.men
perso.wanadoo.es partners-ship.pro
pinsdaddy.com patol01.pw
plastgranar.nu pavlodar.xkaz.org
plastjulgranar.se pay2me.pl
popander.mobi pcimforum.com
popserve.adscpm.net phormchina.com
pornofeuer.com photo.houseofgaga.ru
pornzone.tv pictures-and-images.com
pixell.club
pl.id-forex.com
plastgran.com
poffet.net
pokemongooo.ml
popup.matchmaker.com
porno-chaman.info
porno-dojki.net
pornotubexxx.name
portadd.men
potolokelekor.ru potolokelekor.ru
pourvous.info powitania.pl
preconnubial.usuby.site preconnubial.usuby.site
prefersurvey.net preventheadacheguide.info
privacyassistant.net privat-girl.net
prlog.ru privhosting.com
promoheads.com prod2016.com
prostitutki-yaroslavlya.org proekt-mos.ru
professionalwritingservices15.blogspot.ru
pronekut.com
prostitutki-belgoroda.org
pshare.biz pshare.biz
purplesphere.in pts163.ru
quelle.ru pulse33.ru
quickloanbank.com rarbg.to
rainbowice.ru realnye-otzyvy.info
raisedseo.com
ranksays.com
rankscanner.com
ranksonic.info
raschtextil.com.ua
rasteniya-vs-zombi.ru
real-time-analytics.com
reining.lovasszovetseg.hu reining.lovasszovetseg.hu
reklama1.ru reklamuss.ru
renecaovillasale.online remmling.de
renecaovilla.online
repeatlogo.co.uk
replicalouboutin.xyz replicalouboutin.xyz
rfserial.net ribieiendom.no
ric.info roofers.org.uk
ringporno.com ros-ctm.ru
rique.host.sk rostov.xrus.org
russia-today-video.ru rucrypt.com
rybalka-opt.ru running-line.ru
runofilms.ru
russia-tao.ru
russian-postindex.ru
sabaapress.com sabaapress.com
saddiechoua.com sakhboard.ru
salut-camp.ru sammlungfotos.online
saneitconsulting.com samolet.fr
sandhillsonline.com
saneyes.com
sarafangel.ru
satoristudio.net satoristudio.net
scanner-jane.top sbwealthsolutions.ca
scanner-jessica.top scanner-olga.top
scripted.com scoopquest.com
searchimage.co scrapinghub.com
searchmywindow-a.akamaihd.net seo-traffic-ranking.info
seksvideoonlain.com seo18.su
selectads.men service.adtech.fr
seo-smm.kz
seoexperimenty.ru
seojokes.net
seoprofiler.com
seorankinglinks.us
seryeznie-znakomstva.ru seryeznie-znakomstva.ru
sethrollins.net
sex-tracker.com sex-tracker.com
sexuria.net sexsaoy.com
sherlock.se shemale-sex.net
shtaketniki.kz simplesite.com
shtaketniki.ru siteaero.com
shtora66.ru sitechecker.pro
sisiynas.ru siteexpress.co.il
sk.golden-praga.ru skypasss.com
slimcdn.com smailik.org
social-s-ggg.xyz snow.nvr163.com
soheavyblog.com snyatie-lomki-v-stacionare.ru
solmarket.by soc-econom-problems.ru
sophang8.com social-buttons.xyz
soundfrost.org socialbuttons.xyz
souvenir.cc socialmonkee.com
speechfoodie.com softwaretrend.net
spitfiremusic.com soietvousmaime.fr
spywarenuker.com solitaire-game.ru
srgwebmail.nl sotkal.lark.ru
stackthatbucks.com specialfinanceoffers.com
stairliftstrue.com speeddream.xyz
stanthonyscatholicchurch.org sprttrack.com
stop-gepatit.te.ua sps-shop.com
streamin.to spy-app.info
stretchingabuckblog.com ssconstruction.co
stroiminsk.org stardevine.com
strongsignal-a.akamaihd.net strana-krasoty.ru
sundrugstore.com strigkaomsk.ru
superkanpo.com studiofmp.com
swinon.site swingerseiten.com
tako3.com tako3.com
technopellet.gr the-usa-games.blogspot.com
tedy.su thebestweightlosspills.ovh
teencastingporn.com theheroes.ru
teenfuck.tv thruport.com
tehngr.ru
tgtclick.com
thebluenoodle.com
thecounter.com
thedownloadfreeonlinegames.blogspot.com
thefotosgratis.eu
theguardlan.com
thiegs.reco.ws
timer4web.com
timetorelax.biz
tizanidine4mgstreetprice.blogspot.com
tizanidine4mgstreetvalue.blogspot.com
tizanidinecost.blogspot.com tizanidinecost.blogspot.com
tizanidinedosage.blogspot.com tizanidinedrugtest.blogspot.com
tizanidineoral.blogspot.com tizanidinevscyclobenzaprine.blogspot.com
tizanidinesideeffects.blogspot.com tomck.com
tizanidinesideeffectsweightloss.blogspot.com tongkatmadura.info
tizanidinevsvalium.blogspot.com tootoo.to
tomatis.gospartner.com top10registrycleaners.com
torrents.life topflownews.com
torrnada.ru toys.erolove.in
tracksurf.daooda.com track.deriv.com
traderzplanet.in
traffic100.com traffic100.com
trubywriting.com trafficfactory.biz
tubeoffline.com traffique.net
trkdf.com
truebeauty.cc
truemfilelj.gq
turizmus.us turizmus.us
twittrading.com tvoystartup.ru
typer.one twojebook.pl
u17795.netangels.ru u555u.info
uchil.net uasb.ru
ucsol.ru uchebavchehii.ru
umg-stroy.ru univerfiles.com
unimodemhalfduplefw.pen.io urdoot.win
unmaroll.ya.ru urengoy.pro
url-extractor.xyz v24s.net
us-america.ru vancleefreplica.pw
vacuumscleaner.com
validccseller.com
varbergsvind.se varbergsvind.se
verymes.xyz vashsvet.com
vesnatehno.com viandpet.com
videokrik.net vip2ch.com
videotuber.ru
vikistars.com
vipms.ru
virtuagirl.com
visitcambridge.org
vizag.kharkov.ua
vkonche.com
vkontarkte.com
voditeltrezviy.ru voditeltrezviy.ru
vonradio.com vzlom-na-zakaz.com
wareseeker.com warningzscaler.heraeus.com
warning.or.kr watch-movies.ru
watsonrealtycorp.com webix.me
webix.biz wemedinc.com
website-analytics.online whatistizanidine2mg.blogspot.com
weightatraining.com while.cheapwebsitehoster.com
whatzmyip.net wholesalejerseys-cheapest.com
wholesalejerseychinaoutlet.com wholesalejerseyscheapjerseys.us.com
woman-orgasm.ru wildworld.site
works.if.ua wineration.com
worldoffiles.ru winner7777.net
worldtraveler.world witherrom55.eklablog.fr
writingservices17.blogspot.ru woman-h.ru
wrz0iuebwhp5fg.freeddns.com world-mmo.com
wufak.com wosik-dach.service-for-web.de
x69ty.ru wowas31.ucoz.ru
xmlinde.com xaylapdiendanang.com
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai xblognetwork.com
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xerox-douglas.cf
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai xn----7sbahjd3btneuw1joc.xn--p1ai
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai xn----7sbifcamovvfggw9d.xn--p1ai
xn--80aikhbrhr.net xn----ctbbcjd3dbsehgi.xn--p1ai
xn--h1aakne2ba.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai xxx-cam.webcam
xnxxandxvideos.com xxxdatinglocal.us
xpresscare.ru xxxkaz.org
xvideosporn.biz xxxsiterips.xyz
yourothersite.com yaminecraft.ru
zaimite.ru yopoint.in
zajm-zalog-krasnodar.ru youdesigner.kz
zawyna.ua youtubologia.it
zeroredirect.com zaim-pod-zalog-krasnodar.ru
zone-kev717.info zakon-ob-obrazovanii.ru
zoompegs.com zarabotat-na-sajte.ru
zverokruh-shop.cz zeroredirect6.com
zvezdagedon.ru zhongwenlink.com
zynax.ua zigarettenonlinekaufen1.blox.pl
znaniyapolza.ru
znaturaloriginal.com

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03p.info 01apple.com
24-ak.ru 1001desert.com
7ooo.ru 11235813.webzdarma.cz
8558l.jobs.net 178evakuator178.ru
abcdeg.xyz 5elementov.ru
activepr.ru 6hopping.com
add-add.men 999webdesign.com
adman.gr abbanreddy.com
adultmeetonline.info above.com
advertisingtag.net aibolita.com
alekseevec.ru alert-jdh.xyz
alert-hgd.xyz allnews.md
amazon-seo-service.com amyfoxfitness.com
ampower.me android-style.com
amung.us angry-fermi-7633.arukascloud.io
anmysite.com
apiholdingmypage-a.akamaihd.net apiholdingmypage-a.akamaihd.net
arcadeplayhouse.com atlant-auto.info
arclk.net automobile-spec.com
artpicso.com babyguns.ru
atdedinotuho.tk bagcionderlab.com
atlasvkusov.ru baixar-musicas-gratis.com
avtocredit-legko.ru bard-real.com.ua
ayeartoforget.com battleforupdating.site
back.dog bausparen.bz.it
bangla-chat-uk-paralud.ga bayareaaeroclub.org
bannerconnect.net bestmouthwash.club
berlininsl.com bharatdefencekavach.com
bestcoin.cc bloggerads.net
bestdraws.com board.f00d.de
bjorkbacken.nu bonvillan.com
bluejays-jerseys.us bpro1.top
bmwhighperformers.com braintobe.win
boleznikogi.com bscodecs.com
bonux.nextview.ru buchananshardware.com
brainzpod.win buy-meds24.com
btc4u.ru buyhoverboard.com
buehne-fuer-menschenrechte.de buypuppies.ca
bum.com.ru candypeople.se
bumascloset.com canzoni.ru
buybest1.biz cartierbraceletsreplica.pw
cactussoft.biz cartierlovestore.com
cand.jp ceotrk.com
candiceloves.us
candycrushshop.com
cenokos.ru
cete.ru cete.ru
cfcl.co.uk cezartabac.ro
cheapbarbour.online cleanallvirus.com
christianlouboutinsaleonline.us clickintext.net
ciceros.co clickprotects.com
clmforexeu.com co.lumb.co
coldfilm.ru community.allhiphop.com
compliance-don.top compliance-george.xyz
compliance-john.top compliance-margo.top
compliance-walter.top coolyarddecorations.com
cool-wedding.net culturevie.info
covetnica.com danschawbel.com
crackzplanet.com demon-tweeks.com
cranly.net deplim.com
crynet.cc dirtpics.pw
customcollegeessays.net domaincheck.io
de.zapmeta.com download-walpaperhd.blogspot.com
deluxedumps.com doyouknowtheword-flummox.ml
derevesendeco.com driving.kiev.ua
detoxmed24.ru efnor-ac.com
dev33.dioniqlabb.se elektrozigaretten1.webs.com
dfwu1013.info eropho.com
digital-video-processing.com exchanges-bet.com
docsportal.net exoneration-project.us
download-of-the-warez.blogspot.com expertnaya-ocenka.ru
dstroy.su expolicenciaslatam.co
e705.net exportshop.us
electrik-avenue.com ezigarettenkaufen1.pagina.gr
elektrischezigarette2.onsugar.com fighrofacciufreesig.ga
elmifarhangi.com find1friend.com
ezigaretteshop2.mywapblog.com foxtechfpv.com
f07.de freeseedsonline.com
f0815.de freevpn.space
famix.xyz front.ru
filmfanatic.com fxund.us
franklinfire.co gabeshop.ru
free-deals.faith getmiro.com
free-fb-traffic.com ggiaro.com
ge0ip.com gifspics.com
ge0ip.net gigixo.com
gelezki.com gilbertbanda.net
girls-ufa.ru gomusix.com
gratuitbaise.com gorodservis.ru
handicapbathtubarea.com gosmeb.ru
hem.passagen.se gribkovye-zabolevaniya.com
herehloadibs.cf gsasearchengineranker.space
hermesbirkinhandbagoutlets.com hasfun.com
homegardenlova.com healgastro.com
hotblog.top helvetia.com.ua
hotcore.info hitsbox.info
hut1.ru hledejvshopech.cz
iamsport.org hothot.ru
ideawheel.com imgarit.pw
ideoworld.org inspiring-desperate.tk
impotentik.com instakink.com
infowarcraft.ru intelhdgraphicsgtdrive6w.metroblog.com
istripper.com investingclub.ru
iwantmyfreecash.com isoveti.ru
jav-fetish.site iusstf.org
javlibrary.cc jagg.info
javspace.net jyvopys.com
jimmychoosale.online kazan.zrus.org
joyceblog.top kidskunst.info
kareliatobacco.ru kinohit1.ru
kartiniresto.com kinopolet.net
kashubadesign.ru knogg.net
kazka.ru koleso24.com.ua
kino-rf.ru krasivye-devushki.net
koopilka.com lenpipet.ru
koronirealestate.gr letslowbefast.today
kotaku.com lineshops.biz
kovrenok.ru linkdebrideur.xyz
ku6.com lirunet.ru
kumuk.info lisque.batcave.net
kw21.org lostaruban.com
labplus.ru lovasszovetseg.hu
lakomka.com.ua magda-gadalka.ru
lenvred.org magiadinamibia.blogspot.com
lesbian.xyz magicplayer-s.acestream.net
letolove.ru mansparskats.com
lider-zhaluzi.kiev.ua maslenka.kz
lonerangergames.com masserect.com
magazin-pics.ru meetingrainstorm.bid
magento-crew.net mega-polis.biz.ua
mainhp.net megakino.net
master-muznachas.ru mere.host.sk
matrixalchemy.com mexicotravelnet.com
medicineseasybuy.com microsearch.ru
meetlocalchicks.com mini.7zap.com
mobplayer.ru mmoguider.ru
mobstarr.com mncrftpcs.com
moi-glazki.ru mnogabukaff.net
moje-recenze.cz monsterdivx.com
monetizer.com-01.site movies-in-theaters.net
mouselink.co moyakuhnia.ru
moz.com mrmoneymustache.com
muz-shoes.ru msk-diplomat.com
mwtpludn.review msk.afora.ru
mydirtyhobby.com mybackgroundlandscape.blogspot.com
mydoctorok.ru mydirtystuff.com
mysex21.com myfreemp3.eu
narkologiya-belgorod.ru myghillie.info
naturalshair.site na15.ru
new7ob.com natali-forex.com
obnal.org newyorkhotelsmotels.info
of-ireland.info noumeda.com
ofanda.com novodigs.com
okuos.com o-o-8-o-o.ru
omoikiri-japan.ru online-sbank.ru
onetravelguides.com ons-add.men
onstrapon.purplesphere.in ourville.info
openfrost.com oxotl.com
oynat.info ozas.net
page2rss.com paperwritingservice17.blogspot.ru
pandroid.co perfection-pleasure.ru
partners-ship.pro picsearch.com
phelissota.xyz plastgran.com
poisk-zakona.ru platinumdeals.gr
popunder.ru pornhive.org
porndl.org porno-play.net
porndroids.com pornosee.info
pornokajf.com potoideas.us
pornoklad.net preventheadacheguide.info
pornozhara.com princevc.com
projefrio.com.br pro-tec.kz
profitfx.online
prokotov.com prokotov.com
pshare.biz promover.org
qld10000.net pts163.ru
quality-traffic.com rainbowice.ru
queerspace.com rankexperience.com
quick-seeker.com regdefense.com
raavidesigns.com replica-watch.ru
rebelmouse.com reyel1985.webnode.fr
remontvsamare.su ringporno.com
resant.ru rocis.site
rimedia.org romhacking.ru
roll123.com rossmark.ru
rosbalt.com.ua running-line.ru
rusexy.xyz ryetaw.com
sa-rewards.co.za sabaapress.com
scanner-jess.top salmonfishingsacramentoriver.com
searchtooknow-a.akamaihd.net samara.rosfirm.ru
sel-hoz.com sammyweaver.com
serving.adbetclickin.pink santechnik.jimdo.com
sexkontakteao.info scalerite.co.za
sexpornotales.net seinterface.com
sexvporno.ru semp.net
sharebutton.net semrush.com
shopvilleroyboch.com.ua seocdvig.ru
signx.info seofied.com
site3.free-share-buttons.com sex-tracker.de
sitevaluation.com sexy.babes.frontend-stack.top
sitopreferito.it sexyali.com
sky-mine.ru shisha-swag.de
social-s-hhh.xyz shop.xz618.com
sockshares.tv siteripz.net
softwaretrend.net slim.sellany.ru
solmarket.by smokewithrabbits.com
soserfis.com sonata-arctica.wz.cz
stop-zavisimost.com spaceshipad.com
stromerrealty.com spb-plitka.ru
talant-factory.ru speedup-my.site
thaisamkok.com strongholdsb.ru
the-usa-games.blogspot.com support.nopeas.sk
tizanidine4mgprice.blogspot.com swimpool.ca
tizanidinehcl4mgisitanarcotic.blogspot.com tandvardshuset.net
tizanidinehclsideeffects.blogspot.com taximytishi.ru
tizanidineingredients.blogspot.com the-trader.net
tizanidinestreetprice.blogspot.com thedownloadfromwarez.blogspot.com
tizanidinevssoma.blogspot.com threecolumnblogger.com
tivolibasket.it
tn811.us
tourismvictoria.com tourismvictoria.com
tv-spoty.info trichizobswiv.agddns.net
ultimateclassicrock.com tripper.de
v720hd.ru trustedmaccleaner.com
viberdownload10.com tversvet.ru
videochaty.ru umaseh.com
vzlomtw.com uptime.com
watchmyfb.pl url-img.link
waysbetter.cn urll.eu
webalan.ru vasileostrovsky-rayon.ru
weboptimizes.com veles.shop
weburlopener.com via-energy-cumpara.com
westsextube.com vietimgy.pw
word-vorlagen.net viveresaniesnelli.it
worldtraveler.world vseuznaem.com
wrz0iuebwhp5fg.freeddns.com w7s.ru
www.bookmaker-bets.com webmasters.stackexchange.com
whatistizanidinehclusedfor.blogspot.com
wholesalejerseyscheapjerseys.us.com
wholinkstome.com
wjgony.com
x-diesel.com x-diesel.com
x69ty.ru xaylapdiendanang.com
xgftnlrt.bloger.index.hr xgftnlrt.bloger.index.hr
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai xpresscare.ru
xn----ctbbcjd3dbsehgi.xn--p1ai xxxnatelefon.ru
xn----itbeirbjbi7bc6bh2d.xn--p1ai yatrk.xyz
xn--80aafb2a.xn--p1ai yogamatsexpert.com
xn--80ahvj9e.xn--p1ai ypmuseum.ru
xn--e1aggki3c.xn--80adxhks zaim-pod-zalog-krasnodar.ru
yginekologa.com zarajbuilders.com
yuarra.pluto.ro zed21.net
yun56.co
zajm-pod-zalog-nedvizhimosti.ru
zeroredirect2.com
zetmaster.ru
zryydi.com
zscaler.net zscaler.net
zygophyceous.womanstars.site zvezdagedon.ru

181
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,93 +8,6 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -494,6 +407,90 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -584,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.18 0; 10.1.0.117 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:01 UTC 2022 ### Updated: Fri Dec 9 10:12:47 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.12.3511 ### Version: V4.2022.12.3512
### Updated: Thu Dec 8 22:04:01 UTC 2022 ### Updated: Fri Dec 9 10:12:47 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##