vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.07.4598 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-07-02 22:07:13 +00:00
parent 58598545c1
commit a4e42e6e12
33 changed files with 255 additions and 244 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4597 #### Version: V4.2024.07.4598
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4597 #### Version: V4.2024.07.4598
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.07.4597 #### Version: V4.2024.07.4598
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.07.4597 #### Version: V4.2024.07.4598
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

5
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4597 ### Version: V3.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:32 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8585,6 +8585,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4597 4598

5
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4597 ### Version: V3.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:32 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8585,6 +8585,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.14.149 0; 20.55.15.80 0;

5
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.14.149 0; 20.55.15.80 0;

5
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.55.14.149 0; 20.55.15.80 0;

5
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:50 UTC 2024 ### Updated: Tue Jul 2 22:03:31 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8584,6 +8584,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 1; 10.1.0.45 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Buddy Badass
Ebingbong HTMLparser
Freeuploader Kenjin Spider
LWP::Simple MIIxpc
LinqiaScrapeBot MauiBot
Name Intelligence MicroMessenger
Openfind Musobot
Searchestate Snake
TheNomad WebEnhancer
Voltron Xaldon_WebSpider

164
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
ADmantX ADmantX
Acunetix ALittle Client
AiHitBot Anarchie
Anarchy Anthill
AwarioSmartBot Attach
Backlink-Ceck AwarioBot
BatchFTP AwarioRssBot
BetaBot BacklinkCrawler
Buck Bandit
Barkrowler
Battleztar Bazinga
Blow
Buddy
Bullseye
Bytespider
Calculon Calculon
ChatGPT-User
CheeseBot
Chlooe
Citoid Citoid
Cliqzbot Copyscape
DBLBot DatabaseDriverMysqli
DTS Agent Deusu
DomainSigmaCrawler DigitalPebble
Dotbot DittoSpyder
Evil DomainCrawler
ExtractorPro Domains Project
FHscan EMail Siphon
FyberSpider EMail Wolf
HMView EasyDL
Heritrix Ebingbong
IRLbot Freeuploader
Id-search Getintent
Information Security Team InfraSec Scanner Google-Extended
InfraSec Scanner IDBot
Iria IlseBot
Jetty Image Fetch
JikeSpider Intelliseek
Kinza InternetSeer
Iskanie
Keybot Translation-Search-Machine
Keyword Density
Lanshanbot Lanshanbot
LeechFTP LeechFTP
LexiBot Lightspeedsystems
Lftp Likse
LinkWalker LinksManager
Lipperhey Lipperhey
Lipperhey Spider Lmspider
MQQBrowser
Magnet
Majestic-SEO Majestic-SEO
Majestic12
Mass Downloader
Mb2345Browser Mb2345Browser
Meanpathbot Microsoft Data Access
Minefield
NPbot NPbot
NearSite Nameprotect
Net Vampire Netvibes
NetMechanic Nibbler
Netcraft Nimbostratus
NimbleCrawler OrangeSpider
OnCrawl PageAnalyzer
OrangeBot Panscient
POE-Component-Client-HTTP Papa Foto
Pandalytics Picscout
PeoplePal Piepmatz
Pixray RebelMouse
Rainbot
RankingBot2
RocketCrawler RocketCrawler
ScrepyBot SEOstats
SMTBot
SemanticJuice
SentiBot
SeoSiteCheckup
Seomoz Seomoz
Sqlworm SiteSnagger
Sucker Sitebeam
TeleportPro SmartDownload
Telesoft Snake
Telesphorep Snoopy
Toata Sogou web spider
TwengaBot SuperBot
Twice T0PHackTeam
Vagabondo
VoidEYE
Voil
WBSearchBot WBSearchBot
WEBDAV Web Pix
WPScan WebAuto
WWWOFFLE
Wallpapers/3.0
Web Sucker
WebCopier
WebReaper WebReaper
Webshag WebSucker
WebsiteExtractor
WebsiteQuester WebsiteQuester
Widow Widow
WiseGuys Robot Wonderbot
Woobot YaK
archive.org_bot archive.org_bot
awario.com cah.io.community
clark-crawler iubenda-radar
dataforseo.com
facebookscraper
internetVista monitor
magpie-crawler
meanpathbot
mediawords mediawords
ripz probe-image-size
satoristudio.net seobility
seocompany.store
seostar
trendiction.com trendiction.com
ubermetrics-technologies.com xpymep1.exe
voyagerx.com
webmeup-crawler

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adventureparkcostarica.com californianews.cf
btvn.ru com-secure.download
golfresa.lucania.se covetnica.com
gpirate.com flex4launch.ru
id-forex.com fyl.com.ru
piccdata.com myiptest.com
pixelrz.com sodexo.com
pornotubexxx.name softlinesolutions.me
pufip.com watchmyfb.pl
simple-share-buttons.com website-analyzer.info

200
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
2daytrendingnews.com 202ch.com
51.la 4istoshop.com
abovetherivernc.com adservme.com
aktobe.xkaz.org afslankpillen2017nl.eu
alfapro.ru ageofclones.com
anime.dougasouko.com aghanyna.com
appleid-verification.com alive-ua.com
arquivo.pt api.stathat.com
axbocz.net ardimobileinfo.ml
bangla-chat-uk-paralud.ga bestwrinklecreamnow.com
bannerswap.com biketank.ga
bloke.com bnt-team.com
brateg.xyz brus-vsem.ru
bvlgaribracelet.xyz bukleteg.xyz
callstevens.com burkesales.com
cartierbracelet.xyz carstrends2015.com
chatroulette.life christianlouboutinreplica.win
cialischsrx.com cialis-samples.com
cienum.fr clipartnew.com
compliance-jess.top contentlook.co
cordstrap.cc doreenblog.online
demenageur.com doxyporno.com
dimaka.info druzhininevgeniy63.blogspot.com
dinkolove.ya.ru e-poker-2005.com
dogbreedspicture.net elektrozigarette1.dreamwidth.org
elektrischezigarette2.devhub.com encodable.com
elektrozigarettekaufen1.devhub.com fix-website-errors.com
erotische-geschichten-xxl.com flashbannernow.com
essay-edu.biz fr-bearings.ru
eyessurgery.ru generousdeal-a.akamaihd.net
fermersovet.ru gepezz.info
fetlifeblog.com girlporn.ru
freshsuperbloop.com glavprofit.ru
gotomontenegro.net gloverid.site
hacktougroup.ru googlepositions.com
hatedriveapart.com gsbs.com.ua
hoterika.com gsmtlf.ru
hotshoppymac.com gungamesz.com
humanorightswatch.org hannasolution.ru
husky-shop.cz hawaiisurf.com
idegenvezeto.eu health-medical-portal.info
ilo134uloh.com heartofbeijing.blogspot.com
immobiliaremassaro.com highland-homes.com
impisr.edunsk.ru hotelcrocenzi.sm
iskalko.ru indetiske.ya.ru
karusel-market.ru int.search.tb.ask.com
kazrent.com ipostroika.ru
kinofak.net kenaba.su
konteiner24.com keywords-monitoring-your-success.com
kovrenok.ru kidd.reunionwatch.com
labplus.ru konica.kz
linerdrilling.com krasivoe-hd.com
lion.snapmap.us loadingpages.me
liupis.com mansparskats.com
lombia.com mebel-alait.ru
longlifelomilomi.info monclerjacketsoutlet.pw
mediaoffers.click mydirtystuff.com
my-bc.ru mykings.pw
mybinaryoptionsrobot.com mypornfree.ru
myliveblog.ru nalogovyykodeks.ru
news-speaker.com narkologiya-belgorod.ru
noumeda.com nikkiewart.ru
offer.wpsecurity.website nudejapan.net
ownshop.win nzfilecloud.weebly.com
patol01.pw one-gear.com
pendelprognos.se portnoff.od.ua
pills24h.com rankings-analytics.com
popugauka.ru reimageplus.com
popunder.net rewardpoll.com
powitania.pl rusexy.xyz
profitsport.club rutor.vip
promover.org sale-japan.com
prosmibank.ru samoiedo.it
puteshestvennik.com search-error.com
reeyanaturopathy.com sexy-pings.com
retreatia.com shijian.ac.cn
rightenergysolutions.com.au shohanb.com
saveriopiazza.it sierraapps.com
score-ads.men site3.free-share-buttons.com
se-welding.ru smallseotools.com
searchimpression.com spb-plitka.ru
sherlock.se sprttrack.com
slayerlife.com srecorder.com
slimcdn.com timeallnews.ru
sloopyjoes.com tizanidinecost.blogspot.com
sluganarodu.ru tryrating.com
steebook.com twu.com.ua
sterva.cc tx41tclega.ru
stjamesschool.info vacances-voyages.info
terraclicks.com vietimgy.pw
tkanorganizma.ru visitcambridge.org
toxicwap.com watchinf.com
ukrtextbook.com webpromotion.ae
westen-z.life webs.com
whereiskentoday.com websites-reviews.com
worldis.me xedserver.com
xn--80ajbshivpvn2i.xn--p1ai xkaz.org
xn--80atua3d.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai
xxxtubesafari.com yurgorod.ru
yunque.pluto.ro zrus.org

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.111 0; 10.1.0.45 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:51 UTC 2024 ### Updated: Tue Jul 2 22:03:32 UTC 2024
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4597 ### Version: V4.2024.07.4598
### Updated: Tue Jul 2 10:05:51 UTC 2024 ### Updated: Tue Jul 2 22:03:32 UTC 2024
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
### Version Information ## ### Version Information ##