vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.07.4603 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-07-05 10:09:32 +00:00
parent c9922b1b40
commit 5c0985e7ce
34 changed files with 276 additions and 245 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4602 #### Version: V4.2024.07.4603
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.07.4602 #### Version: V4.2024.07.4603
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.07.4602 #### Version: V4.2024.07.4603
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.07.4602 #### Version: V4.2024.07.4603
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [662](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

5
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist-testing-version.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4602 ### Version: V3.2024.07.4603
### Updated: Thu Jul 4 22:03:20 UTC 2024 ### Updated: Fri Jul 5 10:05:50 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8590,6 +8590,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4602 4603

5
dev-tools/globalblacklist-testing.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V3.2024.07.4602 ### Version: V3.2024.07.4603
### Updated: Thu Jul 4 22:03:20 UTC 2024 ### Updated: Fri Jul 5 10:05:50 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8590,6 +8590,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

5
dev-tools/globalblacklist.template
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.159.142.99 0; 74.249.14.164 0;

5
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.137 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.137 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.137 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.137 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.137 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.137 0;
127.0.0.1 0; 127.0.0.1 0;

5
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.159.142.99 0; 74.249.14.164 0;

5
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.159.142.99 0; 74.249.14.164 0;

5
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

@ -4,8 +4,8 @@
### VERSION INFORMATION # ### VERSION INFORMATION #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:19 UTC 2024 ### Updated: Fri Jul 5 10:05:49 UTC 2024
### Bad Referrer Count: 7104 ### Bad Referrer Count: 7104
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
@ -8589,6 +8589,7 @@ geo $validate_client {
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ### # END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# END KNOWN BAD IP ADDRESSES ### DO NOT EDIT THIS LINE AT ALL ###
# -------------------------- # --------------------------
# WHITELIST Google IP Ranges # WHITELIST Google IP Ranges

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 1; 10.1.0.137 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Badass Attach
BuiltWith Foobot
Crawling at Home Project InfoNaviRobot
Exabot Lftp
InternetSeer Mojolicious
Web Fetch Niki-bot
Webshag TurnitinBot
Wotbox Typhoeus
ZyBorg Virusdie
backlink-check WebLeacher

174
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
01h4x.com Attach
404checker BatchFTP
80legs Black Hole
ASPSeek BlowFish
Acunetix BotALot
AllSubmitter
AwarioBot
AwarioSmartBot
BackDoorBot
BetaBot
Bitacle
Brandwatch
BuiltBotTough BuiltBotTough
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Citoid
Crawling at Home Project Crawling at Home Project
CrunchBot
DatabaseDriverMysqli
DigitalPebble DigitalPebble
DomCopBot DittoSpyder
DomainCrawler
DomainStatsBot DomainStatsBot
Dotbot Dragonfly
Ebingbong ECCP/1.0
Ecxi EirGrabber
Extreme Picture Finder FacebookBot
Foobot Freeuploader
FrontPage Grafula
GetRight
Go-Ahead-Got-It
HEADMasterSEO
HTMLparser HTMLparser
Image Fetch Humanlinks
Kenjin Spider HybridBot
Keybot Translation-Search-Machine Id-search
Leap ImagesiftBot
Likse IndeedBot
MSIECrawler Indy Library
MTRobot InfraSec Scanner
Mag-Net IstellaBot
Mass Downloader Keyword Density
Mata Hari LWP::Simple
Mojeek Larbin
Linkbot
MSFrontPage
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mb2345Browser
Minefield
Moblie Safari
Mr.4x3
Musobot
NPbot
Nameprotect Nameprotect
Netvibes Needle
Nibbler
Nikto
Offline Navigator
OnCrawl OnCrawl
PECL::HTTP Openfind
Page Analyzer OutclicksBot
Panscient
Pi-Monster Pi-Monster
ProPowerBot RankingBot2
Psbot Rankivabot
PyCurl RepoMonkey
QueryN Metasearch Rogerbot
Quick-Crawler
Re-re
Reaper
Recorder
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOprofiler
SearchmetricsBot SalesIntelligent
SemrushBot ScoutJet
SenutoBot SentiBot
SeoSiteCheckup
SiteExplorer SiteExplorer
SiteSucker Sitevigil
Sqworm SmartDownload
Stripper SuperHTTP
Surfbot
SurveyBot SurveyBot
Suzuran Szukacz
T0PHackTeam Thumbor
T8Abot Trendiction
TeleportPro True_Robot
Telesphoreo TurnitinBot
Telesphorep Twice
TheNomad V-BOT
VCI VB Project
VelenPublicWebCrawler Vagabondo
WASALive-Bot WEBDAV
WWW-Mechanize WWW-Collector-E
Web Collage Web Fuck
Web Fetch
WebAuto WebAuto
WebFuck WebImageCollector
WebSauger WiseGuys Robot
Webster Xaldon WebSpider
Whacker Zermelo
Whatweb Zeus
Wotbox ZumBot
YaK anthropic-ai
ZoomBot cah.io.community
autoemailspider eCatch
clark-crawler facebookscraper
crawl.sogou.com heritrix
crawler.feedback scalaj-http
netEstate NE Crawler scan.lol
seostar seoscanners
voyagerx.com serpstatbot
x09Mozilla sogouspider
zgrab sysscan
webprosbot

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aa8780bb28a1de4eb5bff33c28a218a930.com 7search.com
comeondog.info cookie-law-enforcement-hh.xyz
forumprofi.de credit-respect.ru
ku6.com geile-lelly.eu
nelc.edu.eg kupit-adenu.ru
proekt-gaz.ru rentalcarnavi.info
veerotech.com sextracker.be
vvon.co.uk studworks.org
webjam.com x-lime.net
zakazfutbolki.com xn--oogle-wmc.com

192
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
12masterov.com 7xc4n.com
2000k.ru adamoads.com
21h2o.com alta-realestate.com
4kplayer.pl anticrawler.org
adexprts.com asdfz.pro
adrunnr.com asscenihotosidea.blogspot.co.za
afmuseum.com autobrennero.it
alienwheels.de autowebmarket.com.ua
allboard.xobor.de balook.com
appearance-cool.com bestplacetobuyeriacta.jw.lt
arius.tech blog.koorg.ru
atlant-auto.info blog.yam.com
automobile-spec.com bonky.biz
besthomemadepornsites.com boole.onlinewebshop.net
bget.ru brandbucket.com
butstrap.space c-english.ru
cam-kontakte.org call-of-duty.info
cartierlove2u.xyz chatroulette.online
cb.iphantom.com chcu.net
cdnanalytics.xyz cherubinimobili.it
com-supportcenter.website
compliance-barak.top compliance-barak.top
compliance-fred.top compliance-don.top
comsysnet.com compliance-george.top
cyclobenzaprinevstizanidine.blogspot.com compucelunlock.net
de.zapmeta.com d0t.ru
depositfiles-porn.ga datsun-do.com
derevesendeco.com detskie-konstruktory.ru
djstools.com dgfitness.co
dojki365.online digital-video-processing.com
doreenblog.online discovertreasurenow.com
eduserver.net downloaddy.net
eksprognoz.ru dynainbox.com
elektroniksigaraankara.info egvar.net
elektronischezigarettekaufen1.myblog.de elektrischezigaretten2.beeplog.com
eyemagination.com empirepoker.com
fifa-coins.online eywords-monitoring-your-success.com
fil.ru fba-mexico.com
filmbokep69.com gallerylisting.com
gcup.ru googst2.ru
genericlowlatencyasiodriverhq.aircus.com gotomontenegro.net
getresponse.com greendream.com.ua
globetrotting-culture.ru handsandlegs.ru
go2mike.ru hdimagelib.com
grtyi.com intellekt21.ru
hanink.biz.ly intellektmedia.at
hostcritique.com intim-uslugi.info
icaseclub.ru jeremyeaton.co
infowarcraft.ru kiinomaniak.pl
inmate-locator.us koleso24.com.ua
isoveti.ru kotaku.com
krasula.pp.ua ks1234.com
le-clos-des-alouettes.com
lezbiyanki.net
likesdesign.com
live-sexchat.ru
locationdesaison.com locationdesaison.com
luxmagazine.cf martlinker.com
mackeeper-center.club
macnewtech.com
magicalfind-a.akamaihd.net
masterseek.com
minecraft-neo.ru
moi-glazki.ru moi-glazki.ru
mural.co montredemarque.nl
nastroyke.net mydownloadengine.com
o-o-8-o-o.ru obiavo.kz
online-templatestore.com omgtnc.com
orion-v.com online7777.com
partnerworkroom.men onstrapon.purplesphere.in
pinstake.com ownshop.cf
pizda.lol pawli.eu
pornoelita.info paydayloanslocal.com
pornogratisdiario.com pdns.cz
predmety.in.ua petsblogroll.com
pst2017.onlinewebshop.net pic-re.blogspot.com
regionshop.biz pix-hd.com
rustic-quiver.win pod-muzyku.club
rutor.group pornotubs.com
s8-nowy-wygraj.comli.com porodasobak.net
scottbywater.com preparevideosafesystem4unow.site
seocheki.net progonrumarket.ru
seorankinglinks.xyz pts163.ru
sexspornotub.com ranksonic.info
siteaero.com raschtextil.com.ua
sledstvie-veli.net rethinkwasteni.info
sonata-arctica.wz.cz robotixix.com
songplanet.ru sexvideo-sex.com
tkanorganizma.ru slimcdn.com
snsdeainavi.info
snworks.com
speedup-my.site
spin2016.cf
sugarkun.com
supermodni.com.ua
surgut.zrus.org
tizanidineduringpregnancy.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com
tomatis.gospartner.com tomatis.gospartner.com
triplepanda.xyz toonfamilies.net
turizm.bz tsan.net
txxx.com uhodzalijami.ru
ukrtvir.com.ua unrealcommander.org
velpanex.ru venta-prom.ru
vezuviy.su vonradio.com
video-hollywood.ru win-spy.com
weddingdresses.xyz you-shall-not-pass.is74.ru
weightatraining.com zarenica.net
worldhistory.biz zynax.ua
wyniki-lista.pl

20
dev-tools/test_units/ratelimittest-master.txt
View file

@ -858,4 +858,24 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.92 0; 10.1.0.137 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:20 UTC 2024 ### Updated: Fri Jul 5 10:05:50 UTC 2024
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.07.4602 ### Version: V4.2024.07.4603
### Updated: Thu Jul 4 22:03:20 UTC 2024 ### Updated: Fri Jul 5 10:05:50 UTC 2024
### Bad Bot Count: 662 ### Bad Bot Count: 662
################################################### ###################################################
### Version Information ## ### Version Information ##