vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.04.4458 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-04-24 22:04:53 +00:00
parent ae0d4299b9
commit 0a889a4e27
35 changed files with 55278 additions and 55261 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4457 #### Version: V4.2024.04.4458
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.04.4457 #### Version: V4.2024.04.4458
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.04.4457 #### Version: V4.2024.04.4458
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9164
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.04.4457 #### Version: V4.2024.04.4458
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [659](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9175
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9168
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9175
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4457 4458

9168
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9168
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.198 0; 20.172.17.140 0;

9175
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 1; 10.1.1.136 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 0; 10.1.1.136 0;
127.0.0.1 0; 127.0.0.1 0;

9175
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 1; 10.1.1.136 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 0; 10.1.1.136 0;
127.0.0.1 0; 127.0.0.1 0;

9175
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 1; 10.1.1.136 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 0; 10.1.1.136 0;
127.0.0.1 0; 127.0.0.1 0;

9175
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.198 0; 20.172.17.140 0;

9175
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
172.183.162.198 0; 20.172.17.140 0;

9175
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 1; 10.1.1.136 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BBBike AhrefsBot
Blackboard Domains Project
Citoid GrapeshotCrawler
IDBot Jorgee
Majestic12 LexiBot
MauiBot LinkScan
SalesIntelligent MSFrontPage
SemrushBot Needle
Sogou web spider
Zade Zade
openai.com

166
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
404checker 404checker
404enemy
ALittle Client ALittle Client
Acunetix
AdsTxtCrawlerTP
Aipbot
Alexibot Alexibot
Anarchy99 Alligator
Aspiegel AwarioRssBot
Attach Barkrowler
AwarioBot BetaBot
AwarioSmartBot Buddy
Bandit BuzzSumo
Battleztar Bazinga CATExplorador
Black Hole CSHttp
Blow CazoodleBot
Boardreader
CODE87
ChatGPT-User ChatGPT-User
CheeseBot Cloud mapping
ChinaClaw CrunchBot
Cogentbot Dispatch
CyotekWebCopy Dotbot
Discobot ExtractorPro
Dragonfly Flunky
EroCrawler GalaxyBot
ExtLinksBot GetRight
Extractor Go!Zilla
Extreme Picture Finder Gotit
Ezooms GridBot
FHscan HEADMasterSEO
Firefox/7.0
Go-Ahead-Got-It
Harvest
Havij
HonoluluBot HonoluluBot
IRLbot IlseBot
IndeedBot Joomla
Internet Ninja Kozmosbot
LeechFTP
LeechGet
LexiBot LexiBot
Libwhisker
LinkScan LinkScan
LinqiaScrapeBot LinksManager
Majestic-SEO LinqiaMetadataDownloaderBot
Masscan Lipperhey Spider
MauiBot Litemage_walker
MeanPath Bot Ltx71
MegaIndex.ru MarkMonitor
Mata Hari
MicroMessenger MicroMessenger
Microsoft URL Control Mr.4x3
Minefield Musobot
Moblie Safari Navroad
Morfeus Fucking Scanner Needle
Netcraft
Nibbler Nibbler
OrangeBot Nikto
Panscient Offline Navigator
ProPowerBot OutclicksBot
Probethenet PECL::HTTP
QueryN Metasearch Pavuk
Rainbot Piepmatz
Pump
PxBroker
PyCurl
RankFlex
ReGet ReGet
Searchestate RedesScrapy
SearchmetricsBot RocketCrawler
SemanticJuice Rogerbot
SeobilityBot SEOkicks-Robot
SEOprofiler
SMTBot
Scanbot
ScoutJet
Scrapy
ScrepyBot
Semrush
Shodan
Site Sucker Site Sucker
SiteSucker Sitebeam
Snapbot Sosospider
Spammen SpankBot
Steeler
Sucker
T0PHackTeam T0PHackTeam
Teleport Telesoft
Telesphorep TightTwatBot
TheNomad TinyTestBot
TurnitinBot Toweyabot
TwengaBot WISENutbot
UnisterBot WWW-Collector-E
Upflow
WeSEE WeSEE
Web Enhancer Web Enhancer
Web Fetch WebPix
Web Fuck Website Quester
WebWhacker Woobot
Webalta Zermelo
WebsiteQuester com.plumanalytics
Whack crawler4j
WiseGuys Robot domainsproject.org
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zade
ZyBorg
archive.org_bot
isitwp.com isitwp.com
linkdexbot meanpathbot
lwp-trivial
netEstate NE Crawler netEstate NE Crawler
probe-image-size probe-image-size
seostar scalaj-http
zgrab seobility
seocompany.store
webgains-bot
webmeup-crawler

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adamoads.com anal-acrobats.com
cialiswithoutadoctor.net davebestdeals.com
dorratex.tn emerson-rus.ru
freetangodownload.com io9.com
igru-xbox.net lawyers.cafe
nuker.com mantramusic.ru
steame.ru popup-fdm.xyz
supervesti.ru siteonomy.com
theprofitsmaker.net strana-solnca.ru
zona-aqua.ru unionmarkt.de

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
12bet.com 1xbet4you.com
51.la 2nt.ru
absolute-s.ru adanih.com
acads.net adtech.de
aero2.ru adultmeetonline.info
aerogo.com ameblo.top
alfa9.com apiqualitinknet-a.akamaihd.net
alkoravto.ru app-ready.xyz
allkrim.com arate.ru
amehdaily.com asociatia-tipografilor-transilvania.ro
anaksma.info ayodhya.co
arclk.net back.dog
azartniy-bonus.com bala.getenjoyment.net
barbourjackets.online
beauty-clinic.ru
besthomemadepornsites.com
biznesrealnost.ru
bloggen.be
blogrankers.com blogrankers.com
buttons-for-website.com bonzibuddi.com
buynorxx.com bristolhostel.com
buypillsorderonline.com brus-vsem.ru
canvas.gloverid.site buyessayonline19.blogspot.ru
cardsdumps.com chidporn.com
ciproandtizanidine.blogspot.com christianlouboutinreplica.win
clayvasedesigns.tk clickprotects.com
codysbbq.com compliance-alexa.xyz
contentlook.co descargar-musica-gratis.net
cool-wedding.net egvar.net
deshevo-nedorogo.ru elmacho.xyz
designdevise.com eonpal.com
dieswaene.com familyphysician.ru
dostavimvdom.ru faracontrol.ir
doxyporno.com fellowshipoftheminds.com
electronicadirect.com fermersovet.ru
ereko.ru filesvine.com
ezigaretteshop.webs.com game300.ru
farmprofi.net gate5.co.za
fillmewithhappiness.com gratuitxblcodes.com
filunika.com.ru gwebtools.com.br
formulaantiuban.com hatdc.org
fortwosmartcar.pw havepussy.com
genericviagrasildenafiled.net hildinghr.se
ghernnqr.skyrock.com howtowhitenteethfast.xyz
glasof.es ilovevitaly.com
goroda-vsego-mira.ru incomekey.net
herehloadibs.cf janerikholst.se
hotsocialz.com kaliningrad.zrus.org
itsdp3.com keywordsdoctor.com
kino2018.cc lostfilm-online.ru
konica.kz mactechinfo.info
letsrepair.in masterseek.com
lirunet.ru minharevisao.com
littlesexdolls.com misslike.ru
lowephotos.info mnimmigrantrights.net
macnewtech.com moncleroutletonline.pw
maridan.com.ua mostantikor.ru
mobilierland.com mouselink.co
modenamebel.ru msk-diplomat.com
mojpregled.com my-bc.ru
mriyadh.com news-speaker.com
myfreemp3.eu nudo.ca
myonlinepayday.co odesproperty.com
myprintscreen.com picturesfrom.com
newstudio.tv pokerniydom.ru
ningessaybe.me popmarker.com
no-rx.info pornhubforum.tk
nosecret.com.ua pretty-mart.com
nzfilecloud.weebly.com pushdata.sendpulse.com
ohmyrings.com qualitymarketzone.com
ok.ru realtytimes.com
origin-my.ru regionshop.biz
paphoselectricianandplumber.com rusoft-zone.ru
pl-vouchers.com see-your-website-here.com
poquoson.org shell-pmr.ru
privatefx.all4invest.info site-analyzer.com
proftests.net soc-econom-problems.ru
prokotov.com solmarket.by
sad-torg.com.ua spacash.com
sexvporno.ru spywarenuker.com
sexyteens.hol.es star61.de
small-game.com studiofaca.com
socialmadesimple.com support.nopeas.sk
speeddream.xyz taqywu51.soup.io
superoboi.com.ua tizanidineandhydrocodone.blogspot.com
syvertsen-da.no tizanidinevssoma.blogspot.com
t-bygg.com tizanidinewithdrawal.blogspot.com
tasteidea.com tmtrck.com
thedownloadfromwarez.blogspot.com trichizobswiv.agddns.net
tizanidineoral.blogspot.com ttsq.fr
topclickguru.com vielporno.net
tubeline.biz wahicbefa31.soup.io
umaseh.com whipme.yopoint.in
uptimechecker.com wordpress-crew.net
usadacha.net xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
uvozdeckych.info xn--80ahvj9e.xn--p1ai
videochat.mx xxxnatelefon.ru
whatsappbot.flyland.ru youporn-ru.com
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai zakazfutbolki.com
xxart.ru zarabiaj-dzis.pl
xzlive.com
yoopsie.com
you-shall-not-pass.is74.ru
yourothersite.com
znakomstva-moskva77.ru

29
dev-tools/test_units/ratelimittest-master.txt
View file

@ -1,11 +1,14 @@
<html> <!DOCTYPE html>
<head><title>503 Service Temporarily Unavailable</title></head> <html>
<body> <head>
<center><h1>503 Service Temporarily Unavailable</h1></center> <title>Welcome to NginX</title>
<hr><center>nginx/1.18.0 (Ubuntu)</center> </head>
</body> <body>
</html> <div align=center>
<html> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
@ -641,14 +644,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.33 0; 10.1.1.136 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4457 ### Version: V4.2024.04.4458
### Updated: Wed Apr 24 12:57:22 UTC 2024 ### Updated: Wed Apr 24 22:01:08 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.04.4457 ### Version: V4.2024.04.4458
### Updated: Wed Apr 24 12:57:22 UTC 2024 ### Updated: Wed Apr 24 22:01:08 UTC 2024
### Bad Bot Count: 659 ### Bad Bot Count: 659
################################################### ###################################################
### Version Information ## ### Version Information ##