V4.2023.09.4021 [ci skip]

AUTO-CONFIGURATION.md

@@ -4,7 +4,7 @@
 ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
 
 _______________
-#### Version: V4.2023.09.4020
+#### Version: V4.2023.09.4021
 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
 #### Bad User-Agents (Bots) Blocked: [645](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

MANUAL-CONFIGURATION.md

@@ -4,7 +4,7 @@
 ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
 
 _______________
-#### Version: V4.2023.09.4020
+#### Version: V4.2023.09.4021
 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
 #### Bad User-Agents (Bots) Blocked: [645](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

README.md

@@ -14,7 +14,7 @@
 ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
 
 _______________
-#### Version: V4.2023.09.4020
+#### Version: V4.2023.09.4021
 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
 #### Bad User-Agents (Bots) Blocked: [645](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

_google_analytics_ghost_spam/README.md

@@ -3,7 +3,7 @@
 # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
 
 _______________
-#### Version: V4.2023.09.4020
+#### Version: V4.2023.09.4021
 #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
 #### Bad User-Agents (Bots) Blocked: [645](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
 #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

dev-tools/buildnumber

@@ -1 +1 @@
-4020
+4021

dev-tools/test1_conf_files/bots.d/whitelist-ips.conf

@@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.57.65.99             0;
+20.57.41.156            0;

dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	1;
+10.1.0.71	1;
 127.0.0.1	1;

dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	0;
+10.1.0.71	0;
 127.0.0.1	0;

dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	1;
+10.1.0.71	1;
 127.0.0.1	1;

dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	0;
+10.1.0.71	0;
 127.0.0.1	0;

dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	1;
+10.1.0.71	1;
 127.0.0.1	1;

dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	0;
+10.1.0.71	0;
 127.0.0.1	0;

dev-tools/test2_conf_files/bots.d/whitelist-ips.conf

@@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.57.65.99             0;
+20.57.41.156            0;

dev-tools/test3_conf_files/bots.d/whitelist-ips.conf

@@ -45,4 +45,4 @@
 # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. 
 # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
 # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
-20.57.65.99             0;
+20.57.41.156            0;

dev-tools/test_units/blacklist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	1;
+10.1.0.71	1;
 127.0.0.1	1;

dev-tools/test_units/random-bots-for-test-quick.list

@@ -1,10 +1,10 @@
-CyotekWebCopy
+Calculon
-ExtractorPro
+Harvest
-GetWeb
+Mail.RU_Bot
-NICErsPRO
+Mata Hari
-Navroad
+RankActive
-NetMechanic
+Telesphorep
-SeekportBot
+Voil
-Widow
+Wallpapers/3.0
-Zauba
+Webster
-seostar
+dataforseo.com

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-ALittle Client
+Aipbot
-Aboundexbot
+AlphaBot
-AfD-Verbotsverfahren
-Anarchy
-AwarioSmartBot
 BBBike
-BDFetch
 Backlink-Ceck
-Bandit
+BetaBot
-Black Hole
+Bitacle
 Blackboard
-Boardreader
+BlowFish
-Bolt
-Bullseye
 BunnySlippers
+BuzzSumo
+Calculon
+CheTeam
 CherryPicker
-Crawling at Home Project
+Cogentbot
-DataCha0s
+Copier
-Deusu
+Custo
-Domains Project
+CyotekWebCopy
+Dirbuster
+Discobot
+DnyzBot
+DomainAppender
 Dotbot
-Dragonfly
+Download Wonder
-EMail Wolf
 Ezooms
-FHscan
+Fimap
-Fuzz
+FrontPage
-Grafula
+Fyrebot
-HTMLparser
+GermCrawler
-HTTP::Lite
+HaosouSpider
-Haansoft
+Heritrix
-InfoNaviRobot
+Iblog
-Internet Ninja
+Id-search
-JamesBOT
+IndeedBot
-JennyBot
+JOC Web Spider
-Jetty
+Jorgee
-Joomla
+LWP::Simple
-Keybot Translation-Search-Machine
+Lightspeedsystems
-LexiBot
+LinkScan
-Lftp
+LinkWalker
-Libwhisker
+LinkpadBot
-LinqiaRSSBot
 Lipperhey
-MFC_Tear_Sample
+Lipperhey Spider
-MSIECrawler
+MIDown tool
-MarkWatch
+Majestic12
-Mb2345Browser
+MegaIndex.ru
-Mojeek
+Metauri
-MolokaiBot
+Microsoft Data Access
+Microsoft URL Control
+Mister PiX
 Morfeus Fucking Scanner
-NICErsPRO
+Msrabot
 NextGenSearchBot
-Nibbler
+Nuclei
-Niki-bot
+Offline Explorer
-NimbleCrawler
+Openvas
-OnCrawl
 PECL::HTTP
+Papa Foto
+PeoplePal
 Pi-Monster
-ProWebWalker
+Picsearch
-Probethenet
+Piepmatz
-RankActive
+PleaseCrawl
-ReGet
+Pockey
+Proximic
+Reaper
+RepoMonkey
 Ripper
-SEOprofiler
+SEOlyticsCrawler
-Scrapy
+Scanbot
-SemanticJuice
+Sitevigil
-SenutoBot
+Snapbot
-Sitebeam
+Sogou web spider
-Sociscraper
+Spinn3r
-Spanner
+Stripper
-SuperHTTP
-SurveyBot
-Swiftbot
 Telesphoreo
-Typhoeus
+Toata
-VB Project
+Turingos
-Vagabondo
+UnisterBot
-VeriCiteCrawler
+VelenPublicWebCrawler
 Virusdie
-Web Enhancer
+Voltron
-Web Fetch
+Web Auto
-WebBandit
+WebCopier
-WebLeacher
+WebEnhancer
-WebSucker
+WebGo IS
-WebWhacker
+Webster
-Website Quester
+Widow
-Wonderbot
+Woobot
-Wotbox
+Xenu
-Wprecon
+ZoomBot
-YoudaoBot
+demandbase-bot
-Zade
+facebookscraper
-backlink-check
+heritrix
-coccocbot
+isitwp.com
-com.plumanalytics
+lwp-trivial
-crawler.feedback
+seobility
-crawler4j
+sexsearcher
-gopher
+webmeup-crawler
-instabid
+webpros.com
-iubenda-radar
+zgrab
-satoristudio.net
-scalaj-http

dev-tools/test_units/random-referrers-for-test-quick.list

@@ -1,10 +1,10 @@
-adservme.com
+1kinobig.ru
-avtoarenda.by
+asdfg.pro
-blogsfunky672.weebly.com
+compliance-andrew.xyz
-espaceinventoristes.com
+hazardky.net
-extstat.com
+investmac.com
-hard-porn.mobi
+most-kerch.org
-houtings.xyz
+pokemongooo.ml
-igtools.club
+spidtest.space
-mouselink.co
+staticfs.host
-urzedowski.eu
+zrus.org

dev-tools/test_units/random-referrers-for-whitelist-test.list

@@ -1,100 +1,100 @@
-202ch.com
+1-free-share-buttons.com
-add-add.men
+24videos.tv
-allornamenti.com
+adconscious.com
-asmxsatadriverin.aircus.com
+aimayangzhi.com
-beauty-b0x.pl
+allcredits.su
-bestwebsitesawards.com
+androids-store.com
-bigcities.org
+balitouroffice.com
-bigpenisguide.com
+bestmobilityscooterstoday.com
-bio-optomarket.ru
+bikini-image.com
-blogqpot.com
+brus.city
-brokergid.ru
 buynorxx.com
-callstevens.com
+bycontext.com
-citetick.com
+bzero1jewelry.net
-clickbank.net
+candypeople.se
-clickcash.com
+carstrends2015.com
-copyrightclaims.org
+cctva.tv
-crazyprotocol.com
+cdncash.net
-credit.co.ua
+cercacamion.it
-domaincrawler.com
+cezartabac.ro
-downloadmefiranaratb1972.xpg.com.br
+chcu.net
-e-collantes.com
+checkm8.com
-eurosamodelki.ru
+checkpagerank.net
-evidencecleanergold.com
+cleansearch.net
-evrotekhservis.ru
+cognitiveseo.com
-ezigarettenkaufen2.dreamwidth.org
+compliance-donald.xyz
-fastfixing.tech
+csgo4.win
-fettefrauen.net
+cutt.us
-filefilter.weebly.com
+elektrischezigaretten2.beeplog.com
-franch.info
+finansov.info
-freenom.link
+findsexguide.com
-gameonasia.com
+formseo.com
-gazobeton-p.com.ua
+foto-weinberger.at
-girlsfuckdick.com
+frighteningremain.cf
-howopen.ru
+game300.ru
-imperiafilm.ru
+gembird.com
-indo-export.ru
+get-seo-domain.com
-kamalsinha.com
+grupografico-pilar.com.ar
-keywesthideaways.co
+headpharmacy.com
-klumba55.ru
+hoztorg-opt.ru
-ku6.com
+hvd-store.com
-lirunet.ru
+int.search.tb.ask.com
-listiseltemournlan.gq
+invitefashion.com
-lordzfilmz.me
+kinoflux.net
-lyrster.com
+layola.biz.tc
-mainhp.net
+ledis.top
-max-eclat.men
+legalrc.biz
-menetie.ru
+letslowbefast.today
-mir-betting.ru
+light.ifmo.ru
-missclub.info
+mapquestz.us
-mixed-wrestling.ru
+marketland.ml
-mttwtrack.com
+masserect.com
-multgo.ru
+mediafresh.online
-ningessaybe.me
+medmajor.ru
-offergroup.info
+meds-online24.com
-onetravelguides.com
+mezaruk.info
-pomoc-drogowa.cba.pl
+mvpicton.co.uk
-pooleroadmedicalcentre.co.uk
+na15.ru
-popunder.net
+nootrino.com
-porndl.org
+onlineku.com
-porno-transsexuals.ru
+optikremont.ru
-pr0fit-b0x.com
+pics-group.com
-q-moto.ru
+pijoto.net
-retreatia.com
+pornogad.com
-rosbalt.com.ua
+prefersurvey.net
-scanner-ivan.top
+preg.marketingvici.com
-scripted.com
+profitsport.club
-seeingmeerkat.com
+questionmarque.ch
-sientalyric.co
+relayblog.com
-sky-mine.ru
+robotixix.com
-smart-scripts.com
+saltspray.ru
-smartbalanceworld.com
+sampleletters.net
-souvenir.cc
+saneitconsulting.com
-steebook.com
+sanyuprojects.com
-store-rx.com
+seo-2-0.com
-studiofaca.com
+seorankinglinks.com
-symphonyintegratedhealthcare.com
+sex-pr.net
-taqywu51.soup.io
+simul.co
-tattomedia.com
+slavkokacunko.de
-taximytishi.ru
+sumo.com
-terrafootwear.us
+superstats.com
-thewebsitetemplate.info
+svolze.com
-top-deal.com.pl
+tarad.com
-track-rankings.online
+tedxrj.com
-trumpetedextremes.com
+theendivechronicles.com
-tuberkuleznik.ru
+thejournal.ru
-typimga.pw
+thenetinfo.com
-udayavani.com
+tizanidinestreetvalue.blogspot.com
-umnovocaminho.com
+tsstcorpcddvdwshbbdriverfb.aircus.com
-uptimechecker.com
+tversvet.ru
-varikozdok.ru
+waterefficiency.co
-walkme.com
+wpsecurity.website
-wardreapptokone.tk
+x-lime.net
-warningwar.ru
+xboxster.ru
-whatzmyip.net
+xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
-word-vorlagen.xyz
+xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
-wzgyyq.com
+xn--b1addnj3cah.xn--p1ai
-xnxx699.com
+xolodremont.ru
-yhit.press
+yatrk.xyz
-zacreditom.ru
+yourads.website
+za-fun-offer.com

dev-tools/test_units/ratelimittest-master.txt

@@ -581,4 +581,14 @@
 <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
 <p>This is merely used for testing !!!</p>
 </body>
+</html><!DOCTYPE html>
+<html>
+<head>
+<title>Welcome to NginX</title>
+</head>
+<body>
+<div align=center>
+<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
+<p>This is merely used for testing !!!</p>
+</body>
 </html>

dev-tools/test_units/whitelist-ips.conf

@@ -1,2 +1,2 @@
-10.1.0.227	0;
+10.1.0.71	0;
 127.0.0.1	0;

dev-tools/tmp/robots.txt

@@ -6,8 +6,8 @@
 
 ### Version Information #
 ###################################################
-### Version: V4.2023.09.4020
+### Version: V4.2023.09.4021
-### Updated: Wed Sep 27 10:03:21 UTC 2023
+### Updated: Wed Sep 27 22:01:10 UTC 2023
 ### Bad Bot Count: 645
 ###################################################
 ### Version Information ##

robots.txt/robots.txt

@@ -6,8 +6,8 @@
 
 ### Version Information #
 ###################################################
-### Version: V4.2023.09.4020
+### Version: V4.2023.09.4021
-### Updated: Wed Sep 27 10:03:21 UTC 2023
+### Updated: Wed Sep 27 22:01:10 UTC 2023
 ### Bad Bot Count: 645
 ###################################################
 ### Version Information ##