vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.03.4340 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-03-02 05:08:24 +00:00
parent c1819c9f2b
commit c471d5c1c6
38 changed files with 60653 additions and 60635 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4339 #### Version: V4.2024.03.4340
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4339 #### Version: V4.2024.03.4340
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.03.4339 #### Version: V4.2024.03.4340
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

10062
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_generator_lists/bad-user-agents.list
View file

@ -1,4 +1,3 @@
axios
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -580,6 +579,7 @@ archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider autoemailspider
axios
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe check1.exe

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.03.4339 #### Version: V4.2024.03.4340
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

10069
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10069
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10069
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
dev-tools/_robots_input/robots-input.txt
View file

@ -579,6 +579,7 @@ archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider autoemailspider
axios
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe check1.exe

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4339 4340

10069
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10069
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.36 0; 172.183.51.126 0;

10069
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 1; 10.1.0.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 0; 10.1.0.9 0;
127.0.0.1 0; 127.0.0.1 0;

10069
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 1; 10.1.0.9 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 0; 10.1.0.9 0;
127.0.0.1 0; 127.0.0.1 0;

10069
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 1; 10.1.0.9 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -640,6 +640,7 @@
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;
"~*(?:\b)arquivo.pt(?:\b|)" 0; "~*(?:\b)arquivo.pt(?:\b|)" 0;
"~*(?:\b)autoemailspider(?:\b|)" 0; "~*(?:\b)autoemailspider(?:\b|)" 0;
"~*(?:\b)axios(?:\b|)" 0;
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 0; 10.1.0.9 0;
127.0.0.1 0; 127.0.0.1 0;

10069
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.36 0; 172.183.51.126 0;

10069
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.36 0; 172.183.51.126 0;

10069
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 1; 10.1.0.9 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -640,6 +640,7 @@
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;
"~*(?:\b)arquivo.pt(?:\b|)" 0; "~*(?:\b)arquivo.pt(?:\b|)" 0;
"~*(?:\b)autoemailspider(?:\b|)" 0; "~*(?:\b)autoemailspider(?:\b|)" 0;
"~*(?:\b)axios(?:\b|)" 0;
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Brandwatch Badass
DataCha0s BuiltBotTough
Lipperhey Spider Cocolyzebot
MSFrontPage DomainSigmaCrawler
MSIECrawler Fuzz
Mass Downloader GridBot
Niki-bot Mojolicious
RSSingBot Papa Foto
WebLeacher PyCurl
ZyBorg SenutoBot

166
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
01h4x.com 360Spider
404enemy 404enemy
ASPSeek AIBOT
Acunetix ALittle Client
AdsTxtCrawlerTP AhrefsBot
Ankit Ankit
Anthill BBBike
AwarioSmartBot BatchFTP
Bandit Battleztar Bazinga
Barkrowler
Bitacle
BotALot
BuiltBotTough BuiltBotTough
Bullseye
BunnySlippers BunnySlippers
BuzzSumo Bytespider
Curious CATExplorador
DIIbot Claritybot
Cocolyzebot
Cogentbot
Copier
Craftbot
DTS Agent DTS Agent
Digincore Demon
Dirbuster DomainSigmaCrawler
Discoverybot Domains Project
ECCP/1.0
EirGrabber EirGrabber
Express WebPictures
Extreme Picture Finder Extreme Picture Finder
Firefox/7.0 FDM
Fuzz Genieo
Fyrebot Google-Extended
GetRight IRLbot
GoZilla
HaosouSpider
Hloader
HybridBot
Iblog Iblog
Intelliseek IlseBot
Internet Ninja ImagesiftBot
JustView Iskanie
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
LNSpiderguy
Lanshanbot Lanshanbot
Likse LeechFTP
MJ12bot LeechGet
MQQBrowser Mail.RU_Bot
Majestic12 Majestic12
MarkWatch MarkWatch
MeanPath Bot Mass Downloader
Metauri Meanpathbot
Mojolicious MegaIndex.ru
Morfeus Fucking Scanner Microsoft Data Access
Net Vampire Minefield
NetZIP Mister PiX
Niki-bot MolokaiBot
Nuclei Mr.4x3
Offline Explorer Nettrack
Nibbler
Nikto
OpenVAS
PECL::HTTP PECL::HTTP
PHPCrawl Page Analyzer
PageScorer PageScorer
Pockey Pi-Monster
Pump PxBroker
RankingBot PyCurl
Reaper ReGet
Recorder RebelMouse
ScoutJet RedesScrapy
SeobilityBot RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
Scanbot
SearchmetricsBot
SeoSiteCheckup
SiteSnagger SiteSnagger
SmartDownload SiteSucker
Spanner Snake
SputnikBot Sociscraper
Sosospider
Spammen
Spbot
Stripper
SuperBot SuperBot
Suzuran T0PHackTeam
Telesphorep Turingos
TinyTestBot VCI
Toweyabot WWW::Mechanize
Trendiction Wallpapers
Trendictionbot Web Enhancer
UnisterBot WebAuto
Voil WebStripper
WASALive-Bot Wprecon
WallpapersHD Xaldon WebSpider
WeSEE Xenu
WebGo IS Zade
WebImageCollector arquivo-web-crawler
Webshag arquivo.pt
WebsiteExtractor dataforseobot
Who.is Bot gopher
Woobot heritrix
Xaldon_WebSpider
Zeus
archive.org_bot
autoemailspider
clark-crawler
cognitiveseo
crawler4j
dataforseo.com
lwp-request lwp-request
meanpathbot magpie-crawler
scan.lol omgili
sexsearcher seoscanners
sogouspider webpros.com
spyfu x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
adssafeprotected.com allkrim.com
coolingoods.com bracketsmackdown.com
free-share-buttons.blogspot.com gallerily.com
gaming-journal.com kimcurlrvsms.com
istock-mebel.ru laexotic.com
ixora.pro sanjosestartups.com
letto.by tizanidinevsvalium.blogspot.com
privacylocationforloc.com todohr.com
waycash.net yellowstonesafaritours.com
whatistizanidinehclusedfor.blogspot.com zetmaster.ru

200
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
45en.ru 100dollars-seo.com
aa9bd78f328a6a41279d0fad0a88df1901.com alldubai.biz
alif-ba-ta.com amazingpic.net
an-donut.com anlimebel.kiev.ua
android-systems.ru arkartex.ru
anonymizeme.pro bcmp.org
appearance-cool.com bestbrainprod.win
arquivo.pt bestofupload.info
autorn.ru bestwrinklecreamnow.com
avek.ru bloglag.com
avtovolop.ru bmsco.co
backiee.com buyscabiescream.com
billiard-classic.com.ua checkm8.com
bitcoins-live.ru compliance-elena.xyz
burn-fat.ga coolbar.pro
buybest1.biz coolingoods.com
casinopinup-wins.com crazyprotocol.com
cheapsergiorossi.online crest3d.ru
cpajunkies.com culmimg.pw
daretodonate.co deanmoore.ie
dimfour.com depositfiles-porn.ga
dokumentalkino.net deutschland123.de
domaincdn.xyz drugspowerstore.com
dyt.net easyshoppermac.com
enews.tech eets.net
exci.ru elektrischezi.canalblog.com
ezb.elvenmachine.com elektrozigaretten1.postbit.com
ezrvrentals.com elvenar.com
filefilter.weebly.com fanrto.com
filmfanatic.com foxjuegos.com
frankofficial.ru gearcraft.us
freeseedsonline.com getoutofdebtfree.org
gavuer.ru guitar-master.org
hdimagegallery.net hotenergy.ru
i4track.net ibb.com.ua
iklysha.ml informatiecentro.be
imagui.eu inspiring-desperate.tk
immobiliaremassaro.com interior-stickers.ru
indo-export.ru iplogger.org
innodgfdriverhm.aircus.com kadashihotel.com
justucalling32211123456789.tk kinobaks.com
kam-dom.ru letslowbefast.site
krasnodar.xrus.org linkredirect.biz
kretpicf.pw linksharingt.com
localflirtbuddies.com lowephotos.info
louisvuittonoutletstore.net luckyshop.net.ua
mensandals.xyz lunchrock.co
michaelkorssaleoutletonline.net mnogabukaff.net
misswell.net moetomnenie.com
musicstock.me mp3s.club
nero-us.com nacap.ru
nordstar.pro naturalbreakthroughsresearch.com
noscrapleftbehind.co nelc.edu.eg
okmusic.jp nomuos.it
paclitor.com obiavo.kz
photo.houseofgaga.ru odesproperty.com
pixell.club owathemes.com
plastjulgranar.se palvira.com.ua
pornoklad.net pdamods.ru
preventheadacheguide.info picsfair.com
privatefx-in.ru piuminiita.com
professionaldieselcare.com pr0fit-b0x.com
prostitutki-yaroslavlya.org profitwithalex.info
realresultslist.com prosperent.com
relax.ru pxhdwsm.com
remybutler.fr rcb101.ru
responsive-test.net rep-am.com
reversing.cc resultshub-a.akamaihd.net
roofers.org.uk rockma.se
sanyuprojects.com s8-nowy-wygraj.comli.com
scrapy.org sakhboard.ru
search.pch.com sbdl.no
searchimpression.com scanner-irvin.top
seksvideoonlain.com screentoolkit.com
sex-tracker.com sex-tracker.de
skuteczna-dieta.co.pl smartpet.ru
slujbauborki.ru softlinesolutions.me
smartadserver.com stats-collector.org
spinazdrav.ru streha-metalko.si
studiofmp.com stroyplus.ru
tackletarts.co success-seo.com
timecrimea.ru swingerseiten.com
tizanidinepain.blogspot.com tabakur77.com
tizanidinevssoma.blogspot.com thecoral.com.br
tjkckpytpnje.com thiegs.reco.ws
tmtrck.com tizanidinedruginteractions.blogspot.com
tobeyouday.win traffmonster.info
typer.one usswrite.com
universals.com.ua velpanex.ru
vektorpress.ru versaut.xxx-cam.webcam
viandpet.com video-woman.com
videochat.cafe vipromoffers.com
virtualbb.com website-speed-up.top
vita.com.hr wellcome2slovenia.ru
voloomoney.com ww1943.ru
vpnhowto.info xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
waterefficiency.co xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xjrul.com xxxmania.top
xn--80aeahghtf8ac5i.xn--p1ai youporn-forum.ga
zscaler.net zebramart.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.167 0; 10.1.0.9 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4339 ### Version: V4.2024.03.4340
### Updated: Fri Mar 1 22:01:10 UTC 2024 ### Updated: Sat Mar 2 05:04:44 UTC 2024
### Bad Bot Count: 655 ### Bad Bot Count: 656
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1177,6 +1177,8 @@ User-agent: arquivo.pt
Disallow:/ Disallow:/
User-agent: autoemailspider User-agent: autoemailspider
Disallow:/ Disallow:/
User-agent: axios
Disallow:/
User-agent: backlink-check User-agent: backlink-check
Disallow:/ Disallow:/
User-agent: cah.io.community User-agent: cah.io.community

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4339 ### Version: V4.2024.03.4340
### Updated: Fri Mar 1 22:01:10 UTC 2024 ### Updated: Sat Mar 2 05:04:44 UTC 2024
### Bad Bot Count: 655 ### Bad Bot Count: 656
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1177,6 +1177,8 @@ User-agent: arquivo.pt
Disallow:/ Disallow:/
User-agent: autoemailspider User-agent: autoemailspider
Disallow:/ Disallow:/
User-agent: axios
Disallow:/
User-agent: backlink-check User-agent: backlink-check
Disallow:/ Disallow:/
User-agent: cah.io.community User-agent: cah.io.community