vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.03.4344 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-03-03 04:55:57 +00:00
parent 7db8b4bcd6
commit 98f5ceefb5
37 changed files with 62565 additions and 62583 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4343 #### Version: V4.2024.03.4344
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.03.4343 #### Version: V4.2024.03.4344
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.03.4343 #### Version: V4.2024.03.4344
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

10384
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.03.4343 #### Version: V4.2024.03.4344
#### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7104](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [656](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

10391
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10391
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10391
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

1
dev-tools/_robots_input/robots-input.txt
View file

@ -579,7 +579,6 @@ archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider autoemailspider
axios
backlink-check backlink-check
cah.io.community cah.io.community
check1.exe check1.exe

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4343 4344

10391
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10391
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.47 0; 20.51.206.102 0;

10391
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 1; 10.1.0.127 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 0; 10.1.0.127 0;
127.0.0.1 0; 127.0.0.1 0;

10391
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 1; 10.1.0.127 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 0; 10.1.0.127 0;
127.0.0.1 0; 127.0.0.1 0;

10391
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 1; 10.1.0.127 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -640,7 +640,6 @@
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;
"~*(?:\b)arquivo.pt(?:\b|)" 0; "~*(?:\b)arquivo.pt(?:\b|)" 0;
"~*(?:\b)autoemailspider(?:\b|)" 0; "~*(?:\b)autoemailspider(?:\b|)" 0;
"~*(?:\b)axios(?:\b|)" 0;
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 0; 10.1.0.127 0;
127.0.0.1 0; 127.0.0.1 0;

10391
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.47 0; 20.51.206.102 0;

10391
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.171.122.47 0; 20.51.206.102 0;

10391
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 1; 10.1.0.127 1;
127.0.0.1 1; 127.0.0.1 1;

1
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -640,7 +640,6 @@
"~*(?:\b)arquivo-web-crawler(?:\b|)" 0; "~*(?:\b)arquivo-web-crawler(?:\b|)" 0;
"~*(?:\b)arquivo.pt(?:\b|)" 0; "~*(?:\b)arquivo.pt(?:\b|)" 0;
"~*(?:\b)autoemailspider(?:\b|)" 0; "~*(?:\b)autoemailspider(?:\b|)" 0;
"~*(?:\b)axios(?:\b|)" 0;
"~*(?:\b)backlink-check(?:\b|)" 0; "~*(?:\b)backlink-check(?:\b|)" 0;
"~*(?:\b)cah.io.community(?:\b|)" 0; "~*(?:\b)cah.io.community(?:\b|)" 0;
"~*(?:\b)check1.exe(?:\b|)" 0; "~*(?:\b)check1.exe(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AiHitBot Aboundex
Kinza FrontPage
LexiBot HTMLparser
Snake LWP::Simple
Spbot MegaIndex.ru
Titan Rankivabot
TurnitinBot SEOlyticsCrawler
WebBandit SiteSnagger
seoscanners check1.exe
webpros.com imagesift.com

168
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
Alligator 360Spider
Anarchy99 ASPSeek
Atomseobot Abonti
AfD-Verbotsverfahren
Aspiegel
AwarioRssBot AwarioRssBot
BDFetch BDFetch
BLEXBot BackStreet
BetaBot Bandit
Brandwatch BatchFTP
Buck Blackboard
BuiltWith Blow
Bytespider Bytespider
CCBot Cegbfeieh
ChatGPT-User ChinaClaw
Claritybot Citoid
Copier Cloud mapping
Copyscape Cosmos
CyotekWebCopy CyotekWebCopy
DTS Agent DIIbot
DatabaseDriverMysqli DSearch
Deusu EMail Siphon
Dispatch Ecxi
DnyzBot
DomCopBot
DomainAppender
EirGrabber EirGrabber
Express WebPictures Evil
Ezooms Flunky
FHscan GT::WWW
FyberSpider GetRight
Fyrebot GridBot
Go!Zilla HEADMasterSEO
GoZilla HTTP::Lite
HTTrack
IlseBot IlseBot
InfoNaviRobot Intelliseek
Jorgee IstellaBot
LNSpiderguy
LWP::Simple LWP::Simple
LeechFTP
LeechGet
LieBaoFast
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey
MJ12bot
MSFrontPage MSFrontPage
Majestic SEO Magnet
Majestic-SEO
Majestic12 Majestic12
MauiBot MarkWatch
MicroMessenger Masscan
Mister PiX Mata Hari
Mojeek Minefield
Morfeus Fucking Scanner Msrabot
NICErsPRO
Name Intelligence
Nameprotect Nameprotect
NetSpider NearSite
Niki-bot Nibbler
OpenLinkProfiler Nmap
Nuclei
OpenVAS OpenVAS
Page Analyzer PictureFinder
Pandalytics Pixray
Pavuk ProPowerBot
PeoplePal Rainbot
Petalbot RankActiveLinkBot
Pockey Recorder
RSSingBot RedesScrapy
RankFlex RocketCrawler
Ripper ScanAlert
Rogerbot ScreenerBot
Scrapy Searchestate
SearchmetricsBot SemrushBot
SmartDownload Shodan
SocialRankIOBot SiteExplorer
SpaceBison Sitevigil
Spbot SputnikBot
Sqlmap SurveyBot
Sucker Teleport
Surfbot TeleportPro
Szukacz The Intraformant
True_Robot TinyTestBot
V-BOT TurnitinBot
VB Project Typhoeus
Vagabondo Voil
WASALive-Bot WWW-Mechanize
WEBDAV Web Enhancer
Web Fuck
Web Sauger Web Sauger
WebWhacker
Whack Whack
Whatweb Whatweb
Zauba Wotbox
adscanner archive.org_bot
arquivo-web-crawler
arquivo.pt arquivo.pt
coccocbot backlink-check
cohere-ai dataforseobot
dataforseo.com isitwp.com
facebookscraper iubenda-radar
instabid mediawords
internetVista monitor page scorer
satoristudio.net polaris version
ubermetrics-technologies.com probe-image-size
webprosbot seobility
seostar
sp_auditbot
webmeup-crawler
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
1-free-share-buttons.com ahrntal.verymes.xyz
7fon.ru citetick.com
aarbur.com citysecurity.nu
allnews24.in glicol.kz
apple.com-cleaner.systems okonich.com.ua
contentsexpress.com porndl.org
istripper.com scanner-josh.top
parajumpersstore.online share-buttons-for-free.com
scanner-alex.top shlyahten.ru
social-s-ggg.xyz whatistizanidinehclusedfor.blogspot.com

196
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
00author.com alpinism.ru
101raccoon.ru animalrank.com
1pamm.ru aosexkontakte.net
20pascals.nl apper.de
4istoshop.com atmovs.com
aac500b7a15b2646968f6bd8c6305869d7.com autogrep.ru
abclauncher.com biocn.dx.am
abctoppictures.net bumascloset.com
adsref.men cartierbraceletsreplica.pw
adtiger.tk cartierlove2u.com
allesohnegirls.net cartierwatch.xyz
am-se.com choosecuisine.com
atelielembrancaqueencanta.com.br clickhype.com
avirasecureserver.com clubfashionista.com
azbaseimages.net compliance-willy.top
baikaleminer.com cosmetic.donna7753191.ru
best-mam.ru datadepths.com
bif-ru.info dfwu1013.info
boleznikogi.com donvito.unas.cz
candiceloves.us dostavka-v-krym.com
capture-room.com e-poker-2005.com
ceotrk.com efnor-ac.com
christianlouboutinreplica.pw elektroniksigaraankara.info
clickcash.com epicbrogaming.com
compliance-checker-7.info erotikstories.ru
compliance-josh.top essay-edu.biz
cornerstone-countertops.com fable.in.ua
costablue.xyz fortwosmartcar.pw
crafthubs.com fuckmill.com
credit-respect.ru getoutofdebtfree.org
deniven.1bb.ru greenidesign.co
diamond-necklace.info gsasearchengineranker.site
eager-nash.188-93-233-196.plesk.page gsou.cf
espaceinventoristes.com guidefs.ru
etotupo.ru hannasolution.ru
evening-dating-club.info hd-film.pl
evidencecleanergold.com hdseriale.pl
ezigarettenshop1.yolasite.com healmytrauma.info
flirt4free.com hostsshop.ru
foxweber.com houdom.net
freelifetimefuckbook.com house.sieraddns.com
friendflnder.com iminent.com
glastecfilms.com.my impisr.edunsk.ru
golden-catalog.pro impresagaia.it
golmau.host.sk infodocsportal.com
guiadeserraazul.com integritylandscapeservices.com
hitmuzik.ru intelhdgraphicsgtdrive6w.metroblog.com
ip-guide.com jerseyswholesalechinalimited.com
iqoption.com jjbabskoe.ru
ivoiretechnocom.ci keki.info
jagg.info khadastoafarde.tk
jwss.cc komputernaya-pomosh-moscow.ru
karadene.com labelwater.se
keywordhut.com localflirtbuddies.com
mnogabukaff.net medosmotr-ufa.ru
monetizationking.net metallosajding.ru
musicdaddy.net michaelkorsoutletstore.net
myxdate.info mtmtv.info
no-fuel.org muz-baza.net
nottyu.xyz mymercy.info
oda.as njkmznnb.ru
onlinemegax.com petitions.whitehouse.gov
ons-add.men pinup-casino1.ru
paparazzistudios.com.au pl-vouchers.com
partner-high.men playtap.us
perl.dp.ua ploenjitmedia.azurewebsites.net
poppen-nw.net poem-paying.gq
pornogig.com
pro-tec.kz
producm.ru producm.ru
prostitutki-rostova.org produkto.net
qwarckoine.com
replicalouboutin.xyz replicalouboutin.xyz
rogervivierforsale.com respublica-otel.ru
ruclicks.com rockma.se
rusoft-zone.ru roll123.com
sanyuprojects.com rossmark.ru
scanner-walter.top royalcar-ufa.ru
sex-znakomstva.online sakhboard.ru
sexiporno.net scanner-jessica.top
sexsearch.com seadragonherbery.com
share-buttons-for-free.com searchinterneat-a.akamaihd.net
smartshoppymac.com searchtooknow-a.akamaihd.net
spbchampionat.ru secret.xn--oogle-wmc.com
speechfoodie.com senger.atspace.co.uk
tacbibirfa.tk sex-sex-sex5.com
tytoona.com sharebutton.to
ustion.ru shillyourcoins.com
uzungil.com shopcheermakeup.info
vedomstvo.net skuteczna-dieta.co.pl
vilingstore.net sneakyboy.com
w-journal.ru starpages.net
webnode.me stroydetali.ru
wleuaprpxuvr.ga support.nopeas.sk
xerox-douglas.cf suralink.com
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai tamada69.com
xn--80aikhbrhr.net trafficstars.com
youbloodyripper.com uzporno.mobi
ypmuseum.ru venerologiya.com
zeroredirect11.com ventelnos.com
viagengrarx.com
womensplay.net
zzlgxh.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.54 0; 10.1.0.127 0;
127.0.0.1 0; 127.0.0.1 0;

8
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4343 ### Version: V4.2024.03.4344
### Updated: Sat Mar 2 22:01:10 UTC 2024 ### Updated: Sun Mar 3 04:52:18 UTC 2024
### Bad Bot Count: 656 ### Bad Bot Count: 655
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1177,8 +1177,6 @@ User-agent: arquivo.pt
Disallow:/ Disallow:/
User-agent: autoemailspider User-agent: autoemailspider
Disallow:/ Disallow:/
User-agent: axios
Disallow:/
User-agent: backlink-check User-agent: backlink-check
Disallow:/ Disallow:/
User-agent: cah.io.community User-agent: cah.io.community

8
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.03.4343 ### Version: V4.2024.03.4344
### Updated: Sat Mar 2 22:01:10 UTC 2024 ### Updated: Sun Mar 3 04:52:18 UTC 2024
### Bad Bot Count: 656 ### Bad Bot Count: 655
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -1177,8 +1177,6 @@ User-agent: arquivo.pt
Disallow:/ Disallow:/
User-agent: autoemailspider User-agent: autoemailspider
Disallow:/ Disallow:/
User-agent: axios
Disallow:/
User-agent: backlink-check User-agent: backlink-check
Disallow:/ Disallow:/
User-agent: cah.io.community User-agent: cah.io.community