vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2024.02.4301 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2024-02-12 05:40:20 +00:00
parent fece6266a0
commit 7081af59aa
30 changed files with 53104 additions and 53068 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
AUTO-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.02.4300 #### Version: V4.2024.02.4301
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [653](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
MANUAL-CONFIGURATION.md
View file

@ -4,9 +4,9 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2024.02.4300 #### Version: V4.2024.02.4301
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [653](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

4
README.md
View file

@ -14,9 +14,9 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2024.02.4300 #### Version: V4.2024.02.4301
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [653](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8802
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

4
_generator_lists/bad-user-agents.list
View file

@ -1,5 +1,3 @@
ImagesiftBot
imagesift.com
01h4x.com 01h4x.com
360Spider 360Spider
404checker 404checker
@ -205,6 +203,7 @@ Id-search
IlseBot IlseBot
Image\ Fetch Image\ Fetch
Image\ Sucker Image\ Sucker
ImagesiftBot
IndeedBot IndeedBot
Indy\ Library Indy\ Library
InfoNaviRobot InfoNaviRobot
@ -600,6 +599,7 @@ evc-batch
facebookscraper facebookscraper
gopher gopher
heritrix heritrix
imagesift.com
instabid instabid
internetVista\ monitor internetVista\ monitor
ips-agent ips-agent

4
_google_analytics_ghost_spam/README.md
View file

@ -3,9 +3,9 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2024.02.4300 #### Version: V4.2024.02.4301
#### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7105](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [653](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [655](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)
____________________ ____________________

8810
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8810
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8810
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/_robots_input/robots-input.txt
View file

@ -203,6 +203,7 @@ Id-search
IlseBot IlseBot
Image Fetch Image Fetch
Image Sucker Image Sucker
ImagesiftBot
IndeedBot IndeedBot
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
@ -598,6 +599,7 @@ evc-batch
facebookscraper facebookscraper
gopher gopher
heritrix heritrix
imagesift.com
instabid instabid
internetVista monitor internetVista monitor
ips-agent ips-agent

2
dev-tools/buildnumber
View file

@ -1 +1 @@
4300 4301

8810
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8810
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.81.159.100 0; 20.55.214.246 0;

8810
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8810
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8810
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-user-agents.conf
View file

@ -264,6 +264,7 @@
"~*(?:\b)IlseBot(?:\b|)" 0; "~*(?:\b)IlseBot(?:\b|)" 0;
"~*(?:\b)Image\ Fetch(?:\b|)" 0; "~*(?:\b)Image\ Fetch(?:\b|)" 0;
"~*(?:\b)Image\ Sucker(?:\b|)" 0; "~*(?:\b)Image\ Sucker(?:\b|)" 0;
"~*(?:\b)ImagesiftBot(?:\b|)" 0;
"~*(?:\b)IndeedBot(?:\b|)" 0; "~*(?:\b)IndeedBot(?:\b|)" 0;
"~*(?:\b)Indy\ Library(?:\b|)" 0; "~*(?:\b)Indy\ Library(?:\b|)" 0;
"~*(?:\b)InfoNaviRobot(?:\b|)" 0; "~*(?:\b)InfoNaviRobot(?:\b|)" 0;
@ -659,6 +660,7 @@
"~*(?:\b)facebookscraper(?:\b|)" 0; "~*(?:\b)facebookscraper(?:\b|)" 0;
"~*(?:\b)gopher(?:\b|)" 0; "~*(?:\b)gopher(?:\b|)" 0;
"~*(?:\b)heritrix(?:\b|)" 0; "~*(?:\b)heritrix(?:\b|)" 0;
"~*(?:\b)imagesift.com(?:\b|)" 0;
"~*(?:\b)instabid(?:\b|)" 0; "~*(?:\b)instabid(?:\b|)" 0;
"~*(?:\b)internetVista\ monitor(?:\b|)" 0; "~*(?:\b)internetVista\ monitor(?:\b|)" 0;
"~*(?:\b)ips-agent(?:\b|)" 0; "~*(?:\b)ips-agent(?:\b|)" 0;

8810
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.81.159.100 0; 20.55.214.246 0;

8810
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.81.159.100 0; 20.55.214.246 0;

8810
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-user-agents.conf
View file

@ -264,6 +264,7 @@
"~*(?:\b)IlseBot(?:\b|)" 0; "~*(?:\b)IlseBot(?:\b|)" 0;
"~*(?:\b)Image\ Fetch(?:\b|)" 0; "~*(?:\b)Image\ Fetch(?:\b|)" 0;
"~*(?:\b)Image\ Sucker(?:\b|)" 0; "~*(?:\b)Image\ Sucker(?:\b|)" 0;
"~*(?:\b)ImagesiftBot(?:\b|)" 0;
"~*(?:\b)IndeedBot(?:\b|)" 0; "~*(?:\b)IndeedBot(?:\b|)" 0;
"~*(?:\b)Indy\ Library(?:\b|)" 0; "~*(?:\b)Indy\ Library(?:\b|)" 0;
"~*(?:\b)InfoNaviRobot(?:\b|)" 0; "~*(?:\b)InfoNaviRobot(?:\b|)" 0;
@ -659,6 +660,7 @@
"~*(?:\b)facebookscraper(?:\b|)" 0; "~*(?:\b)facebookscraper(?:\b|)" 0;
"~*(?:\b)gopher(?:\b|)" 0; "~*(?:\b)gopher(?:\b|)" 0;
"~*(?:\b)heritrix(?:\b|)" 0; "~*(?:\b)heritrix(?:\b|)" 0;
"~*(?:\b)imagesift.com(?:\b|)" 0;
"~*(?:\b)instabid(?:\b|)" 0; "~*(?:\b)instabid(?:\b|)" 0;
"~*(?:\b)internetVista\ monitor(?:\b|)" 0; "~*(?:\b)internetVista\ monitor(?:\b|)" 0;
"~*(?:\b)ips-agent(?:\b|)" 0; "~*(?:\b)ips-agent(?:\b|)" 0;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Citoid Ankit
EasyDL Bandit
Gigabot Collector
Haansoft Flunky
LWP::Simple MTRobot
Mail.RU_Bot Picscout
Net Vampire Picsearch
RankActiveLinkBot SemanticJuice
SiteLockSpider Upflow
SpaceBison Zermelo

166
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
ALittle Client 404enemy
AiHitBot AIBOT
Anthill Aspiegel
AwarioSmartBot AwarioRssBot
BLEXBot BLEXBot
BackWeb BacklinkCrawler
Badass Bolt
BatchFTP BotALot
Blow BuzzSumo
Bullseye
CSHttp CSHttp
CherryPicker
ChinaClaw
Copyscape
Crescent
Curious Curious
DIIbot Custo
Dragonfly DTS Agent
Extractor Digincore
EyeNetIE DigitalPebble
FHscan Disco
FemtosearchBot Exabot
Flunky ExtLinksBot
Foobot Extreme Picture Finder
FrontPage FacebookBot
Fuzz Fuzz
GT::WWW FyberSpider
Go!Zilla Go-Ahead-Got-It
HTTP::Lite HMView
HaosouSpider Heritrix
InfoTekies HonoluluBot
Iria Humanlinks
Internet Ninja
InternetSeer
JOC Web Spider JOC Web Spider
LNSpiderguy Keyword Density
LinkScan LeechGet
Linkbot Likse
MSIECrawler LinksManager
Majestic-SEO Lipperhey Spider
Mass Downloader Lmspider
MegaIndex.ru MIDown tool
Moblie Safari MJ12bot
Mojolicious MQQBrowser
Mr.4x3 Mag-Net
NPbot MarkMonitor
NearSite MeanPath Bot
Microsoft Data Access
Name Intelligence
Net Vampire Net Vampire
NetMechanic NetLyzer
NextGenSearchBot Offline Navigator
Niki-bot POE-Component-Client-HTTP
OpenVAS Petalbot
Openvas Pi-Monster
OutfoxBot
PageAnalyzer
PageScorer
Picscout Picscout
PictureFinder
ProPowerBot
Probethenet Probethenet
Pu_iN
Pump
PxBroker
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot2 RankingBot2
Rankivabot
Reaper
RebelMouse
SMTBot
ScanAlert ScanAlert
Screaming SeekportBot
ScreenerBot
SemrushBot SemrushBot
SenutoBot Shodan
SeobilityBot Sitebeam
Site Sucker Telesphorep
SmartDownload Thumbor
Snake Trendictionbot
Sogou web spider VidibleScraper
Sqworm Voil
Surfbot WWW-Mechanize
TheNomad Web Collage
VCI Web Enhancer
VelenPublicWebCrawler Web Pix
Virusdie Web Sauger
VoidEYE
WASALive-Bot
WBSearchBot
WWW-Collector-E
Web Auto
Web Fetch
WebFuck WebFuck
WebmasterWorldForumBot WebImageCollector
WebReaper
WebSauger
WebWhacker
Webster Webster
Who.is Bot WinHTTrack
Xaldon WebSpider Zauba
ZmEu
ZyBorg
archive.org_bot
arquivo-web-crawler arquivo-web-crawler
coccocbot backlink-check
cohere-ai crawl.sogou.com
domainsproject.org crawler4j
eCatch
isitwp.com
muhstik-scan muhstik-scan
netEstate NE Crawler omgili
pcBrowser openai
probe-image-size spyfu
sp_auditbot
webgains-bot webgains-bot
zgrab x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
decenttools.com 123movies.love
downloaddy.net apishops.ru
free-floating-buttons.com bvlgaribracelet.xyz
i-hobot.ru infokonkurs.ru
ilmexico.com mafa-free.com
medanestesia.ru mazda-roadsters.com
quality-traffic.com meteostate.com
quelle.ru platinumdeals.gr
tizanidineformigraines.blogspot.com salutmontreal.com
zskdla.site tjkckpytpnje.com

198
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,100 +1,100 @@
20pascals.nl 1688.com
256bit.by accessoires-mode.in
admatic.com.tr adtiger.tk
adnotbad.com animaltoplist.com
advocatemsk.ru artdestshop.eu
alert-fdm.xyz balitouroffice.com
amazingpic.net becuo.com
apidigidocketnet-a.akamaihd.net bitcoinremote.com
baersaratov.ru bizlist.com.de
bausparen.bz.it bluelabelsky.com
bestwebsitesawards.com buzzurl.jp
blpmovies.com cdncash.com
bus-offer.com clickbanksites.info
buyhoverboard.com clickpapa.com
cactussoft.biz codq.info
call-of-duty.info compliance-andrew.top
carapics.com cryptoswap.biz
cascadelink.org cymbaltaandtizanidine.blogspot.com
cdncash.org ddsoldes.fr
centrumcoachingu.com dostavimvdom.ru
clickso.com e-biznes.info
compliance-andrew.xyz elektrischeziga.livejournal.com
compliance-don.xyz estelight.ru
coolgramgoods.com extremez.net
countbertwistdisp26.soup.io fandlr.com
destinationrealestate.com finteks.ru
dividendo.ru freewareseek.com
duplicashapp.com friendflnder.com
dvd-famille.com fuck-paid-share-buttons.xyz
erotiktreff24.info galaxy-family.ru
extractorandburner.com gambarkatabaru.com
f5mtrack.com gamebackyard.com
falopicm.pw gamedayhouse.com
gallerily.com
getlamborghini.ga
gettpromos.com
gigixo.com gigixo.com
hamptonoaks.ca googlefeud.com
happy.new.yeartwit.com homemade.gq
hydropump.su hotblognetwork.com
hyiphunter.org ikearugs.xyz
jerseysbizwholesalecheap.com interferencer.ru
jerseyschinabizwholesale.us jackwolfskinoutlet.online
johannesburgsingles.co.za javcoast.com
jose.mulinohouse.co kaac.ru
khadastoafarde.tk labplus.ru
kometars.xyz lafriore.ru
kredit-blog.ru littlesexdolls.com
kredit-pod-zalog-krasnodar.ru meduza-consult.ru
lerporn.info mega-bony2017.pl
longlifelomilomi.info mensandals.xyz
macdamaged.tech morocco-nomad-excursions.com
mansparskats.com myplaycity.com
mararoom.ru nfljerseyscheapchinabiz.com
matsdale.com pcads.ru
mexicosleevegastrectomy.com photorepair.ru
most-kerch.org pl.aasoldes.fr
muabancantho.info pokerniydom.ru
musirc.com porno-chaman.info
mymobilemoneypages.com pourvous.info
myxdate.info predmety.in.ua
napalm51.nut.cc prefersurvey.net
narutonaruto.ru promoheads.com
ok-ua.info quickcashlimited.com
onefilms.net ranksays.com
online-sbank.ru rednise.com
orel-reshka.net responsive-test.net
partybunny.ru robotixix.com
pics-group.com ruex.org.ua
platinumdeals.gr scanner-george.top
poisk-zakona.ru semalt.com
pojdelo.weebly.com seoanalyses.com
porngalleries.top sex-tracker.com
princevc.com sexyali.com
pro-okis.ru sharebutton.org
psvita.ru simul.co
pussysaga.com splendorsearch-a.akamaihd.net
quickchange.cc standardchartered-forex.com
ratemodels.net startwp.org
remont-ustanovka-tehniki.ru steamoff.net
seoholding.com stefanbakosab.se
seokicks.de suchenindeutschland.com
shoppytoolmac.com supermama.top
snts.shell-pmr.ru thefarmergame.com
steelmaster.lv timecrimea.ru
stroydetali.ru titan-ads.life
svbur.ru tizanidinedruginteractions.blogspot.com
timdreby.com trafficcentr.xyz
tizanidine4mgtablets.blogspot.com trk-4.net
tizanidineforopiatewithdrawal.blogspot.com tupper-posuda.ru
tv-spoty.info tyumen.xrus.org
ublaze.ru unitygame3d.com
waterefficiency.co videonsk.com
webenlace.com.ar vikistars.com
webkeyit.com vzube.com
whereiskentoday.com wwwadultcheck.com
williamrobsonproperty.com x-lime.com
xvideosbay.com xchat26.myfreecams.com
y8games-free.com xn----7sbifcamovvfggw9d.xn--p1ai
yugk.net xn--e1aggki3c.xn--80adxhks
yaaknaa.info
z-master.ru
znakomstva-moskva77.ru

10
dev-tools/tmp/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.02.4300 ### Version: V4.2024.02.4301
### Updated: Sun Feb 11 22:01:03 UTC 2024 ### Updated: Mon Feb 12 05:36:38 UTC 2024
### Bad Bot Count: 653 ### Bad Bot Count: 655
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -425,6 +425,8 @@ User-agent: Image Fetch
Disallow:/ Disallow:/
User-agent: Image Sucker User-agent: Image Sucker
Disallow:/ Disallow:/
User-agent: ImagesiftBot
Disallow:/
User-agent: IndeedBot User-agent: IndeedBot
Disallow:/ Disallow:/
User-agent: Indy Library User-agent: Indy Library
@ -1215,6 +1217,8 @@ User-agent: gopher
Disallow:/ Disallow:/
User-agent: heritrix User-agent: heritrix
Disallow:/ Disallow:/
User-agent: imagesift.com
Disallow:/
User-agent: instabid User-agent: instabid
Disallow:/ Disallow:/
User-agent: internetVista monitor User-agent: internetVista monitor

10
robots.txt/robots.txt
View file

@ -6,9 +6,9 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2024.02.4300 ### Version: V4.2024.02.4301
### Updated: Sun Feb 11 22:01:03 UTC 2024 ### Updated: Mon Feb 12 05:36:38 UTC 2024
### Bad Bot Count: 653 ### Bad Bot Count: 655
################################################### ###################################################
### Version Information ## ### Version Information ##
@ -425,6 +425,8 @@ User-agent: Image Fetch
Disallow:/ Disallow:/
User-agent: Image Sucker User-agent: Image Sucker
Disallow:/ Disallow:/
User-agent: ImagesiftBot
Disallow:/
User-agent: IndeedBot User-agent: IndeedBot
Disallow:/ Disallow:/
User-agent: Indy Library User-agent: Indy Library
@ -1215,6 +1217,8 @@ User-agent: gopher
Disallow:/ Disallow:/
User-agent: heritrix User-agent: heritrix
Disallow:/ Disallow:/
User-agent: imagesift.com
Disallow:/
User-agent: instabid User-agent: instabid
Disallow:/ Disallow:/
User-agent: internetVista monitor User-agent: internetVista monitor