From 4d2ff5b4e26032f56800362aeb07bf5788aadc52 Mon Sep 17 00:00:00 2001 From: Mitchell Krog UB1 Date: Thu, 12 Jan 2017 18:25:44 +0200 Subject: [PATCH] Added robots.txt for People Unable to Use this Bot Blocker - Readme Update --- robots.txt/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/robots.txt/README.md b/robots.txt/README.md index dfd95025a..73bfdaf04 100644 --- a/robots.txt/README.md +++ b/robots.txt/README.md @@ -5,6 +5,10 @@ The robots.txt file residing in this directory can be used to ADD onto your exis ## Do NOT make this file the only contents of your robots.txt file !!! +##### 1. Click on the robots.txt file in this directory +##### 2. Then click on the button that says RAW, this will give you clear unformatted code +##### 3. Then copy those contents to paste into your robots.txt file + If your existing robots.txt file looks like this: User-agent: *