vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Added robots.txt for People Unable to Use this Bot Blocker - Readme Update

Browse source
This commit is contained in:
Mitchell Krog UB1 2017-01-12 18:25:44 +02:00
parent 7d5bb0d19a
commit 4d2ff5b4e2
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
robots.txt/README.md
View file

@ -5,6 +5,10 @@ The robots.txt file residing in this directory can be used to ADD onto your exis
## Do NOT make this file the only contents of your robots.txt file !!!
##### 1. Click on the robots.txt file in this directory
##### 2. Then click on the button that says RAW, this will give you clear unformatted code
##### 3. Then copy those contents to paste into your robots.txt file
If your existing robots.txt file looks like this:
User-agent: *