vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Added robots.txt for People Unable to Use this Bot Blocker

Browse source
This commit is contained in:
Mitchell Krog UB1 2017-01-12 16:16:47 +02:00
parent 0a99260bcf
commit 9acb822e18
1 changed files with 6 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
robots.txt/README.md
View file

@ -6,11 +6,13 @@ The robots.txt file residing in this directory can be used to ADD onto your exis
## Do NOT make this file the only contents of your robots.txt file !!! ## Do NOT make this file the only contents of your robots.txt file !!!
If your existing robots.txt file looks like this: If your existing robots.txt file looks like this:
```User-agent: *
Allow: /wp-admin/admin-ajax.php``` User-agent: *
Allow: /wp-admin/admin-ajax.php
Then your new file will look like this: Then your new file will look like this:
```User-agent: *
User-agent: *
Allow: /wp-admin/admin-ajax.php Allow: /wp-admin/admin-ajax.php
User-agent: Acunetix User-agent: Acunetix
Disallow:/ Disallow:/
@ -18,7 +20,7 @@ User-agent: FHscan
Disallow:/ Disallow:/
User-agent: masscan User-agent: masscan
Disallow:/ Disallow:/
........ rest of file contents``` ........ rest of file contents
# You use this at your own risk # You use this at your own risk