vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Added robots.txt for People Unable to Use this Bot Blocker

Browse source
This commit is contained in:
Mitchell Krog UB1 2017-01-12 16:23:31 +02:00
parent e718fdaaed
commit 07da8a50f8
1 changed files with 11 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

23
robots.txt/README.md
View file

@ -7,21 +7,20 @@ The robots.txt file residing in this directory can be used to ADD onto your exis
If your existing robots.txt file looks like this: If your existing robots.txt file looks like this:
>User-agent: * User-agent: *
Allow: /wp-admin/admin-ajax.php
>Allow: /wp-admin/admin-ajax.php
Then your new file will look like this: Then your new file will look like this:
>User-agent: * User-agent: *
>Allow: /wp-admin/admin-ajax.php Allow: /wp-admin/admin-ajax.php
>User-agent: Acunetix User-agent: Acunetix
> Disallow:/ Disallow:/
>User-agent: FHscan User-agent: FHscan
> Disallow:/ Disallow:/
>User-agent: masscan User-agent: masscan
> Disallow:/ Disallow:/
>........ rest of file contents ........ rest of file contents
# You use this at your own risk # You use this at your own risk