vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Added robots.txt for People Unable to Use this Bot Blocker

Browse source
This commit is contained in:
Mitchell Krog UB1 2017-01-12 16:18:52 +02:00
parent 9acb822e18
commit 26045709fb
1 changed files with 11 additions and 11 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

22
robots.txt/README.md
View file

@ -7,20 +7,20 @@ The robots.txt file residing in this directory can be used to ADD onto your exis
If your existing robots.txt file looks like this:
User-agent: *
Allow: /wp-admin/admin-ajax.php
>User-agent: *
>Allow: /wp-admin/admin-ajax.php
Then your new file will look like this:
User-agent: *
Allow: /wp-admin/admin-ajax.php
User-agent: Acunetix
Disallow:/
User-agent: FHscan
Disallow:/
User-agent: masscan
Disallow:/
........ rest of file contents
>User-agent: *
>Allow: /wp-admin/admin-ajax.php
>User-agent: Acunetix
> Disallow:/
>User-agent: FHscan
> Disallow:/
>User-agent: masscan
> Disallow:/
>........ rest of file contents
# You use this at your own risk