nginx-ultimate-bad-bot-blocker/robots.txt

Robots.txt Directives ONLY for People unable to use the full Nginx Bad Bot, User-Agent and Spam Referrer Blocker

DO NOT use this on any of your sites if you are running the real Bad Bot Blocker (not needed)

The robots.txt file residing in this directory can be used to ADD onto your existing robots.txt file by placing this after anything you already have in your robots.txt file.

Do NOT make this file the only contents of your robots.txt file !!!

1. Click on the robots.txt file in this directory

2. Then click on the button that says RAW, this will give you clear unformatted code

3. Then copy those contents to paste into your robots.txt file

If your existing robots.txt file looks like this:

User-agent: *
Allow: /wp-admin/admin-ajax.php

Then your new file will look like this:

User-agent: *
Allow: /wp-admin/admin-ajax.php
User-agent: Acunetix
Disallow:/ 
User-agent: FHscan
Disallow:/ 
User-agent: masscan
Disallow:/ 
........ rest of file contents

You use this at your own risk

This will only help stop some bad bots from gaining access to your site this certainly does not provide nearly as much protection as the full Nginx Bad Bot, User-Agent and Spam Referrer Blocker

If this helped you You can buy me a beer🍺 or send some cheese for my mouse