nginx-ultimate-bad-bot-blocker/robots.txt
2017-06-28 15:14:07 +02:00
..
LICENSE.md V2.2017.04 - Added new include files method for whitelisting your own IP’s and Domain Names 2017-02-16 08:28:01 +02:00
README.md Blocker Update Notifications 2017-04-11 14:19:16 +02:00
robots.txt V3.2017.06.623 [ci skip] 2017-06-28 15:14:07 +02:00

Robots.txt Directives ONLY for People unable to use the full Nginx Bad Bot, User-Agent and Spam Referrer Blocker

DO NOT use this on any of your sites if you are running the real Bad Bot Blocker (not needed)

The robots.txt file residing in this directory can be used to ADD onto your existing robots.txt file by placing this after anything you already have in your robots.txt file.

Do NOT make this file the only contents of your robots.txt file !!!

1. Click on the robots.txt file in this directory
2. Then click on the button that says RAW, this will give you clear unformatted code
3. Then copy those contents to paste into your robots.txt file

If your existing robots.txt file looks like this:

User-agent: *
Allow: /wp-admin/admin-ajax.php

Then your new file will look like this:

User-agent: *
Allow: /wp-admin/admin-ajax.php
User-agent: Acunetix
Disallow:/ 
User-agent: FHscan
Disallow:/ 
User-agent: masscan
Disallow:/ 
........ rest of file contents

You use this at your own risk

This will only help stop some bad bots from gaining access to your site this certainly does not provide nearly as much protection as the full Nginx Bad Bot, User-Agent and Spam Referrer Blocker

If this helped you You can buy me a beer🍺

Update Notification System

Please subscribe your email address to the mailing list at https://groups.google.com/forum/#!forum/nginx-ultimate-bad-bot-blocker or simply send a blank email to nginx-ultimate-bad-bot-blocker+subscribe@googlegroups.com to subscribe. Please make sure you are subscribed to notifications to be notified when the blocker is updated and also to be notified when any important or mission critical changes take place.