mirror of
https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git
synced 2025-09-02 02:29:58 +00:00
.. | ||
README.md | ||
robots.txt |
Robots.txt Directives ONLY for People unable to use this Bot Blocker
DO NOT use this on any of your sites if you are running the Bad Bot Blocker
The robots.txt file residing in this directory can be used to ADD onto your existing robots.txt file by placing this after anything you already have in your robots.txt file.
Do NOT make this file the only contents of your robots.txt file !!!
If your existing robots.txt file looks like this:
User-agent: *
Allow: /wp-admin/admin-ajax.php
Then your new file will look like this:
User-agent: * Allow: /wp-admin/admin-ajax.php User-agent: Acunetix Disallow:/ User-agent: FHscan Disallow:/ User-agent: masscan Disallow:/ ........ rest of file contents
You use this at your own risk
This will only help stop some bad bots from gaining access to your site this certainly does not provide nearly as much protection as the full Nginx Bad Bot Blocker