From 26045709fb5026c10830f9e52348a3e819f03619 Mon Sep 17 00:00:00 2001 From: Mitchell Krog UB1 Date: Thu, 12 Jan 2017 16:18:52 +0200 Subject: [PATCH] Added robots.txt for People Unable to Use this Bot Blocker --- robots.txt/README.md | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/robots.txt/README.md b/robots.txt/README.md index 7e5fa9fb1..26a0e5231 100644 --- a/robots.txt/README.md +++ b/robots.txt/README.md @@ -7,20 +7,20 @@ The robots.txt file residing in this directory can be used to ADD onto your exis If your existing robots.txt file looks like this: -User-agent: * -Allow: /wp-admin/admin-ajax.php +>User-agent: * +>Allow: /wp-admin/admin-ajax.php Then your new file will look like this: -User-agent: * -Allow: /wp-admin/admin-ajax.php -User-agent: Acunetix - Disallow:/ -User-agent: FHscan - Disallow:/ -User-agent: masscan - Disallow:/ -........ rest of file contents +>User-agent: * +>Allow: /wp-admin/admin-ajax.php +>User-agent: Acunetix +> Disallow:/ +>User-agent: FHscan +> Disallow:/ +>User-agent: masscan +> Disallow:/ +>........ rest of file contents # You use this at your own risk