From 98b1e346af7b59e5a5afccc4240f6f3f265f984b Mon Sep 17 00:00:00 2001 From: Mikaela Suomalainen Date: Mon, 23 Nov 2020 14:00:02 +0200 Subject: [PATCH] robots.txt: Allow / The only effect of the disallows would be preventing search engines from seeing Noindex that the upstream adds * https://github.com/jekyll/jekyll-redirect-from/commit/efddde5d2590453a5a09aded13c9cf1f60444a29 Also Google hasn't supported Noindex in robots.txt in ages and it's not part of robots.txt specification. --- robots.txt | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/robots.txt b/robots.txt index 67abaf2..9bc8e52 100644 --- a/robots.txt +++ b/robots.txt @@ -1,6 +1,3 @@ User-agent: * -Allow: /index -Index: /index -Disallow: / -Noindex: / +Allow: / Sitemap: https://im.piraattinuoret.fi/sitemap.xml