robots.txt: Allow /

The only effect of the disallows would be preventing search engines from
seeing Noindex that the upstream adds

* efddde5d25

Also Google hasn't supported Noindex in robots.txt in ages and it's not
part of robots.txt specification.
This commit is contained in:
Aminda Suomalainen ⚧ 2020-11-23 14:00:02 +02:00
parent f0a7c6b2ac
commit 98b1e346af
GPG Key ID: 99392F62BAE30723
1 changed files with 1 additions and 4 deletions

View File

@ -1,6 +1,3 @@
User-agent: *
Allow: /index
Index: /index
Disallow: /
Noindex: /
Allow: /
Sitemap: https://im.piraattinuoret.fi/sitemap.xml