robots.txt: Allow /
The only effect of the disallows would be preventing search engines from
seeing Noindex that the upstream adds
* efddde5d25
Also Google hasn't supported Noindex in robots.txt in ages and it's not
part of robots.txt specification.
This commit is contained in:
parent
f0a7c6b2ac
commit
98b1e346af
|
@ -1,6 +1,3 @@
|
||||||
User-agent: *
|
User-agent: *
|
||||||
Allow: /index
|
Allow: /
|
||||||
Index: /index
|
|
||||||
Disallow: /
|
|
||||||
Noindex: /
|
|
||||||
Sitemap: https://im.piraattinuoret.fi/sitemap.xml
|
Sitemap: https://im.piraattinuoret.fi/sitemap.xml
|
||||||
|
|
Loading…
Reference in New Issue