robots.txt: Allow /
The only effect of the disallows would be preventing search engines from
seeing Noindex that the upstream adds
* efddde5d25
Also Google hasn't supported Noindex in robots.txt in ages and it's not
part of robots.txt specification.
This commit is contained in:
parent
f0a7c6b2ac
commit
98b1e346af
|
@ -1,6 +1,3 @@
|
|||
User-agent: *
|
||||
Allow: /index
|
||||
Index: /index
|
||||
Disallow: /
|
||||
Noindex: /
|
||||
Allow: /
|
||||
Sitemap: https://im.piraattinuoret.fi/sitemap.xml
|
||||
|
|
Loading…
Reference in New Issue