robots.txt: prevent search engines from indexing disallowed content

This commit is contained in:
Aminda Suomalainen ⚧ 2019-02-23 00:18:09 +02:00
parent fc2eb3aea0
commit c028a2bd0c
No known key found for this signature in database
GPG Key ID: 0C207F07B2F32B67
1 changed files with 2 additions and 0 deletions

View File

@ -1,4 +1,6 @@
User-agent: * User-agent: *
Allow: /index Allow: /index
Index: /index
Disallow: / Disallow: /
Noindex: /
Sitemap: https://im.piraattinuoret.fi/sitemap.xml Sitemap: https://im.piraattinuoret.fi/sitemap.xml