Commit Graph

4 Commits

Author SHA1 Message Date
Aminda Suomalainen ⚧ 98b1e346af
robots.txt: Allow /
The only effect of the disallows would be preventing search engines from
seeing Noindex that the upstream adds

* efddde5d25

Also Google hasn't supported Noindex in robots.txt in ages and it's not
part of robots.txt specification.
2020-11-23 14:00:02 +02:00
Aminda Suomalainen ⚧ c028a2bd0c
robots.txt: prevent search engines from indexing disallowed content 2019-02-23 00:18:09 +02:00
Aminda Suomalainen ⚧ e95c843fc4
write more story to index 2019-01-26 18:33:07 +02:00
Aminda Suomalainen ⚧ d1dea02a90
Initial commit 2018-04-16 13:37:09 +03:00