Add robots.txt

Issue #63 new
cefn repo owner created an issue

Currently all content will be indexed, which means lots of unnecessary duplicate matches for text searches.

robots.txt should be added and probably declare that section and page files are the only ones to be indexed.

Comments (0)

  1. Log in to comment