Add robots.txt
Issue #63
new
Currently all content will be indexed, which means lots of unnecessary duplicate matches for text searches.
robots.txt should be added and probably declare that section and page files are the only ones to be indexed.