Commits

Anonymous committed 74b12fc

Add robots.txt

Comments (0)

Files changed (1)

+User-agent: *
+Crawl-delay: 100
+Disallow: /hg
+Disallow: /repo
+Disallow: /bts/issue?
+
+User-agent: geniebot
+Disallow: /
+
+User-agent: ShopWiki
+Disallow: /
+
+User-agent: DotBot
+Disallow: /