thegeeklab/layouts/robots.txt

9 lines
132 B
Plaintext

User-agent: *
Disallow: /atom.xml
Disallow: /authors/*
Disallow: /tags/*
Disallow: /page/*
Sitemap: {{ "/sitemap.xml" | absURL }}