xoxys/geeklabor_legacy
Archived
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
This repository has been archived on 2023-12-07. You can view files and clone it, but cannot push or open issues or pull requests.
9e0aa91c49
geeklabor_legacy/static/robots.txt
Robert Kaussow d3c1ee0b21
All checks were successful
continuous-integration/drone/push Build is passing
Details
disallow paging sites for web crawler
2019-02-05 16:05:33 +01:00

9 lines
182 B
Plaintext
Raw Blame History

User-agent: *
Disallow: /feed.atom.xml
Disallow: /categories/*
Disallow: /authors/*
Disallow: /author/*
Disallow: /tags/*
Disallow: /page/*
Sitemap: https://geeklabor.de/sitemap.xml
Reference in New Issue View Git Blame Copy Permalink