#166 robots.txt should be updated to disallow indexing of old content
Closed: Fixed by darknao. Opened by glb.

https://docs.fedoraproject.org/robots.txt should be updated to disallow all search robots from indexing some of the older parts of the documentation namespace by adding lines like the following:

Disallow: /*/Fedora/7/
Disallow: /*/Fedora/8/

Edit: Added trailing slash to examples. The slash might be significant to block entire directories.


Metadata Update from @darknao:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

Metadata
Related Pull Requests