Configuration based Robots.txt

Brought to you by: fbelleau, vincentemonet

#56 Configuration based Robots.txt

Milestone: v1.0.1

Status: open

Owner: Peter Ansell

Labels: Configuration files (21)

Priority: 5

Updated: 2011-06-28

Created: 2011-06-28

Private: No

The webapp configuration files need to be extended to include support for robots.txt query and global level instructions:

Example:

global: /queryplan/, /admin/
query: /links/, /search/