source:
indico/indico/htdocs/robots.txt
| Last change on this file was 4e5769, checked in by Jose Benito <jose.benito.gonzalez@…>, 15 months ago | |
|---|---|
|
|
| File size: 210 bytes | |
| Line | |
|---|---|
| 1 | # recommended robots.txt for indico |
| 2 | |
| 3 | User-agent: * |
| 4 | Disallow: /categoryMap.py |
| 5 | Disallow: /wcalendar.py |
| 6 | Disallow: /categOverview.py |
| 7 | Disallow: /search.py |
| 8 | Disallow: /scripts/export.py |
| 9 | Disallow: /api |
| 10 | Crawl-delay: 10 |
Note: See TracBrowser
for help on using the repository browser.
