No changes between revisions
/gestion/robots.txt |
0,0 → 1,19 |
# exclude help system from robots |
User-agent: * |
Disallow: /manual/ |
Disallow: /manual-1.3/ |
Disallow: /manual-2.0/ |
Disallow: /manual-2.2/ |
Disallow: /addon-modules/ |
Disallow: /doc/ |
Disallow: /images/ |
# the next line is a spam bot trap, for grepping the logs. you should _really_ change this to something else... |
Disallow: /all_our_e-mail_addresses |
# same idea here... |
Disallow: /admin/ |
# but allow htdig to index our doc-tree |
#User-agent: htdig |
#Disallow: |
# disallow stress test |
user-agent: stress-agent |
Disallow: / |
Property changes: |
Added: svn:eol-style |
+native |
\ No newline at end of property |