Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(240)

Issues Search
    My Issues | Starred     Open | Closed | All

Side by Side Diff: appengine/monorail/static/robots.txt

Issue 1868553004: Open Source Monorail (Closed) Base URL: https://chromium.googlesource.com/infra/infra.git@master
Patch Set: Rebase Created 4 years, 8 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « appengine/monorail/static/js/tracker/trackerediting_test.js ('k') | appengine/monorail/static/third_party/js/kibbles-1.3.3.comp.js » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
(Empty)
1 User-agent: *
2 # Start by disallowing everything.
3 Disallow: /
4 # Some specific things are okay, though.
5 Allow: /$
6 Allow: /hosting
7 Allow: /p/*/adminIntro
8 # Query strings are hard. We only allow ?id=N, no other parameters.
9 Allow: /p/*/issues/detail?id=*
10 Disallow: /p/*/issues/detail?id=*&*
11 Disallow: /p/*/issues/detail?*&id=*
12 # 10 second crawl delay for bots that honor it.
13 Crawl-delay: 10
OLDNEW
« no previous file with comments | « appengine/monorail/static/js/tracker/trackerediting_test.js ('k') | appengine/monorail/static/third_party/js/kibbles-1.3.3.comp.js » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698