Chromium Code Reviews| Index: tools/perf/docs/perf_bot_sheriffing.md |
| diff --git a/tools/perf/docs/perf_bot_sheriffing.md b/tools/perf/docs/perf_bot_sheriffing.md |
| index 6b072b8f563c35225792aa526c29b02ae888e4f2..8d7525e58402c8e54609fe2af49a5ea948e38cde 100644 |
| --- a/tools/perf/docs/perf_bot_sheriffing.md |
| +++ b/tools/perf/docs/perf_bot_sheriffing.md |
| @@ -5,17 +5,11 @@ waterfall up and running, and triaging performance test failures and flakes. |
| ## Key Responsibilities |
| - * [Keeping the chromium.perf waterfall green](#chromiumperf) |
| - * [Handling Test Failures](#testfailures) |
| - * [Handling Device and Bot Failures](#botfailures) |
| - * [Follow up on failures](#followup) |
| + * [Handle Test Failures](#testfailures) |
| + * [Handle Device and Bot Failures](#botfailures) |
|
aiolos (Not reviewing)
2016/03/09 17:57:38
Can you move the Device and Bot Failures before th
dtu
2016/03/09 22:27:44
Done.
|
| + * [Follow up on failures](#followup) |
| -###<a name="chromiumperf"></a> Keeping the chromium.perf waterfall green |
| - |
| -The primary responsibility of the perfbot health sheriff is to keep the |
| -chromium.perf waterfall green. |
| - |
| -####<a name="waterfallstate"></a> Understanding the Waterfall State |
| +##<a name="waterfallstate"></a> Understanding the Waterfall State |
| Everyone can view the chromium.perf waterfall at |
| https://build.chromium.org/p/chromium.perf/, but for Googlers it is recommended |
| @@ -44,20 +38,20 @@ Note that there are four different views: |
| * **start_time** is seconds since the epoch. |
| You can see a list of all previously filed bugs using the |
| -**[Performance-BotHealth](https://code.google.com/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth)** |
| +**[Performance-BotHealth](https://bugs.chromium.org/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth)** |
| label in crbug. |
| Please also check the recent |
| **[perf-sheriffs@chromium.org](https://groups.google.com/a/chromium.org/forum/#!forum/perf-sheriffs)** |
| postings for important announcements about bot turndowns and other known issues. |
| -####<a name="testfailures"></a> Handling Test Failures |
| +##<a name="testfailures"></a> Handle Test Failures |
| You want to keep the waterfall green! So any bot that is red or purple needs to |
| be investigated. When a test fails: |
| 1. File a bug using |
| - [this template](https://code.google.com/p/chromium/issues/entry?labels=Performance-BotHealth,Pri-1,Type-Bug-Regression,OS-?&comment=Revision+range+first+seen:%0ALink+to+failing+step+log:%0A%0A%0AIf%20the%20test%20is%20disabled,%20please%20downgrade%20to%20Pri-2.&summary=%3Ctest%3E+failure+on+chromium.perf+at+%3Crevisionrange%3E). |
| + [this template](https://bugs.chromium.org/p/chromium/issues/entry?labels=Performance-BotHealth,Pri-1,Type-Bug-Regression,OS-?&comment=Revision+range+first+seen:%0ALink+to+failing+step+log:%0A%0A%0AIf%20the%20test%20is%20disabled,%20please%20downgrade%20to%20Pri-2.&summary=%3Ctest%3E+failure+on+chromium.perf+at+%3Crevisionrange%3E). |
| You'll want to be sure to include: |
| * Link to buildbot status page of failing build. |
| * Copy and paste of relevant failure snippet from the stdio. |
| @@ -92,10 +86,10 @@ be investigated. When a test fails: |
| the tab did not crash. |
| -#####<a name="telemetryfailures"></a> Disabling Telemetry Tests |
| +###<a name="telemetryfailures"></a> Disabling Telemetry Tests |
| If the test is a telemetry test, its name will have a '.' in it, such as |
| -thread_times.key_mobile_sites, or page_cycler.top_10. The part before the first |
| +thread\_times.key\_mobile\_sites, or page\_cycler.top\_10. The part before the first |
|
sullivan
2016/03/09 14:38:25
We could also consider backticks instead of backsl
dtu
2016/03/09 22:27:44
Done.
|
| dot will be a python file in [tools/perf/benchmarks]( |
| https://code.google.com/p/chromium/codesearch#chromium/src/tools/perf/benchmarks/). |
| @@ -129,15 +123,15 @@ and example of disabling a benchmark which OOMs on svelte. |
| Disabling CLs can be TBR-ed to anyone in tools/perf/OWNERS, but please do **not** |
| submit with NOTRY=true. |
| -#####<a name="otherfailures"></a> Disabling Other Tests |
| +###<a name="otherfailures"></a> Disabling Other Tests |
| Non-telemetry tests are configured in [chromium.perf.json](https://code.google.com/p/chromium/codesearch#chromium/src/testing/buildbot/chromium.perf.json). |
| You can TBR any of the per-file OWNERS, but please do **not** submit with |
| NOTRY=true. |
| -####<a name="botfailures"></a> Handling Device and Bot Failures |
| +##<a name="botfailures"></a> Handle Device and Bot Failures |
| -#####<a name="purplebots"></a> Purple bots |
| +###<a name="purplebots"></a> Purple bots |
| When a bot goes purple, it's it's usually because of an infrastructure failure |
| outside of the tests. But you should first check the logs of a purple bot to |
| @@ -146,11 +140,11 @@ turn the bot purple, for example. |
| If the bot goes purple and you believe it's an infrastructure issue, file a bug |
| with |
| -[this template](https://code.google.com/p/chromium/issues/entry?labels=Pri-1,Performance-BotHealth,Infra-Troopers,OS-?&comment=Link+to+buildbot+status+page:&summary=Purple+Bot+on+chromium.perf), |
| +[this template](https://bugs.chromium.org/p/chromium/issues/entry?labels=Pri-1,Performance-BotHealth,Infra-Troopers,OS-?&comment=Link+to+buildbot+status+page:&summary=Purple+Bot+on+chromium.perf), |
| which will automatically add the bug to the trooper queue. Be sure to note |
| which step is failing, and paste any relevant info from the logs into the bug. |
| -#####<a name="devicefailures"></a> Android Device failures |
| +###<a name="devicefailures"></a> Android Device failures |
| There are two types of device failures: |
| @@ -164,7 +158,7 @@ There are two types of device failures: |
| with the same device affinity number are failing, it's probably a device |
| failure. |
| -For both types of failures, please file a bug with [this template](https://code.google.com/p/chromium/issues/entry?labels=Pri-1,Performance-BotHealth,Infra-Labs,OS-Android&comment=Link+to+buildbot+status+page:&summary=Device+offline+on+chromium.perf) |
| +For both types of failures, please file a bug with [this template](https://bugs.chromium.org/p/chromium/issues/entry?labels=Pri-1,Performance-BotHealth,Infra-Labs,OS-Android&comment=Link+to+buildbot+status+page:&summary=Device+offline+on+chromium.perf) |
| which will add an issue to the infra labs queue. |
| If you need help triaging, here are the common labels you should use: |
| @@ -189,20 +183,20 @@ If you need help triaging, here are the common labels you should use: |
| If you still need help, ask the speed infra chat, or escalate to sullivan@. |
| -####<a name="followup"></a> Follow up on failures |
| +##<a name="followup"></a> Follow up on failures |
| -**[Pri-0 bugs](https://code.google.com/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-0)** |
| +**[Pri-0 bugs](https://bugs.chromium.org/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-0)** |
| should have an owner or contact on speed infra team and be worked on as top |
| priority. Pri-0 generally implies an entire waterfall is down. |
| -**[Pri-1 bugs](https://code.google.com/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-1)** |
| +**[Pri-1 bugs](https://bugs.chromium.org/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-1)** |
| should be pinged daily, and checked to make sure someone is following up. Pri-1 |
| bugs are for a red test (not yet disabled), purple bot, or failing device. |
| -**[Pri-2 bugs](https://code.google.com/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-2)** |
| +**[Pri-2 bugs](https://bugs.chromium.org/p/chromium/issues/list?can=2&q=label%3APerformance-BotHealth+label%3APri-2)** |
| are for disabled tests. These should be pinged weekly, and work towards fixing |
| should be ongoing when the sheriff is not working on a Pri-1 issue. Here is the |
| -[list of Pri-2 bugs that have not been pinged in a week](https://code.google.com/p/chromium/issues/list?can=2&q=label:Performance-BotHealth%20label:Pri-2%20modified-before:today-7&sort=modified) |
| +[list of Pri-2 bugs that have not been pinged in a week](https://bugs.chromium.org/p/chromium/issues/list?can=2&q=label:Performance-BotHealth%20label:Pri-2%20modified-before:today-7&sort=modified) |
| <!-- Unresolved issues: |
| 1. Do perf sheriffs watch the bisect waterfall? |