OLD | NEW |
1 # Perf Bot Sheriffing | 1 # Perf Bot Sheriffing |
2 | 2 |
3 The perf bot sheriff is responsible for keeping the bots on the chromium.perf | 3 The perf bot sheriff is responsible for keeping the bots on the chromium.perf |
4 waterfall up and running, and triaging performance test failures and flakes. | 4 waterfall up and running, and triaging performance test failures and flakes. |
5 | 5 |
6 **[Rotation calendar](https://calendar.google.com/calendar/embed?src=google.com_
2fpmo740pd1unrui9d7cgpbg2k%40group.calendar.google.com)** | 6 **[Rotation calendar](https://calendar.google.com/calendar/embed?src=google.com_
2fpmo740pd1unrui9d7cgpbg2k%40group.calendar.google.com)** |
7 | 7 |
8 ## Key Responsibilities | 8 ## Key Responsibilities |
9 | 9 |
10 * [Handle Device and Bot Failures](#Handle-Device-and-Bot-Failures) | 10 * [Handle Device and Bot Failures](#Handle-Device-and-Bot-Failures) |
(...skipping 326 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
337 2. See 'Reproducing the task locally' on swarming task page | 337 2. See 'Reproducing the task locally' on swarming task page |
338 3. First run the command under | 338 3. First run the command under |
339 'Download input files into directory foo' | 339 'Download input files into directory foo' |
340 4. cd into foo/out/Release if those downloaded inputs | 340 4. cd into foo/out/Release if those downloaded inputs |
341 5. Execute test from this directory. Command you are looking for | 341 5. Execute test from this directory. Command you are looking for |
342 should be at the top of the logs, you just need to update the | 342 should be at the top of the logs, you just need to update the |
343 `--isolated-script-test-output=/b/s/w/ioFB73Qz/output.json` and | 343 `--isolated-script-test-output=/b/s/w/ioFB73Qz/output.json` and |
344 `--isolated-script-test-chartjson-output=/b/s/w/ioFB73Qz/chartjson-o
utput.json` | 344 `--isolated-script-test-chartjson-output=/b/s/w/ioFB73Qz/chartjson-o
utput.json` |
345 flags to be a local path | 345 flags to be a local path |
346 6. Example with tmp as locally created dir: | 346 6. Example with tmp as locally created dir: |
347 `/usr/bin/python ../../testing/scripts/run_telemetry_benchmark_as_go
ogletest.py ../../tools/perf/run_benchmark indexeddb_perf -v --upload-results --
output-format=chartjson --browser=release --isolated-script-test-output=tmp/outp
ut.json --isolated-script-test-chartjson-output=tmp/chartjson-output.json` | 347 `/usr/bin/python ../../testing/scripts/run_telemetry_benchmark_as_go
ogletest.py ../../tools/perf/run_benchmark speedometer -v --upload-results --out
put-format=chartjson --browser=release --isolated-script-test-output=tmp/output.
json --isolated-script-test-chartjson-output=tmp/chartjson-output.json` |
348 * ssh into swarming bot and run test on that machine | 348 * ssh into swarming bot and run test on that machine |
349 1. NOTE: this should be a last resort since it will cause a fifth of | 349 1. NOTE: this should be a last resort since it will cause a fifth of |
350 the benchmarks to continuously fail on the waterfall | 350 the benchmarks to continuously fail on the waterfall |
351 2 First you need to decommission the swarming bot so other jobs don’t | 351 2 First you need to decommission the swarming bot so other jobs don’t |
352 interfere, file a ticket with go/bugatrooper | 352 interfere, file a ticket with go/bugatrooper |
353 3. See [remote access to bots](https://sites.google.com/a/google.com/ch
rome-infrastructure/golo/remote-access?pli=1) | 353 3. See [remote access to bots](https://sites.google.com/a/google.com/ch
rome-infrastructure/golo/remote-access?pli=1) |
354 on how to ssh into the bot and then run the test. | 354 on how to ssh into the bot and then run the test. |
355 Rough overview for build161-m1 | 355 Rough overview for build161-m1 |
356 * prodaccess --chromegolo_ssh | 356 * prodaccess --chromegolo_ssh |
357 * Ssh build161-m1.golo | 357 * Ssh build161-m1.golo |
(...skipping 118 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
476 | 476 |
477 There is also a weekly debrief that you should see on your calendar titled | 477 There is also a weekly debrief that you should see on your calendar titled |
478 **Weekly Speed Sheriff Retrospective**. For this meeting you should prepare | 478 **Weekly Speed Sheriff Retrospective**. For this meeting you should prepare |
479 any highlights or lowlights from your sheriffing shift as well as any other | 479 any highlights or lowlights from your sheriffing shift as well as any other |
480 feedback you may have that could improve future sheriffing shifts. | 480 feedback you may have that could improve future sheriffing shifts. |
481 | 481 |
482 <!-- Unresolved issues: | 482 <!-- Unresolved issues: |
483 1. Do perf sheriffs watch the bisect waterfall? | 483 1. Do perf sheriffs watch the bisect waterfall? |
484 2. Do perf sheriffs watch the internal clank waterfall? | 484 2. Do perf sheriffs watch the internal clank waterfall? |
485 --> | 485 --> |
OLD | NEW |