OLD | NEW |
(Empty) | |
| 1 # Perf Try Bots |
| 2 |
| 3 [TOC] |
| 4 |
| 5 ## What are perf try bots? |
| 6 |
| 7 Chrome has a performance lab with dozens of device and OS configurations. You |
| 8 can run performance tests on an unsubmitted CL on these devices using the |
| 9 perf try bots. |
| 10 |
| 11 ## Supported platforms |
| 12 |
| 13 The platforms available in the lab change over time. To find the currently |
| 14 available platforms, run `tools/perf/run_benchmark try --help`. |
| 15 |
| 16 Example output: |
| 17 |
| 18 ``` |
| 19 > tools/perf/run_benchmark try --help |
| 20 usage: Run telemetry benchmarks on trybot. You can add all the benchmark options
available except the --browser option |
| 21 [-h] [--repo_path <repo path>] [--deps_revision <deps revision>] |
| 22 <trybot name> <benchmark name> |
| 23 |
| 24 positional arguments: |
| 25 <trybot name> specify which bots to run telemetry benchmarks on. Allo
wed values are: |
| 26 Mac Builder |
| 27 all |
| 28 all-android |
| 29 all-linux |
| 30 all-mac |
| 31 all-win |
| 32 android-fyi |
| 33 android-nexus5 |
| 34 android-nexus5X |
| 35 android-nexus6 |
| 36 android-nexus7 |
| 37 android-one |
| 38 android-webview-arm64-aosp |
| 39 android-webview-nexus6-aosp |
| 40 linux |
| 41 mac-10-11 |
| 42 mac-10-12 |
| 43 mac-10-12-mini-8gb |
| 44 mac-air |
| 45 mac-pro |
| 46 mac-retina |
| 47 staging-android-nexus5X |
| 48 staging-linux |
| 49 staging-mac-10-12 |
| 50 staging-win |
| 51 win |
| 52 win-8 |
| 53 win-x64 |
| 54 winx64-10 |
| 55 winx64-high-dpi |
| 56 winx64-zen |
| 57 winx64ati |
| 58 winx64intel |
| 59 winx64nvidia |
| 60 |
| 61 ``` |
| 62 |
| 63 ## Supported benchmarks |
| 64 |
| 65 All the telemetry benchmarks are supported by the perf trybots. To get a full |
| 66 list, run `tools/perf/run_benchmark list`. |
| 67 |
| 68 To learn more about the benchmark, you can read about the |
| 69 [system health benchmarks](https://docs.google.com/document/d/1BM_6lBrPzpMNMtcyi
2NFKGIzmzIQ1oH3OlNG27kDGNU/edit?ts=57e92782), |
| 70 which test Chrome's performance at a high level, and the |
| 71 [benchmark harnesses](https://docs.google.com/spreadsheets/d/1ZdQ9OHqEjF5v8dqNjd
7lGUjJnK6sgi8MiqO7eZVMgD0/edit#gid=0), |
| 72 which cover more specific areas. |
| 73 |
| 74 ## Starting a perf try job |
| 75 |
| 76 Use this command line: |
| 77 |
| 78 `tools/perf/run_benchmark try <trybot_name> <benchmark_name>` |
| 79 |
| 80 See above for how to choose a trybot and benchmark. |
| 81 |
| 82 Run `tools/perf/run_benchmark try --help` for more information about available |
| 83 options. |
| 84 |
| 85 ## Interpreting the results |
| 86 |
| 87 Perf trybots create a code review under the covers to hold the trybot results. |
| 88 The code review will list links to buildbot status pages for the try jobs. |
| 89 On each buildbot status page, you will see a "HTML Results" link. You can click |
| 90 it to see detailed information about the performance test results with and |
| 91 without your patch. |
| 92 |
| 93 **[Here is the documentation](https://github.com/catapult-project/catapult/blob/
master/docs/metrics-results-ui.md)** |
| 94 on reading the results. |
OLD | NEW |