Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(111)

Side by Side Diff: docs/speed/perf_trybots.md

Issue 2943223002: Added documentation for running perf bisects and tryjobs. (Closed)
Patch Set: added documentation for perf trybots, and TOC Created 3 years, 6 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « docs/speed/images/bisecting_revision_step.png ('k') | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
(Empty)
1 # Perf Try Bots
2
3 [TOC]
4
5 ## What are perf try bots?
6
7 Chrome has a performance lab with dozens of device and OS configurations. You
8 can run performance tests on an unsubmitted CL on these devices using the
9 perf try bots.
10
11 ## Supported platforms
12
13 The platforms available in the lab change over time. To find the currently
14 available platforms, run `tools/perf/run_benchmark try --help`.
15
16 Example output:
17
18 ```
19 > tools/perf/run_benchmark try --help
20 usage: Run telemetry benchmarks on trybot. You can add all the benchmark options available except the --browser option
21 [-h] [--repo_path <repo path>] [--deps_revision <deps revision>]
22 <trybot name> <benchmark name>
23
24 positional arguments:
25 <trybot name> specify which bots to run telemetry benchmarks on. Allo wed values are:
26 Mac Builder
27 all
28 all-android
29 all-linux
30 all-mac
31 all-win
32 android-fyi
33 android-nexus5
34 android-nexus5X
35 android-nexus6
36 android-nexus7
37 android-one
38 android-webview-arm64-aosp
39 android-webview-nexus6-aosp
40 linux
41 mac-10-11
42 mac-10-12
43 mac-10-12-mini-8gb
44 mac-air
45 mac-pro
46 mac-retina
47 staging-android-nexus5X
48 staging-linux
49 staging-mac-10-12
50 staging-win
51 win
52 win-8
53 win-x64
54 winx64-10
55 winx64-high-dpi
56 winx64-zen
57 winx64ati
58 winx64intel
59 winx64nvidia
60
61 ```
62
63 ## Supported benchmarks
64
65 All the telemetry benchmarks are supported by the perf trybots. To get a full
66 list, run `tools/perf/run_benchmark list`.
67
68 To learn more about the benchmark, you can read about the
69 [system health benchmarks](https://docs.google.com/document/d/1BM_6lBrPzpMNMtcyi 2NFKGIzmzIQ1oH3OlNG27kDGNU/edit?ts=57e92782),
70 which test Chrome's performance at a high level, and the
71 [benchmark harnesses](https://docs.google.com/spreadsheets/d/1ZdQ9OHqEjF5v8dqNjd 7lGUjJnK6sgi8MiqO7eZVMgD0/edit#gid=0),
72 which cover more specific areas.
73
74 ## Starting a perf try job
75
76 Use this command line:
77
78 `tools/perf/run_benchmark try <trybot_name> <benchmark_name>`
79
80 See above for how to choose a trybot and benchmark.
81
82 Run `tools/perf/run_benchmark try --help` for more information about available
83 options.
84
85 ## Interpreting the results
86
87 Perf trybots create a code review under the covers to hold the trybot results.
88 The code review will list links to buildbot status pages for the try jobs.
89 On each buildbot status page, you will see a "HTML Results" link. You can click
90 it to see detailed information about the performance test results with and
91 without your patch.
92
93 **[Here is the documentation](https://github.com/catapult-project/catapult/blob/ master/docs/metrics-results-ui.md)**
94 on reading the results.
OLDNEW
« no previous file with comments | « docs/speed/images/bisecting_revision_step.png ('k') | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698