OLD | NEW |
1 # Copyright 2013 The Chromium Authors. All rights reserved. | 1 # Copyright 2013 The Chromium Authors. All rights reserved. |
2 # Use of this source code is governed by a BSD-style license that can be | 2 # Use of this source code is governed by a BSD-style license that can be |
3 # found in the LICENSE file. | 3 # found in the LICENSE file. |
4 | 4 |
5 """Config file for Run Performance Test Bot | 5 """Config file for Run Performance Test Bot |
6 | 6 |
7 This script is intended for use by anyone that wants to run a remote performance | 7 This script is intended for use by anyone that wants to run a remote performance |
8 test. Modify the config below and add the command to run the performance test, | 8 test. Modify the config below and add the command to run the performance test, |
9 the metric you're interested in, and repeat/discard parameters. You can then | 9 the metric you're interested in, and repeat/discard parameters. You can then |
10 run a git try <bot>. | 10 run a git try <bot>. |
(...skipping 11 matching lines...) Expand all Loading... |
22 | 22 |
23 The metric name is "<graph>/<trace>". | 23 The metric name is "<graph>/<trace>". |
24 'repeat_count': The number of times to repeat the performance test. | 24 'repeat_count': The number of times to repeat the performance test. |
25 'max_time_minutes': The script will attempt to run the performance test | 25 'max_time_minutes': The script will attempt to run the performance test |
26 "repeat_count" times, unless it exceeds "max_time_minutes". | 26 "repeat_count" times, unless it exceeds "max_time_minutes". |
27 'truncate_percent': Discard the highest/lowest % values from performance test. | 27 'truncate_percent': Discard the highest/lowest % values from performance test. |
28 | 28 |
29 Sample config: | 29 Sample config: |
30 | 30 |
31 config = { | 31 config = { |
32 'command': './tools/perf/run_measurement --browser=release blink_perf third_pa
rty/WebKit/PerformanceTests/Layout/floats_50_100.html', | 32 'command': './tools/perf/run_benchmark --browser=release smoothness.key_mobile
_sites', |
33 'metric': 'floats_50_100/floats_50_100', | 33 'metric': 'mean_frame_time/mean_frame_time', |
34 'repeat_count': '20', | 34 'repeat_count': '20', |
35 'max_time_minutes': '20', | 35 'max_time_minutes': '20', |
36 'truncate_percent': '25', | 36 'truncate_percent': '25', |
37 } | 37 } |
38 | 38 |
39 On Windows: | 39 On Windows: |
40 - If you're calling a python script you will need to add "python" to | 40 - If you're calling a python script you will need to add "python" to |
41 the command: | 41 the command: |
42 | 42 |
43 config = { | 43 config = { |
44 'command': 'python tools/perf/run_measurement -v --browser=release kraken', | 44 'command': 'python tools/perf/run_benchmark -v --browser=release smoothness.ke
y_mobile_sites', |
45 'metric': 'Total/Total', | 45 'metric': 'mean_frame_time/mean_frame_time', |
46 'repeat_count': '20', | 46 'repeat_count': '20', |
47 'max_time_minutes': '20', | 47 'max_time_minutes': '20', |
48 'truncate_percent': '25', | 48 'truncate_percent': '25', |
49 } | 49 } |
50 | 50 |
51 | 51 |
52 On ChromeOS: | 52 On ChromeOS: |
53 - Script accepts either ChromeOS versions, or unix timestamps as revisions. | 53 - Script accepts either ChromeOS versions, or unix timestamps as revisions. |
54 - You don't need to specify --identity and --remote, they will be added to | 54 - You don't need to specify --identity and --remote, they will be added to |
55 the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values. | 55 the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values. |
56 | 56 |
57 config = { | 57 config = { |
58 'command': './tools/perf/run_measurement -v '\ | 58 'command': './tools/perf/run_benchmark -v '\ |
59 '--browser=cros-chrome-guest '\ | 59 '--browser=cros-chrome-guest '\ |
60 'dromaeo tools/perf/page_sets/dromaeo/jslibstylejquery.json', | 60 'smoothness.key_mobile_sites', |
61 'metric': 'jslib/jslib', | 61 'metric': 'mean_frame_time/mean_frame_time', |
62 'repeat_count': '20', | 62 'repeat_count': '20', |
63 'max_time_minutes': '20', | 63 'max_time_minutes': '20', |
64 'truncate_percent': '25', | 64 'truncate_percent': '25', |
65 } | 65 } |
66 | 66 |
67 """ | 67 """ |
68 | 68 |
69 config = { | 69 config = { |
70 'command': '', | 70 'command': '', |
71 'metric': '', | 71 'metric': '', |
72 'repeat_count': '', | 72 'repeat_count': '', |
73 'max_time_minutes': '', | 73 'max_time_minutes': '', |
74 'truncate_percent': '', | 74 'truncate_percent': '', |
75 } | 75 } |
76 | 76 |
77 # Workaround git try issue, see crbug.com/257689 | 77 # Workaround git try issue, see crbug.com/257689 |
OLD | NEW |