| OLD | NEW |
| 1 # Copyright 2013 The Chromium Authors. All rights reserved. | 1 # Copyright 2013 The Chromium Authors. All rights reserved. |
| 2 # Use of this source code is governed by a BSD-style license that can be | 2 # Use of this source code is governed by a BSD-style license that can be |
| 3 # found in the LICENSE file. | 3 # found in the LICENSE file. |
| 4 | 4 |
| 5 """Config file for Run Performance Test Bot | 5 """Config file for Run Performance Test Bot |
| 6 | 6 |
| 7 This script is intended for use by anyone that wants to run a remote performance | 7 This script is intended for use by anyone that wants to run a remote performance |
| 8 test. Modify the config below and add the command to run the performance test, | 8 test. Modify the config below and add the command to run the performance test, |
| 9 the metric you're interested in, and repeat/discard parameters. You can then | 9 the metric you're interested in, and repeat/discard parameters. You can then |
| 10 run a git try <bot>. | 10 run a git try <bot>. |
| (...skipping 11 matching lines...) Expand all Loading... |
| 22 | 22 |
| 23 The metric name is "<graph>/<trace>". | 23 The metric name is "<graph>/<trace>". |
| 24 'repeat_count': The number of times to repeat the performance test. | 24 'repeat_count': The number of times to repeat the performance test. |
| 25 'max_time_minutes': The script will attempt to run the performance test | 25 'max_time_minutes': The script will attempt to run the performance test |
| 26 "repeat_count" times, unless it exceeds "max_time_minutes". | 26 "repeat_count" times, unless it exceeds "max_time_minutes". |
| 27 'truncate_percent': Discard the highest/lowest % values from performance test. | 27 'truncate_percent': Discard the highest/lowest % values from performance test. |
| 28 | 28 |
| 29 Sample config: | 29 Sample config: |
| 30 | 30 |
| 31 config = { | 31 config = { |
| 32 'command': './tools/perf/run_measurement --browser=release blink_perf third_pa
rty/WebKit/PerformanceTests/Layout/floats_50_100.html', | 32 'command': './tools/perf/run_benchmark --browser=release smoothness.key_mobile
_sites', |
| 33 'metric': 'floats_50_100/floats_50_100', | 33 'metric': 'mean_frame_time/mean_frame_time', |
| 34 'repeat_count': '20', | 34 'repeat_count': '20', |
| 35 'max_time_minutes': '20', | 35 'max_time_minutes': '20', |
| 36 'truncate_percent': '25', | 36 'truncate_percent': '25', |
| 37 } | 37 } |
| 38 | 38 |
| 39 On Windows: | 39 On Windows: |
| 40 - If you're calling a python script you will need to add "python" to | 40 - If you're calling a python script you will need to add "python" to |
| 41 the command: | 41 the command: |
| 42 | 42 |
| 43 config = { | 43 config = { |
| 44 'command': 'python tools/perf/run_measurement -v --browser=release kraken', | 44 'command': 'python tools/perf/run_benchmark -v --browser=release smoothness.ke
y_mobile_sites', |
| 45 'metric': 'Total/Total', | 45 'metric': 'mean_frame_time/mean_frame_time', |
| 46 'repeat_count': '20', | 46 'repeat_count': '20', |
| 47 'max_time_minutes': '20', | 47 'max_time_minutes': '20', |
| 48 'truncate_percent': '25', | 48 'truncate_percent': '25', |
| 49 } | 49 } |
| 50 | 50 |
| 51 | 51 |
| 52 On ChromeOS: | 52 On ChromeOS: |
| 53 - Script accepts either ChromeOS versions, or unix timestamps as revisions. | 53 - Script accepts either ChromeOS versions, or unix timestamps as revisions. |
| 54 - You don't need to specify --identity and --remote, they will be added to | 54 - You don't need to specify --identity and --remote, they will be added to |
| 55 the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values. | 55 the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values. |
| 56 | 56 |
| 57 config = { | 57 config = { |
| 58 'command': './tools/perf/run_measurement -v '\ | 58 'command': './tools/perf/run_benchmark -v '\ |
| 59 '--browser=cros-chrome-guest '\ | 59 '--browser=cros-chrome-guest '\ |
| 60 'dromaeo tools/perf/page_sets/dromaeo/jslibstylejquery.json', | 60 'smoothness.key_mobile_sites', |
| 61 'metric': 'jslib/jslib', | 61 'metric': 'mean_frame_time/mean_frame_time', |
| 62 'repeat_count': '20', | 62 'repeat_count': '20', |
| 63 'max_time_minutes': '20', | 63 'max_time_minutes': '20', |
| 64 'truncate_percent': '25', | 64 'truncate_percent': '25', |
| 65 } | 65 } |
| 66 | 66 |
| 67 """ | 67 """ |
| 68 | 68 |
| 69 config = { | 69 config = { |
| 70 'command': '', | 70 'command': '', |
| 71 'metric': '', | 71 'metric': '', |
| 72 'repeat_count': '', | 72 'repeat_count': '', |
| 73 'max_time_minutes': '', | 73 'max_time_minutes': '', |
| 74 'truncate_percent': '', | 74 'truncate_percent': '', |
| 75 } | 75 } |
| 76 | 76 |
| 77 # Workaround git try issue, see crbug.com/257689 | 77 # Workaround git try issue, see crbug.com/257689 |
| OLD | NEW |