Index: tools/auto_bisect/bisect.cfg |
diff --git a/tools/run-bisect-perf-regression.cfg b/tools/auto_bisect/bisect.cfg |
similarity index 57% |
rename from tools/run-bisect-perf-regression.cfg |
rename to tools/auto_bisect/bisect.cfg |
index 085a0fc58b70f0ec62680b8c2dc2a000d8000a38..91fdd70319f0e1e649e95f3dbda1cefb9a4f239e 100644 |
--- a/tools/run-bisect-perf-regression.cfg |
+++ b/tools/auto_bisect/bisect.cfg |
@@ -2,7 +2,7 @@ |
# Use of this source code is governed by a BSD-style license that can be |
# found in the LICENSE file. |
-"""Config file for Run Performance Test Bisect Tool |
+"""Config file read by run-bisect-perf-regression.py. |
This script is intended for use by anyone that wants to run a remote bisection |
on a range of revisions to look for a performance regression. Modify the config |
@@ -12,67 +12,50 @@ run a git try <bot>. |
Changes to this file should never be submitted. |
Args: |
- 'command': This is the full command line to pass to the |
- bisect-perf-regression.py script in order to execute the test. |
+ 'command': This is the full command to execute the test. |
'good_revision': An svn or git revision where the metric hadn't regressed yet. |
- 'bad_revision': An svn or git revision sometime after the metric had |
- regressed. |
+ 'bad_revision': An svn or git revision sometime after the metric regressed. |
'metric': The name of the metric to parse out from the results of the |
performance test. You can retrieve the metric by looking at the stdio of |
the performance test. Look for lines of the format: |
- |
- RESULT <graph>: <trace>= <value> <units> |
- |
+ RESULT <graph>: <trace>= <value> <units> |
The metric name is "<graph>/<trace>". |
'repeat_count': The number of times to repeat the performance test. |
'max_time_minutes': The script will attempt to run the performance test |
"repeat_count" times, unless it exceeds "max_time_minutes". |
- 'truncate_percent': Discard the highest/lowest % values from performance test. |
+ 'truncate_percent': The highest/lowest % values will be discarded before |
+ computing the mean result for each revision. |
Sample config: |
config = { |
- 'command': './tools/perf/run_measurement --browser=release blink_perf third_party/WebKit/PerformanceTests/Layout/floats_50_100.html', |
- 'good_revision': '233015', |
- 'bad_revision': '233115', |
- 'metric': 'floats_50_100/floats_50_100', |
- 'repeat_count': '20', |
- 'max_time_minutes': '20', |
- 'truncate_percent': '25', |
-} |
- |
-On Windows: |
- - If you're calling a python script you will need to add "python" to |
-the command: |
- |
-config = { |
- 'command': 'python tools/perf/run_measurement -v --browser=release kraken', |
- 'good_revision': '185319', |
- 'bad_revision': '185364', |
+ 'command': './tools/perf/run_benchmark --browser=release sunspider', |
'metric': 'Total/Total', |
+ 'good_revision': '14ac2486c0eba1266d2da1c52e8759d9c784fe80', |
+ 'bad_revision': 'fcf8643d31301eea990a4c42d7d8c9fc30cc33ec', |
'repeat_count': '20', |
'max_time_minutes': '20', |
'truncate_percent': '25', |
} |
+For Windows, if you're calling a python script you will need to add "python" |
+to the command, so the command would be changed to: |
+ 'python tools/perf/run_benchmark -v --browser=release sunspider', |
-On ChromeOS: |
- - Script accepts either ChromeOS versions, or unix timestamps as revisions. |
+For ChromeOS: |
+ - For good and bad revision, the script may accept either ChromeOS versions |
+ or unix timestamps. |
- You don't need to specify --identity and --remote, they will be added to |
- the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values. |
+ the command using the bot's BISECT_CROS_IP and BISECT_CROS_BOARD values |
+ - Example: |
config = { |
- 'command': './tools/perf/run_measurement -v '\ |
- '--browser=cros-chrome-guest '\ |
- 'dromaeo tools/perf/page_sets/dromaeo/jslibstylejquery.json', |
+ 'command': ('./tools/perf/run_measurement -v --browser=cros-chrome-guest ' |
+ 'dromaeo.jslibstylejquery') |
'good_revision': '4086.0.0', |
'bad_revision': '4087.0.0', |
'metric': 'jslib/jslib', |
- 'repeat_count': '20', |
- 'max_time_minutes': '20', |
- 'truncate_percent': '25', |
} |
- |
""" |
config = { |