OLD | NEW |
1 #!/usr/bin/env python | 1 #!/usr/bin/env python |
2 # Copyright (c) 2011 The Chromium Authors. All rights reserved. | 2 # Copyright (c) 2011 The Chromium Authors. All rights reserved. |
3 # Use of this source code is governed by a BSD-style license that can be | 3 # Use of this source code is governed by a BSD-style license that can be |
4 # found in the LICENSE file. | 4 # found in the LICENSE file. |
5 | 5 |
6 """Dromaeo benchmark automation script. | 6 """Dromaeo benchmark automation script. |
7 | 7 |
8 Script runs dromaeo tests in browsers specified by --browser switch and saves | 8 Script runs dromaeo tests in browsers specified by --browser switch and saves |
9 results to a spreadsheet on docs.google.com. | 9 results to a spreadsheet on docs.google.com. |
10 | 10 |
11 Prerequisites: | 11 Prerequisites: |
12 1. Install Google Data APIs Python Client Library from | 12 1. Install Google Data APIs Python Client Library from |
13 http://code.google.com/p/gdata-python-client. | 13 http://code.google.com/p/gdata-python-client. |
14 2. Checkout Dromaeo benchmark from | 14 2. Checkout Dromaeo benchmark from |
15 http://src.chromium.org/svn/trunk/src/chrome/test/data/dromaeo and provide | 15 http://src.chromium.org/svn/trunk/src/chrome/test/data/dromaeo and provide |
16 local path to it in --dromaeo_home switch. | 16 local path to it in --dromaeo_home switch. |
17 3. Create a spreadsheet at http://docs.google.com and specify it's name in | 17 3. Create a spreadsheet at http://docs.google.com and specify its name in |
18 --spreadsheet switch | 18 --spreadsheet switch |
19 | 19 |
20 Benchmark results are presented in the following format: | 20 Benchmark results are presented in the following format: |
21 browser | date time | 21 browser | date time |
22 test 1 name|m11|...|m1n|test 1 average mean| |e11|...|e1n|test 1 average error | 22 test 1 name|m11|...|m1n|test 1 average mean| |e11|...|e1n|test 1 average error |
23 test 2 name|m21|...|m2n|test 2 average mean| |e21|...|e2n|test 2 average error | 23 test 2 name|m21|...|m2n|test 2 average mean| |e21|...|e2n|test 2 average error |
24 ... | 24 ... |
25 | 25 |
26 Here mij is mean run/s in individual dromaeo test i during benchmark run j, | 26 Here mij is mean run/s in individual dromaeo test i during benchmark run j, |
27 eij is error in individual dromaeo test i during benchmark run j. | 27 eij is error in individual dromaeo test i during benchmark run j. |
(...skipping 229 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
257 # Insert test results into spreadsheet. | 257 # Insert test results into spreadsheet. |
258 for (test_name, test_data) in benchmark_results.data.iteritems(): | 258 for (test_name, test_data) in benchmark_results.data.iteritems(): |
259 spreadsheet_writer.WriteBrowserBenchmarkResults(test_name, test_data) | 259 spreadsheet_writer.WriteBrowserBenchmarkResults(test_name, test_data) |
260 | 260 |
261 server.socket.close() | 261 server.socket.close() |
262 return 0 | 262 return 0 |
263 | 263 |
264 | 264 |
265 if __name__ == '__main__': | 265 if __name__ == '__main__': |
266 sys.exit(main()) | 266 sys.exit(main()) |
OLD | NEW |