| OLD | NEW |
| 1 #!/usr/bin/env python | 1 #!/usr/bin/env python |
| 2 # Copyright (c) 2011 The Chromium Authors. All rights reserved. | 2 # Copyright (c) 2011 The Chromium Authors. All rights reserved. |
| 3 # Use of this source code is governed by a BSD-style license that can be | 3 # Use of this source code is governed by a BSD-style license that can be |
| 4 # found in the LICENSE file. | 4 # found in the LICENSE file. |
| 5 | 5 |
| 6 """Dromaeo benchmark automation script. | 6 """Dromaeo benchmark automation script. |
| 7 | 7 |
| 8 Script runs dromaeo tests in browsers specified by --browser switch and saves | 8 Script runs dromaeo tests in browsers specified by --browser switch and saves |
| 9 results to a spreadsheet on docs.google.com. | 9 results to a spreadsheet on docs.google.com. |
| 10 | 10 |
| 11 Prerequisites: | 11 Prerequisites: |
| 12 1. Install Google Data APIs Python Client Library from | 12 1. Install Google Data APIs Python Client Library from |
| 13 http://code.google.com/p/gdata-python-client. | 13 http://code.google.com/p/gdata-python-client. |
| 14 2. Checkout Dromaeo benchmark from | 14 2. Checkout Dromaeo benchmark from |
| 15 http://src.chromium.org/svn/trunk/src/chrome/test/data/dromaeo and provide | 15 http://src.chromium.org/svn/trunk/src/chrome/test/data/dromaeo and provide |
| 16 local path to it in --dromaeo_home switch. | 16 local path to it in --dromaeo_home switch. |
| 17 3. Create a spreadsheet at http://docs.google.com and specify it's name in | 17 3. Create a spreadsheet at http://docs.google.com and specify its name in |
| 18 --spreadsheet switch | 18 --spreadsheet switch |
| 19 | 19 |
| 20 Benchmark results are presented in the following format: | 20 Benchmark results are presented in the following format: |
| 21 browser | date time | 21 browser | date time |
| 22 test 1 name|m11|...|m1n|test 1 average mean| |e11|...|e1n|test 1 average error | 22 test 1 name|m11|...|m1n|test 1 average mean| |e11|...|e1n|test 1 average error |
| 23 test 2 name|m21|...|m2n|test 2 average mean| |e21|...|e2n|test 2 average error | 23 test 2 name|m21|...|m2n|test 2 average mean| |e21|...|e2n|test 2 average error |
| 24 ... | 24 ... |
| 25 | 25 |
| 26 Here mij is mean run/s in individual dromaeo test i during benchmark run j, | 26 Here mij is mean run/s in individual dromaeo test i during benchmark run j, |
| 27 eij is error in individual dromaeo test i during benchmark run j. | 27 eij is error in individual dromaeo test i during benchmark run j. |
| (...skipping 229 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 257 # Insert test results into spreadsheet. | 257 # Insert test results into spreadsheet. |
| 258 for (test_name, test_data) in benchmark_results.data.iteritems(): | 258 for (test_name, test_data) in benchmark_results.data.iteritems(): |
| 259 spreadsheet_writer.WriteBrowserBenchmarkResults(test_name, test_data) | 259 spreadsheet_writer.WriteBrowserBenchmarkResults(test_name, test_data) |
| 260 | 260 |
| 261 server.socket.close() | 261 server.socket.close() |
| 262 return 0 | 262 return 0 |
| 263 | 263 |
| 264 | 264 |
| 265 if __name__ == '__main__': | 265 if __name__ == '__main__': |
| 266 sys.exit(main()) | 266 sys.exit(main()) |
| OLD | NEW |