Chromium Code Reviews| OLD | NEW |
|---|---|
| (Empty) | |
| 1 Setup to run all performance tests: | |
| 2 | |
| 3 TODO(efortuna): run through these steps again on a clean machine to make sure I | |
| 4 didn't leave anything out! | |
| 5 | |
| 6 Overview: | |
| 7 These are the instructions to run a wide variety of performance tests using | |
| 8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are | |
| 9 uploaded to https://dartperf.googleplex.com/. | |
| 10 | |
| 11 A variant of these tests are running on our buildbots to test Chrome and | |
| 12 Firefox (since the buildbots are Linux) that simply ensure that no changes have | |
|
dgrove
2012/01/03 18:09:03
s/no changes have/no changes to/
| |
| 13 frog have broken updating the dom, but not for testing performance. | |
| 14 | |
| 15 This file details how to set up configurations for each setup. It is long, | |
| 16 because there are many variants depending on what platform you're on, and what | |
| 17 you want to set up. | |
| 18 | |
| 19 ============ Windows Installation ============= | |
| 20 | |
| 21 Setting up Windows on Mac hardware: | |
| 22 If you need to install Windows 7 via dual-boot mac, use BootCamp to install | |
| 23 Windows 7 Professional. You can obtain a copy of Windows 7 (Google internal) | |
| 24 by getting an MSDN subscription via GUTS. When installing via BootCamp, don't | |
| 25 forget to also install the "WindowsSupport" drivers that are optional -- | |
| 26 you'll need them to be able to connect to any wireless network in Windows. | |
| 27 | |
| 28 Great! You have a shiny dual-booting machine! | |
| 29 | |
| 30 Use the following instructions to set up for Windows builds: | |
| 31 http://www.chromium.org/developers/how-tos/build-instructions-windows | |
| 32 | |
| 33 NOTE: DO NOT USE Visual Studio 2010 to try to build the project!! Right now Dart | |
| 34 only builds with VS2008 versions! | |
| 35 | |
| 36 Then: | |
| 37 1) Download installer for OpenSSL for Windows via | |
| 38 http://openssl.org/related/binaries.html | |
| 39 2) Install OpenSSL | |
| 40 3) Copy the directory OpenSSL-Win32/include/openssl to | |
| 41 C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\include | |
| 42 4) Copy the ***contents*** of the directory OpenSSL-Win32/lib/VC/static/ to | |
| 43 C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\lib | |
| 44 | |
| 45 ============= All Platforms ================ | |
| 46 | |
| 47 1) Ensure Python 2.7 is installed and in your path. | |
| 48 | |
| 49 2) Install selenium library python bindings | |
| 50 (http://pypi.python.org/pypi/selenium) | |
| 51 | |
| 52 3) Mac only: | |
| 53 Download and install xcode 3.2: | |
| 54 https://developer.apple.com/devcenter/download.action?path=/Developer_Tools /xcode_3.2.6_and_ios_sdk_4.3__final/xcode_3.2.6_and_ios_sdk_4.3.dmg | |
| 55 a) Mount dmg | |
| 56 b) LION only: At a terminal type: | |
| 57 TODO(efortuna): verify | |
| 58 $> export COMMAND_LINE_INSTALL=1 | |
| 59 $> open "/Volumes/Xcode and iOS SDK/Xcode and iOS SDK.mpkg" | |
| 60 c) Install. | |
| 61 | |
| 62 4) (Mac OS Lion only) Install xcode 4.0 and then run: | |
| 63 $> xcode-select -switch /path/to/xcode3.2.6/ | |
| 64 | |
| 65 5) Ensure Firefox is installed. | |
| 66 | |
| 67 If you only want to run the smoketests, you're done! | |
| 68 While standing in dart/tools/testing/perf_testing, run | |
| 69 $> python create_graph.py -b | |
| 70 If everything goes well, you'll see it print out "PASS" at the command line. | |
| 71 | |
| 72 To continue on to run the performance tests: | |
| 73 | |
| 74 6) Ensure Java is installed and in your path. If not, install the Java jdk | |
| 75 (so that we can run the webdriver server from its jar) | |
| 76 | |
| 77 7) Add the following to your DEPS file in all.deps in the "deps = {" section: | |
| 78 # Copy of Python appengine latest release version | |
| 79 "dart/third_party/appengine-python/1.5.4": | |
| 80 "http://googleappengine.googlecode.com/svn/trunk/python@199", | |
| 81 | |
| 82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) | |
| 83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar | |
| 84 and run it: | |
| 85 $> java -jar selenium-server-standalone-2.15.0.jar | |
| 86 | |
| 87 9) Ensure that Chrome, Safari and IE (Windows only) are installed. | |
| 88 | |
| 89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list | |
| 90 and make sure it is in your path. | |
| 91 | |
| 92 10)Disable pop-up blocking in Safari: | |
| 93 Preferences -> Security -> (unselect) Block pop-up windows. | |
| 94 | |
| 95 11)TODO(efortuna): Deal with appengine check in! Run | |
| 96 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' | |
| 97 while standing in dart/tools/testing/perf_tests. | |
| 98 | |
| 99 12)Install matplotlib http://matplotlib.sourceforge.net/ | |
| 100 | |
| 101 13)Pull down benchmarks from internal repo (Google only): | |
| 102 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup | |
| 103 | |
| 104 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | |
| 105 $> python create_graph.py --forever --verbose --perfbot | |
| 106 to run all the tests (browser performance, language correctness in the | |
| 107 browser, command line performance, and self-hosted compile time and compiled | |
| 108 code size). | |
| 109 | |
| 110 You can run individual tests by adding the particular option (such as | |
| 111 --language) when running create_graph.py. Type "create_graph.py -h" for a | |
| 112 full list of the options. | |
| OLD | NEW |