Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(169)

Side by Side Diff: tools/testing/perf_testing/perf_README.txt

Issue 8815018: Added readme about performance testing for browser perf setup. (Closed) Base URL: http://dart.googlecode.com/svn/branches/bleeding_edge/dart/
Patch Set: '' Created 8 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
(Empty)
1 Setup to run all performance tests:
2
3 TODO(efortuna): run through these steps again on a clean machine to make sure I
4 didn't leave anything out!
5
6 Overview:
7 These are the instructions to run a wide variety of performance tests using
8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are
9 uploaded to https://dartperf.googleplex.com/.
10
11 A variant of these tests are running on our buildbots to test Chrome and
12 Firefox (since the buildbots are Linux) that simply ensure that no changes to
13 frog have broken updating the dom, but not for testing performance.
14
15 This file details how to set up configurations for each setup. It is long,
16 because there are many variants depending on what platform you're on, and what
17 you want to set up.
18
19 ============ Windows Installation =============
20
21 Setting up Windows on Mac hardware:
22 If you need to install Windows 7 via dual-boot mac, use BootCamp to install
23 Windows 7 Professional. You can obtain a copy of Windows 7 (Google internal)
24 by getting an MSDN subscription via GUTS. When installing via BootCamp, don't
25 forget to also install the "WindowsSupport" drivers that are optional --
26 you'll need them to be able to connect to any wireless network in Windows.
27
28 Great! You have a shiny dual-booting machine!
29
30 Use the following instructions to set up for Windows builds:
31 http://www.chromium.org/developers/how-tos/build-instructions-windows
32
33 NOTE: DO NOT USE Visual Studio 2010 to try to build the project!! Right now Dart
34 only builds with VS2008 versions!
35
36 Then:
37 1) Download installer for OpenSSL for Windows via
38 http://openssl.org/related/binaries.html
39 2) Install OpenSSL
40 3) Copy the directory OpenSSL-Win32/include/openssl to
41 C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\include
42 4) Copy the ***contents*** of the directory OpenSSL-Win32/lib/VC/static/ to
43 C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\lib
44
45 ============= All Platforms ================
46
47 1) Ensure Python 2.7 is installed and in your path.
48
49 2) Install selenium library python bindings
50 (http://pypi.python.org/pypi/selenium)
51
52 3) Mac only:
53 Download and install xcode 3.2:
54 https://developer.apple.com/devcenter/download.action?path=/Developer_Tools /xcode_3.2.6_and_ios_sdk_4.3__final/xcode_3.2.6_and_ios_sdk_4.3.dmg
55 a) Mount dmg
56 b) LION only: At a terminal type:
57 TODO(efortuna): verify
58 $> export COMMAND_LINE_INSTALL=1
59 $> open "/Volumes/Xcode and iOS SDK/Xcode and iOS SDK.mpkg"
60 c) Install.
61
62 4) (Mac OS Lion only) Install xcode 4.0 and then run:
63 $> xcode-select -switch /path/to/xcode3.2.6/
64
65 5) Ensure Firefox is installed.
66
67 If you only want to run the smoketests, you're done!
68 While standing in dart/tools/testing/perf_testing, run
69 $> python create_graph.py -b
70 If everything goes well, you'll see it print out "PASS" at the command line.
71
72 To continue on to run the performance tests:
73
74 6) Ensure Java is installed and in your path. If not, install the Java jdk
75 (so that we can run the webdriver server from its jar)
76
77 7) Add the following to your DEPS file in all.deps in the "deps = {" section:
78 # Copy of Python appengine latest release version
79 "dart/third_party/appengine-python/1.5.4":
80 "http://googleappengine.googlecode.com/svn/trunk/python@199",
81
82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari)
83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar
84 and run it:
85 $> java -jar selenium-server-standalone-2.15.0.jar
86
87 9) Ensure that Chrome, Safari and IE (Windows only) are installed.
88
89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
90 and make sure it is in your path.
91
92 10)Disable pop-up blocking in Safari:
93 Preferences -> Security -> (unselect) Block pop-up windows.
94
95 11)TODO(efortuna): Deal with appengine check in! Run
96 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/'
97 while standing in dart/tools/testing/perf_tests.
98
99 12)Install matplotlib http://matplotlib.sourceforge.net/
100
101 13)Pull down benchmarks from internal repo (Google only):
102 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup
103
104 14) Run the tests! While standing in dart/tools/testing/perf_testing, run
105 $> python create_graph.py --forever --verbose --perfbot
106 to run all the tests (browser performance, language correctness in the
107 browser, command line performance, and self-hosted compile time and compiled
108 code size).
109
110 You can run individual tests by adding the particular option (such as
111 --language) when running create_graph.py. Type "create_graph.py -h" for a
112 full list of the options.
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698