Add a Telemetry based cold startup test.

tools/perf/benchmarks/startup.py

+# Copyright (c) 2013 The Chromium Authors. All rights reserved.
+# Use of this source code is governed by a BSD-style license that can be
+# found in the LICENSE file.
+from telemetry import test
+
+from measurements import startup
+
+
+class StartupColdBlankPage(test.Test):
+  test = startup.Startup
+  page_set = 'page_sets/blank_page.json'
+  options = {'cold': True,
+             'pageset_repeat_iters': 5}

[jeremy, 2013/08/08 13:00:28]

Are we OK with 5 iterations on all platforms?  Android said things were slow on
their end (albeit that was when things were wired up for 20 iterations).

[James Simonsen, 2013/08/08 17:34:41]

I think 5 is a good starting point for the cold test. It's significantly slower
than warm. Clearing the cache takes time, then the startup is a lot slower too.
I say we start here and change it depending on how it goes.

+
+
+class StartupWarmBlankPage(test.Test):
+  test = startup.Startup
+  page_set = 'page_sets/blank_page.json'
+  options = {'warm': True,
+             'pageset_repeat_iters': 5}

[tonyg, 2013/08/08 15:33:11]

Any idea what this will do to variance? It is currently running with 20
iterations.

[James Simonsen, 2013/08/08 17:34:41]

Done.