Make quiesence test best-effort for the blink_style benchmark

Make quiesence test best-effort in the blink_style benchmark

Some sites, notably techcrunch, in top25 were failing to reach readyState
complete or quiesence due to continual requests (possibly an artifact of
the wpr). As this benchmark normalizes/categories results, it shouldn't
be necessary to reach the same state on every run.

Also switches to a tighter tracing category which allows the reference build
to be re-enabled, since the metrics will not appear there until they are
valid to be consumed by the blink_style measurement.

BUG=479048
Committed: https://crrev.com/13e95bde55343d1351b4879be84e13f9ac01bec2
Cr-Commit-Position: refs/heads/master@{#327235}

[dstockwell, 2015-04-27 02:37:45]

dstockwell@chromium.org changed reviewers:
+ dtu@chromium.org, sullivan@chromium.org

[dstockwell, 2015-04-27 02:38:01]

Perf try-jobs:

blink_style.key_mobile_sites on trybot-android-nexus7
https://codereview.chromium.org/1092983004

blink_style.polymer on trybot-android-nexus7
https://codereview.chromium.org/1103103002

blink_style.polymer on trybot-linux
https://codereview.chromium.org/1107813002

blink_style.polymer on trybot-mac
https://codereview.chromium.org/1058283008

[dstockwell, 2015-04-27 02:57:24]

http://techcrunch.com failed in blink_style.top_25 by timing out in
WaitForDocumentReadyStateToBeComplete

[dstockwell, 2015-04-27 07:49:20]

On 2015/04/27 at 02:57:24, dstockwell wrote:
> http://techcrunch.com failed in blink_style.top_25 by timing out in
WaitForDocumentReadyStateToBeComplete

closing while I work this out, loading the page with tracing enabled seems to be
killing it :/

[dstockwell, 2015-04-27 10:28:55]

PTAL

New perf try jobs:
mac blink_style.top_25: https://codereview.chromium.org/1102283002
linux blink_style.top_25: https://codereview.chromium.org/1103133002
nexus7 blink_style.polymer: https://codereview.chromium.org/1104043003
nexus7 blink_style.key_mobile_sites: https://codereview.chromium.org/1109753002

[dstockwell, 2015-04-27 11:02:22]

Switching to the blink_style trace category now depends on
https://codereview.chromium.org/1102293002

[dtu, 2015-04-27 13:02:21]

Just one comment. lgtm otherwise

https://codereview.chromium.org/1100853003/diff/80001/tools/perf/measurements...
File tools/perf/measurements/blink_style.py (right):

https://codereview.chromium.org/1100853003/diff/80001/tools/perf/measurements...
tools/perf/measurements/blink_style.py:34: except exceptions.TimeoutException:
? Can you add a comment explaining why you want to wait at most 15 seconds
instead of always waiting until quiescence?

[sullivan, 2015-04-27 13:06:06]

On 2015/04/27 10:28:55, dstockwell wrote:
> PTAL
> 
> New perf try jobs:
> mac blink_style.top_25: https://codereview.chromium.org/1102283002
> linux blink_style.top_25: https://codereview.chromium.org/1103133002
> nexus7 blink_style.polymer: https://codereview.chromium.org/1104043003
> nexus7 blink_style.key_mobile_sites:
https://codereview.chromium.org/1109753002

These all fail with the same error:
http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_perf_bisect/...
http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisec...
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...

[ RUN      ] https://www.google.com/#hl=en&q=barack+obama
Traceback (most recent call last):
  File "./tools/perf/../telemetry/telemetry/user_story/user_story_runner.py",
line 88, in _RunUserStoryAndProcessErrorIfNeeded
    state.RunUserStory(results)
  File "./tools/perf/../telemetry/telemetry/page/shared_page_state.py", line
260, in RunUserStory
    self._test.RunPage(self._current_page, self._current_tab, results)
  File "./tools/perf/../telemetry/telemetry/page/page_test.py", line 215, in
RunPage
    self.ValidateAndMeasurePage(page, tab, results)
  File
"/b/build/slave/mac_perf_bisect/build/src/tools/perf/measurements/blink_style.py",
line 68, in ValidateAndMeasurePage
    access_count = event.args['resolverAccessCount']
KeyError: 'resolverAccessCount'

[  FAILED  ] https://www.google.com/#hl=en&q=barack+obama (6724 ms)

Traceback (most recent call last):
  Run at tools/telemetry/telemetry/benchmark.py:202
    max_failures=self._max_failures)
  Run at tools/telemetry/telemetry/user_story/user_story_runner.py:221
    expectations, user_story, results, state)
  _RunUserStoryAndProcessErrorIfNeeded at
tools/telemetry/telemetry/user_story/user_story_runner.py:88
    state.RunUserStory(results)
  RunUserStory at tools/telemetry/telemetry/page/shared_page_state.py:260
    self._test.RunPage(self._current_page, self._current_tab, results)
  RunPage at tools/telemetry/telemetry/page/page_test.py:215
    self.ValidateAndMeasurePage(page, tab, results)
  ValidateAndMeasurePage at tools/perf/measurements/blink_style.py:68
    access_count = event.args['resolverAccessCount']
KeyError: 'resolverAccessCount'

[ RUN      ]
http://iphone.capitolvolkswagen.com/index.htm#new-inventory_p_2Fsb-new_p_2Eht...
76 KB/s (3383 bytes in 0.043s)
CRITICAL:root:[0427/041317:ERROR:daemon.cc(232)] No forwarder daemon seems to be
running

Traceback (most recent call last):
  File "./tools/perf/../telemetry/telemetry/user_story/user_story_runner.py",
line 88, in _RunUserStoryAndProcessErrorIfNeeded
    state.RunUserStory(results)
  File "./tools/perf/../telemetry/telemetry/page/shared_page_state.py", line
260, in RunUserStory
    self._test.RunPage(self._current_page, self._current_tab, results)
  File "./tools/perf/../telemetry/telemetry/page/page_test.py", line 215, in
RunPage
    self.ValidateAndMeasurePage(page, tab, results)
  File
"/b/build/slave/android/build/src/tools/perf/measurements/blink_style.py", line
68, in ValidateAndMeasurePage
    access_count = event.args['resolverAccessCount']
KeyError: 'resolverAccessCount'

[  FAILED  ]
http://iphone.capitolvolkswagen.com/index.htm#new-inventory_p_2Fsb-new_p_2Eht...
(17138 ms)

Traceback (most recent call last):
  Run at tools/telemetry/telemetry/benchmark.py:202
    max_failures=self._max_failures)
  Run at tools/telemetry/telemetry/user_story/user_story_runner.py:221
    expectations, user_story, results, state)
  _RunUserStoryAndProcessErrorIfNeeded at
tools/telemetry/telemetry/user_story/user_story_runner.py:88
    state.RunUserStory(results)
  RunUserStory at tools/telemetry/telemetry/page/shared_page_state.py:260
    self._test.RunPage(self._current_page, self._current_tab, results)
  RunPage at tools/telemetry/telemetry/page/page_test.py:215
    self.ValidateAndMeasurePage(page, tab, results)
  ValidateAndMeasurePage at tools/perf/measurements/blink_style.py:68
    access_count = event.args['resolverAccessCount']
KeyError: 'resolverAccessCount'

[dstockwell, 2015-04-28 01:31:54]

On 2015/04/27 at 13:06:06, sullivan wrote:
> On 2015/04/27 10:28:55, dstockwell wrote:
> > PTAL
> > 
> > New perf try jobs:
> > mac blink_style.top_25: https://codereview.chromium.org/1102283002
> > linux blink_style.top_25: https://codereview.chromium.org/1103133002
> > nexus7 blink_style.polymer: https://codereview.chromium.org/1104043003
> > nexus7 blink_style.key_mobile_sites:
https://codereview.chromium.org/1109753002
> 
> These all fail with the same error:
>
http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_perf_bisect/...
>
http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisec...
>
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...
>
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...

Had to land https://codereview.chromium.org/1102293002 first.

New runs:

trybot-linux blink_style.top_25: https://codereview.chromium.org/1113463002
trybot-mac blink_style.top_25: https://codereview.chromium.org/1106393003
trybot-android-nexus7 blink_style.key_mobile_sites:
https://codereview.chromium.org/1108993003
trybot-android-nexus7 blink_style.polymer:
https://codereview.chromium.org/1111673002

[dstockwell, 2015-04-28 03:38:37]

On 2015/04/28 at 01:31:54, dstockwell wrote:
> On 2015/04/27 at 13:06:06, sullivan wrote:
> > On 2015/04/27 10:28:55, dstockwell wrote:
> > > PTAL
> > > 
> > > New perf try jobs:
> > > mac blink_style.top_25: https://codereview.chromium.org/1102283002
> > > linux blink_style.top_25: https://codereview.chromium.org/1103133002
> > > nexus7 blink_style.polymer: https://codereview.chromium.org/1104043003
> > > nexus7 blink_style.key_mobile_sites:
https://codereview.chromium.org/1109753002
> > 
> > These all fail with the same error:
> >
http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_perf_bisect/...
> >
http://build.chromium.org/p/tryserver.chromium.perf/builders/linux_perf_bisec...
> >
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...
> >
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_p...
> 
> Had to land https://codereview.chromium.org/1102293002 first.
> 
> New runs:
> 
> trybot-linux blink_style.top_25: https://codereview.chromium.org/1113463002
> trybot-mac blink_style.top_25: https://codereview.chromium.org/1106393003
> trybot-android-nexus7 blink_style.key_mobile_sites:
https://codereview.chromium.org/1108993003
> trybot-android-nexus7 blink_style.polymer:
https://codereview.chromium.org/1111673002

Had to do new runs due to a minor typo:

https://codereview.chromium.org/1113473003 mac blink_style.top_25: passing
https://codereview.chromium.org/1113473003 linux blink_style.top_25: passing
https://codereview.chromium.org/1103393003 nexus7 blink_style.polymer: failed to
patch (https://code.google.com/p/chromium/issues/detail?id=481765)
https://codereview.chromium.org/1111683002 nexus7 blink_style.key_mobile_sites:
passing

[dstockwell, 2015-04-28 04:42:58]

The CQ bit was checked by dstockwell@chromium.org

[dstockwell, 2015-04-28 04:42:58]

The patchset sent to the CQ was uploaded after l-g-t-m from dtu@chromium.org
Link to the patchset: https://codereview.chromium.org/1100853003/#ps120001
(title: "Fix typo :/")

[commit-bot: I haz the power, 2015-04-28 04:43:04]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1100853003/120001

[commit-bot: I haz the power, 2015-04-28 05:37:42]

Committed patchset #7 (id:120001)

[commit-bot: I haz the power, 2015-04-28 05:38:34]

Patchset 7 (id:??) landed as
https://crrev.com/13e95bde55343d1351b4879be84e13f9ac01bec2
Cr-Commit-Position: refs/heads/master@{#327235}