[system-health] Run all SH stories in memory benchmarks

[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq

Committed: https://crrev.com/77952f99e4ae203b6b57005ce9e3476895426b96
Cr-Commit-Position: refs/heads/master@{#406309}

[petrcermak, 2016-07-18 13:35:45]

Description was changed from

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

BUG=589726
==========

to

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:android_s5_perf_cq;master.tryserver.chromium.perf:mac_retina_perf_cq
==========

[petrcermak, 2016-07-18 13:38:58]

Description was changed from

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:android_s5_perf_cq;master.tryserver.chromium.perf:mac_retina_perf_cq
==========

to

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:android_s5_perf_cq;master.tryserver.chromium.perf:mac_retina_perf_cq
==========

[petrcermak, 2016-07-18 13:39:15]

petrcermak@chromium.org changed reviewers:
+ nednguyen@google.com

[petrcermak, 2016-07-18 13:39:15]

PTAL.

Thanks,
Petr

[nednguyen, 2016-07-18 13:43:56]

The CQ bit was checked by nednguyen@google.com

[nednguyen, 2016-07-18 13:43:57]

lgtm

[commit-bot: I haz the power, 2016-07-18 13:44:19]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-18 14:19:32]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-18 14:19:33]

Try jobs failed on following builders:
  linux_android_rel_ng on master.tryserver.chromium.android (JOB_FAILED,
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_androi...)
  linux_chromium_rel_ng on master.tryserver.chromium.linux (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_...)

[petrcermak, 2016-07-18 14:56:14]

The CQ bit was checked by petrcermak@chromium.org

[petrcermak, 2016-07-18 14:56:15]

The patchset sent to the CQ was uploaded after l-g-t-m from nednguyen@google.com
Link to the patchset: https://codereview.chromium.org/2159733002/#ps20001
(title: "Disable several stories in desktop SH smoke tests")

[commit-bot: I haz the power, 2016-07-18 14:56:53]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[nednguyen, 2016-07-18 14:59:11]

On 2016/07/18 14:56:53, commit-bot: I haz the power wrote:
> CQ is trying da patch. Follow status at
>  
>
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

Do you see similar stack trace to  crbug.com/624474?

[nednguyen, 2016-07-18 15:04:05]

On 2016/07/18 14:59:11, nednguyen wrote:
> On 2016/07/18 14:56:53, commit-bot: I haz the power wrote:
> > CQ is trying da patch. Follow status at
> >  
> >
>
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...
> 
> Do you see similar stack trace to  crbug.com/624474?

Looks like we are also blowing up the budget of 960s on linux_android_rel_ng:
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_androi...

:-(

[petrcermak, 2016-07-18 15:07:42]

On 2016/07/18 15:04:05, nednguyen wrote:
> On 2016/07/18 14:59:11, nednguyen wrote:
> > On 2016/07/18 14:56:53, commit-bot: I haz the power wrote:
> > > CQ is trying da patch. Follow status at
> > >  
> > >
> >
>
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...
> > 
> > Do you see similar stack trace to  crbug.com/624474?
> 
> Looks like we are also blowing up the budget of 960s on linux_android_rel_ng:
>
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_androi...
> 
> :-(

Are you talking about the Android bot? I think that the failure is due to OOM. I
didn't disable the failing stories yet because I want to figure out if the
failures are deterministic or flakes.

[commit-bot: I haz the power, 2016-07-18 15:54:08]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-18 15:54:09]

Try jobs failed on following builders:
  win_chromium_x64_rel_ng on master.tryserver.chromium.win (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_x64_...)

[petrcermak, 2016-07-18 15:55:25]

The CQ bit was checked by petrcermak@chromium.org

[commit-bot: I haz the power, 2016-07-18 15:55:56]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-18 16:50:23]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-18 16:50:24]

Try jobs failed on following builders:
  linux_android_rel_ng on master.tryserver.chromium.android (JOB_FAILED,
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_androi...)

[petrcermak, 2016-07-18 17:16:42]

The CQ bit was checked by petrcermak@chromium.org

[petrcermak, 2016-07-18 17:16:42]

The patchset sent to the CQ was uploaded after l-g-t-m from nednguyen@google.com
Link to the patchset: https://codereview.chromium.org/2159733002/#ps40001
(title: "Disable several stories in mobile SH smoke tests")

[commit-bot: I haz the power, 2016-07-18 17:17:10]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-18 19:01:19]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-18 19:01:20]

Try jobs failed on following builders:
  linux_android_rel_ng on master.tryserver.chromium.android (JOB_FAILED,
https://build.chromium.org/p/tryserver.chromium.android/builders/linux_androi...)

[petrcermak, 2016-07-19 11:54:30]

The CQ bit was checked by petrcermak@chromium.org

[petrcermak, 2016-07-19 11:54:31]

The patchset sent to the CQ was uploaded after l-g-t-m from nednguyen@google.com
Link to the patchset: https://codereview.chromium.org/2159733002/#ps60001
(title: "Disable the correct stories on mobile")

[commit-bot: I haz the power, 2016-07-19 11:54:49]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-19 17:10:55]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-07-19 17:10:56]

Try jobs failed on following builders:
  android_s5_perf_cq on master.tryserver.chromium.perf (JOB_FAILED,
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_s5_perf_...)

[nednguyen, 2016-07-19 17:14:57]

Description was changed from

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:android_s5_perf_cq;master.tryserver.chromium.perf:mac_retina_perf_cq
==========

to

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq
==========

[nednguyen, 2016-07-19 17:15:02]

The CQ bit was checked by nednguyen@google.com

[nednguyen, 2016-07-19 17:15:30]

On 2016/07/19 17:10:56, commit-bot: I haz the power wrote:
> Try jobs failed on following builders:
>   android_s5_perf_cq on master.tryserver.chromium.perf (JOB_FAILED,
>
http://build.chromium.org/p/tryserver.chromium.perf/builders/android_s5_perf_...)

I removed master.tryserver.chromium.perf:android_s5_perf_cq to land this. If
it's failing on bot, we can disable failing story in subsequent CL.

[commit-bot: I haz the power, 2016-07-19 17:16:08]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[nednguyen, 2016-07-19 17:25:16]

The CQ bit was unchecked by nednguyen@google.com

[nednguyen, 2016-07-19 17:25:16]

The CQ bit was checked by nednguyen@google.com

[commit-bot: I haz the power, 2016-07-19 17:26:06]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-07-19 18:00:21]

Description was changed from

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq
==========

to

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq
==========

[commit-bot: I haz the power, 2016-07-19 18:00:22]

Committed patchset #4 (id:60001)

[commit-bot: I haz the power, 2016-07-19 18:00:36]

CQ bit was unchecked.

[commit-bot: I haz the power, 2016-07-19 18:03:20]

Description was changed from

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq
==========

to

==========
[system-health] Run all SH stories in memory benchmarks

This patch modifies SH memory benchmarks (system_health.memory_desktop
and system_health.memory_mobile) to run all SH stories:

  - load:*   (already running)
  - browse:* (NEW)

As a result, all SH stories will also run in the SH smoke test on the
Chromium CQ
(benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.*).

*** NOTE TO SHERIFF ***
This patch is very likely to cause failures in the System Health
benchmarks (perf waterfall) and smoke tests (regular CQ). Please contact
me before reverting.

BUG=589726
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq

Committed: https://crrev.com/77952f99e4ae203b6b57005ce9e3476895426b96
Cr-Commit-Position: refs/heads/master@{#406309}
==========

[commit-bot: I haz the power, 2016-07-19 18:03:22]

Patchset 4 (id:??) landed as
https://crrev.com/77952f99e4ae203b6b57005ce9e3476895426b96
Cr-Commit-Position: refs/heads/master@{#406309}