WebRTC: Remove webrtc_perf_tests from trybots and Debug commit bots.

WebRTC: Remove webrtc_perf_tests from trybots and Debug commit bots.

The webrtc_perf_tests test has grown to become a major bottleneck for
our CQ trybots since it's execution time has slowly increased over time.
It currently consumes 30-50% of the total build time for the trybots that
run tests on Android devices. It's even worse on Mac, Windows and Linux:
around 70% of the cycle time is consumed.

Given that failures only caught by this test is rare, it makes sense to
remove it from all bots that don't produce perf data (i.e. Release commit
bots).

I also added perf tracking for the not-yet-deployed Android devices that
currently runs in client.webrtc.fyi.

This is one step on the way to move all perf tests into a separate waterfall.

BUG=586238
Committed: https://chromium.googlesource.com/chromium/tools/build/+/4334fd38d9dc0898b5d8e5f33b6130779bcc071e

[kjellander_chromium, 2016-06-01 19:05:13]

kjellander@chromium.org changed reviewers:
+ phoglund@chromium.org

[kjellander_chromium, 2016-06-01 19:05:14]

This should largely speed up our slowest trybots. I feel stupid not thinking
about this earlier.

[kjellander_chromium, 2016-06-01 19:05:23]

The CQ bit was checked by kjellander@chromium.org to run a CQ dry run

[commit-bot: I haz the power, 2016-06-01 19:05:28]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2031673003/1
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/2031673003/1

[commit-bot: I haz the power, 2016-06-01 19:07:01]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-06-01 19:07:01]

Dry run: Try jobs failed on following builders:
  Build Presubmit on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Build%20Presubmit/build...)
  Build Try Recipe Test Trusty64 on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Build%20Try%20Recipe%20...)
  Build Try Recipe Test Win64 on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Build%20Try%20Recipe%20...)

[kjellander_chromium, 2016-06-01 19:53:37]

The CQ bit was checked by kjellander@chromium.org to run a CQ dry run

[commit-bot: I haz the power, 2016-06-01 19:53:41]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2031673003/20001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/2031673003/20001

[commit-bot: I haz the power, 2016-06-01 20:00:11]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-06-01 20:00:12]

Dry run: This issue passed the CQ dry run.

[phoglund_chromium, 2016-06-02 07:55:02]

lgtm

https://codereview.chromium.org/2031673003/diff/20001/scripts/slave/recipe_mo...
File scripts/slave/recipe_modules/webrtc/steps.py (right):

https://codereview.chromium.org/2031673003/diff/20001/scripts/slave/recipe_mo...
scripts/slave/recipe_modules/webrtc/steps.py:160: 'Perf tests should only be run
with Release builds.')
Nice!

[kjellander_chromium, 2016-06-02 08:06:19]

The CQ bit was checked by kjellander@chromium.org

[commit-bot: I haz the power, 2016-06-02 08:08:40]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2031673003/20001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/2031673003/20001

[commit-bot: I haz the power, 2016-06-02 08:12:17]

Description was changed from

==========
WebRTC: Remove webrtc_perf_tests from trybots and Debug commit bots.

The webrtc_perf_tests test has grown to become a major bottleneck for
our CQ trybots since it's execution time has slowly increased over time.
It currently consumes 30-50% of the total build time for the trybots that
run tests on Android devices. It's even worse on Mac, Windows and Linux:
around 70% of the cycle time is consumed.

Given that failures only caught by this test is rare, it makes sense to
remove it from all bots that don't produce perf data (i.e. Release commit
bots).

I also added perf tracking for the not-yet-deployed Android devices that
currently runs in client.webrtc.fyi.

This is one step on the way to move all perf tests into a separate waterfall.

BUG=586238
==========

to

==========
WebRTC: Remove webrtc_perf_tests from trybots and Debug commit bots.

The webrtc_perf_tests test has grown to become a major bottleneck for
our CQ trybots since it's execution time has slowly increased over time.
It currently consumes 30-50% of the total build time for the trybots that
run tests on Android devices. It's even worse on Mac, Windows and Linux:
around 70% of the cycle time is consumed.

Given that failures only caught by this test is rare, it makes sense to
remove it from all bots that don't produce perf data (i.e. Release commit
bots).

I also added perf tracking for the not-yet-deployed Android devices that
currently runs in client.webrtc.fyi.

This is one step on the way to move all perf tests into a separate waterfall.

BUG=586238

Committed:
https://chromium.googlesource.com/chromium/tools/build/+/4334fd38d9dc0898b5d8...
==========

[commit-bot: I haz the power, 2016-06-02 08:12:18]

Committed patchset #2 (id:20001) as
https://chromium.googlesource.com/chromium/tools/build/+/4334fd38d9dc0898b5d8...