Cap the maximum number of flaky tests that we record from a step

Cap the maximum number of flaky tests that we record from a step

TBR=tandrii@chromium.org, phajdan.jr@chromium.org, ojan@chromium.org
BUG=614705
Committed: https://chromium.googlesource.com/infra/infra/+/76806e4d57ac6cebbb0c67900d8ac73870f569e8

[Sergiy Byelozyorov, 2016-05-25 17:17:37]

Description was changed from

==========
Cap the maximum number of flaky tests that we record from a step

R=nodir@chromium.org
BUG=614705
==========

to

==========
Cap the maximum number of flaky tests that we record from a step

TBR=tandrii@chromium.org, phajdan.jr@chromium.org, ojan@chromium.org
BUG=614705
==========

[Sergiy Byelozyorov, 2016-05-25 17:17:37]

sergiyb@chromium.org changed reviewers:
+ ojan@chromium.org, phajdan.jr@chromium.org, tandrii@chromium.org
- nodir@chromium.org

[Sergiy Byelozyorov, 2016-05-25 17:17:44]

The CQ bit was checked by sergiyb@chromium.org

[commit-bot: I haz the power, 2016-05-25 17:17:46]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2007133005/1
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/2007133005/1

[commit-bot: I haz the power, 2016-05-25 17:21:36]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-05-25 17:21:37]

Try jobs failed on following builders:
  Infra Linux Trusty 64 Tester on tryserver.infra (JOB_FAILED,
https://build.chromium.org/p/tryserver.infra/builders/Infra%20Linux%20Trusty%...)

[Sergiy Byelozyorov, 2016-05-25 17:31:19]

The CQ bit was checked by sergiyb@chromium.org

[commit-bot: I haz the power, 2016-05-25 17:31:29]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2007133005/20001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/2007133005/20001

[commit-bot: I haz the power, 2016-05-25 17:35:07]

Description was changed from

==========
Cap the maximum number of flaky tests that we record from a step

TBR=tandrii@chromium.org, phajdan.jr@chromium.org, ojan@chromium.org
BUG=614705
==========

to

==========
Cap the maximum number of flaky tests that we record from a step

TBR=tandrii@chromium.org, phajdan.jr@chromium.org, ojan@chromium.org
BUG=614705

Committed:
https://chromium.googlesource.com/infra/infra/+/76806e4d57ac6cebbb0c67900d8ac...
==========

[commit-bot: I haz the power, 2016-05-25 17:35:08]

Committed patchset #2 (id:20001) as
https://chromium.googlesource.com/infra/infra/+/76806e4d57ac6cebbb0c67900d8ac...

[ojan, 2016-05-25 17:43:29]

Please do more descriptive change descriptions in the future. This actually
considers the whole step to have failed if too many tests fail. I think that's
the right behavior, it's just not clear from the description that this patch
does that.

Also, in an ideal world, we'd use the same cap as the one used by the recipes in
deciding whether to retry a step without the patch.