Setting a maximum number of test runs per revision.

Setting a maximum number of test runs per revision.

The chosen value is 20 runs per revision. The reasoning is that 20 is a
round number that should produce no less than 18 values (one per run, in
a test that is at most 10% flaky) which has in the past seemed
sufficient to decide that the values are unlikely to converge per MWU.

Also, adding test coverage and fixing a small bug highlighted by this
change. (See bisector.py one line change)

R=dtu@chromium.org
BUG=659906
Committed: https://chromium.googlesource.com/chromium/tools/build/+/d8aa54bdb96167b4fd89ad1c5627fecadd18b21c

[dtu, 2016-10-31 20:26:19]

lgtm

[RobertoCN, 2016-10-31 20:27:41]

The CQ bit was checked by robertocn@chromium.org

[commit-bot: I haz the power, 2016-10-31 20:27:50]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-10-31 20:39:56]

Description was changed from

==========
Setting a maximum number of test runs per revision.

The chosen value is 20 runs per revision. The reasoning is that 20 is a
round number that should produce no less than 18 values (one per run, in
a test that is at most 10% flaky) which has in the past seemed
sufficient to decide that the values are unlikely to converge per MWU.

Also, adding test coverage and fixing a small bug highlighted by this
change. (See bisector.py one line change)

R=dtu@chromium.org
BUG=659906
==========

to

==========
Setting a maximum number of test runs per revision.

The chosen value is 20 runs per revision. The reasoning is that 20 is a
round number that should produce no less than 18 values (one per run, in
a test that is at most 10% flaky) which has in the past seemed
sufficient to decide that the values are unlikely to converge per MWU.

Also, adding test coverage and fixing a small bug highlighted by this
change. (See bisector.py one line change)

R=dtu@chromium.org
BUG=659906

Committed:
https://chromium.googlesource.com/chromium/tools/build/+/d8aa54bdb96167b4fd89...
==========

[commit-bot: I haz the power, 2016-10-31 20:39:57]

Committed patchset #1 (id:1) as
https://chromium.googlesource.com/chromium/tools/build/+/d8aa54bdb96167b4fd89...