[Telemetry] Migrate browser_test_runner to use typ as the test runner

[Telemetry] Migrate browser_test_runner to use typ as the test runner 

This is a reland of https://codereview.chromium.org/2590623002/. The
previous work was reverted because it makes setUpClass & tearDownClass
between every single test, causes the webgl_conformance suite to time 
out.

To fix that, this introduces SetUpProcess & TearDownProcess class 
methods to SeriallyExecutedBrowserTestCase which are guaranteed
to be called once before & after the test suite is run.

Patch 1 is the original work, patch 2 & beyond includes extra logic for 
SetUpProcess & TearDownProcess

BUG=chromium:636153
Review-Url: https://codereview.chromium.org/2671483002
Committed: https://chromium.googlesource.com/external/github.com/catapult-project/catapult/+/c6c6d50501b4c2890c4ac60757717c2b942e5358

[nednguyen, 2017-02-01 15:51:09]

Description was changed from

==========
[Telemetry] Migrate browser_test_runner to use typ as the test runner

BUG=chromium:636153
==========

to

==========
[Telemetry] Migrate browser_test_runner to use typ as the test runner 

This is a reland of https://codereview.chromium.org/2590623002/. The
previous work was reverted because it makes setUpClass & tearDownClass
between every single test, causes the webgl_conformance suite to time 
out.

To fix that, this introduces SetUpProcess & TearDownProcess class 
methods to SeriallyExecutedBrowserTestCase which are guaranteed
to be called once before & after the test suite is run.

Patch 1 is the original work, patch 2 & beyond includes extra logic for 
SetUpProcess & TearDownProcess

BUG=chromium:636153
==========

[nednguyen, 2017-02-01 15:51:09]

nednguyen@google.com changed reviewers:
+ dpranke@chromium.org, kbr@chromium.org

[nednguyen, 2017-02-01 15:51:20]

Patchset #2 (id:20001) has been deleted

[nednguyen, 2017-02-01 15:51:25]

The CQ bit was checked by nednguyen@google.com to run a CQ dry run

[commit-bot: I haz the power, 2017-02-01 15:51:27]

Dry run: CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2017-02-01 16:12:38]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2017-02-01 16:12:43]

Dry run: This issue passed the CQ dry run.

[nednguyen, 2017-02-04 00:13:23]

On 2017/02/01 15:51:15, nednguyen wrote:

Ping

[Ken Russell (switch to Gerrit), 2017-02-04 22:14:14]

Sorry, I was at conferences most of this week.

LGTM to try switching over again.

If you think there's a risk of breaking the bots (and consequently Catapult
rolls) again then I'd suggest:

1) Turning off the Catapult auto-roller
2) Landing and immediately reverting this in Catapult
3) Send a Chromium try job through which updates Catapult's DEPS to the version
where this was landed, and makes any test modifications necessary

https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
File telemetry/telemetry/testing/browser_test_runner_unittest.py (right):

https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
telemetry/telemetry/testing/browser_test_runner_unittest.py:23: def
_ExtracTestResults(self, test_result):
typo: _ExtractTestResults

[nednguyen, 2017-02-06 19:15:49]

On 2017/02/04 22:14:14, Ken Russell wrote:
> Sorry, I was at conferences most of this week.
> 
> LGTM to try switching over again.
> 
> If you think there's a risk of breaking the bots (and consequently Catapult
> rolls) again then I'd suggest:
> 
> 1) Turning off the Catapult auto-roller
> 2) Landing and immediately reverting this in Catapult
> 3) Send a Chromium try job through which updates Catapult's DEPS to the
version
> where this was landed, and makes any test modifications necessary

Cool idea!

> 
>
https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
> File telemetry/telemetry/testing/browser_test_runner_unittest.py (right):
> 
>
https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
> telemetry/telemetry/testing/browser_test_runner_unittest.py:23: def
> _ExtracTestResults(self, test_result):
> typo: _ExtractTestResults

[nednguyen, 2017-02-06 19:19:22]

The CQ bit was checked by nednguyen@google.com

[nednguyen, 2017-02-06 19:19:22]

The patchset sent to the CQ was uploaded after l-g-t-m from kbr@chromium.org
Link to the patchset: https://codereview.chromium.org/2671483002/#ps60001
(title: "Address Ken's comment")

[commit-bot: I haz the power, 2017-02-06 19:19:30]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[nednguyen, 2017-02-06 19:19:49]

https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
File telemetry/telemetry/testing/browser_test_runner_unittest.py (right):

https://codereview.chromium.org/2671483002/diff/40001/telemetry/telemetry/tes...
telemetry/telemetry/testing/browser_test_runner_unittest.py:23: def
_ExtracTestResults(self, test_result):
On 2017/02/04 22:14:14, Ken Russell wrote:
> typo: _ExtractTestResults

Done.

[commit-bot: I haz the power, 2017-02-06 19:41:11]

CQ is committing da patch.

Bot data: {"patchset_id": 60001, "attempt_start_ts": 1486408762004660,
"parent_rev": "7b509122f4da72233a507fbc5b3b3fd9909db8b9", "commit_rev":
"c6c6d50501b4c2890c4ac60757717c2b942e5358"}

[commit-bot: I haz the power, 2017-02-06 19:41:15]

Description was changed from

==========
[Telemetry] Migrate browser_test_runner to use typ as the test runner 

This is a reland of https://codereview.chromium.org/2590623002/. The
previous work was reverted because it makes setUpClass & tearDownClass
between every single test, causes the webgl_conformance suite to time 
out.

To fix that, this introduces SetUpProcess & TearDownProcess class 
methods to SeriallyExecutedBrowserTestCase which are guaranteed
to be called once before & after the test suite is run.

Patch 1 is the original work, patch 2 & beyond includes extra logic for 
SetUpProcess & TearDownProcess

BUG=chromium:636153
==========

to

==========
[Telemetry] Migrate browser_test_runner to use typ as the test runner 

This is a reland of https://codereview.chromium.org/2590623002/. The
previous work was reverted because it makes setUpClass & tearDownClass
between every single test, causes the webgl_conformance suite to time 
out.

To fix that, this introduces SetUpProcess & TearDownProcess class 
methods to SeriallyExecutedBrowserTestCase which are guaranteed
to be called once before & after the test suite is run.

Patch 1 is the original work, patch 2 & beyond includes extra logic for 
SetUpProcess & TearDownProcess

BUG=chromium:636153

Review-Url: https://codereview.chromium.org/2671483002
Committed:
https://chromium.googlesource.com/external/github.com/catapult-project/catapu...
==========

[commit-bot: I haz the power, 2017-02-06 19:41:16]

Committed patchset #3 (id:60001) as
https://chromium.googlesource.com/external/github.com/catapult-project/catapu...

[nednguyen, 2017-02-06 19:42:29]

A revert of this CL (patchset #3 id:60001) has been created in
https://codereview.chromium.org/2672323003/ by nednguyen@google.com.

The reason for reverting is: Revert so we can try out this change in CHromium
first..