Add wrapper script for GPU integration tests, supporting sharding.

Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true

Committed: https://crrev.com/6133d7c8452acc247fc01594b00c774b5c81be31
Cr-Commit-Position: refs/heads/master@{#399808}

[Ken Russell (switch to Gerrit), 2016-06-14 00:38:59]

Description was changed from

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
==========

to

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
==========

[Ken Russell (switch to Gerrit), 2016-06-14 00:42:29]

kbr@chromium.org changed reviewers:
+ dpranke@chromium.org, nednguyen@google.com, vadimsh@chromium.org,
zmo@chromium.org

[Ken Russell (switch to Gerrit), 2016-06-14 00:42:29]

dpranke: please review chrome/test/BUILD.gn and testing/scripts/

vadimsh: please review chrome/telemetry_gpu_integration_test.isolate

nednguyen, zmo: please review content/test/gpu/

This depends on https://codereview.chromium.org/2065853002 landing in catapult
and being rolled in.

Once this lands I'll add the gn_isolate_map.pyl change and switch over the
webgl2_conformance_tests to this new harness.

https://codereview.chromium.org/2062993003/diff/1/content/test/gpu/run_gpu_in...
File content/test/gpu/run_gpu_integration_test.py (right):

https://codereview.chromium.org/2062993003/diff/1/content/test/gpu/run_gpu_in...
content/test/gpu/run_gpu_integration_test.py:35: parser =
argparse.ArgumentParser(description='Temporary argument parser')
This is more robust than scraping the arguments manually.

[Zhenyao Mo, 2016-06-14 01:37:04]

content/gest/gpu lgtm

[nednguyen, 2016-06-14 01:50:24]

content/gest/gpu lgtm

[Vadim Sh., 2016-06-14 18:06:13]

lgtm

[Dirk Pranke, 2016-06-14 20:22:25]

lgtm to land and make progress.

At some point we should sit down so I can understand what you're doing better
and how all of these wrappers are the same and differ from each other, but I
don't want that conversation to block this.

[Ken Russell (switch to Gerrit), 2016-06-14 21:21:57]

The CQ bit was checked by kbr@chromium.org

[Ken Russell (switch to Gerrit), 2016-06-14 21:21:58]

The patchset sent to the CQ was uploaded after l-g-t-m from
dpranke@chromium.org, vadimsh@chromium.org, zmo@chromium.org,
nednguyen@google.com
Link to the patchset: https://codereview.chromium.org/2062993003/#ps20001
(title: "Rebased.")

[commit-bot: I haz the power, 2016-06-14 21:22:37]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2062993003/20001

[commit-bot: I haz the power, 2016-06-14 23:24:34]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-06-14 23:24:35]

Try jobs failed on following builders:
  ios-device on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)
  ios-device-gn on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)

[Ken Russell (switch to Gerrit), 2016-06-14 23:32:14]

On 2016/06/14 23:24:35, commit-bot: I haz the power wrote:
> Try jobs failed on following builders:
>   ios-device on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)
>   ios-device-gn on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)

Unrelated failures: http://crbug.com/620130 .

I'll wait for the win_optional_gpu_tests_rel and mac_optional_gpu_tests_rel jobs
to finish before landing this.

[Ken Russell (switch to Gerrit), 2016-06-15 00:34:49]

On 2016/06/14 23:32:14, Ken Russell wrote:
> On 2016/06/14 23:24:35, commit-bot: I haz the power wrote:
> > Try jobs failed on following builders:
> >   ios-device on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)
> >   ios-device-gn on tryserver.chromium.mac (JOB_TIMED_OUT, no build URL)
> 
> Unrelated failures: http://crbug.com/620130 .
> 
> I'll wait for the win_optional_gpu_tests_rel and mac_optional_gpu_tests_rel
jobs
> to finish before landing this.

win_optional_gpu_tests_rel had a flaky failure which isn't handled well by the
current harness and which is handled better by the new harness, specifically
WebglConformance.conformance2_textures_image_bitmap_from_video_tex_2d_rgba8_rgba_unsigned_byte:
https://build.chromium.org/p/tryserver.chromium.win/builders/win_optional_gpu...

mac_optional_gpu_tests_rel was affected by the presence of a problematic patch
(not 100% sure how that made it through the CQ) which has been reverted and is
being resolved.

I'm bypassing the CQ for this change so a dependent change can be sent through
the tryservers.

[Ken Russell (switch to Gerrit), 2016-06-15 00:34:57]

Description was changed from

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
==========

to

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true
==========

[Ken Russell (switch to Gerrit), 2016-06-15 00:35:04]

The CQ bit was checked by kbr@chromium.org

[commit-bot: I haz the power, 2016-06-15 00:35:30]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/2062993003/20001

[commit-bot: I haz the power, 2016-06-15 00:50:22]

Description was changed from

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true
==========

to

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true
==========

[commit-bot: I haz the power, 2016-06-15 00:50:23]

Committed patchset #2 (id:20001)

[commit-bot: I haz the power, 2016-06-15 00:50:28]

CQ bit was unchecked

[commit-bot: I haz the power, 2016-06-15 00:51:53]

Description was changed from

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true
==========

to

==========
Add wrapper script for GPU integration tests, supporting sharding.

Add isolates for the new test harness. Once all of the GPU tests are
switched to the new harness, the old one, and its wrapper script, will
be deleted.

BUG=352807
CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel
NOTRY=true

Committed: https://crrev.com/6133d7c8452acc247fc01594b00c774b5c81be31
Cr-Commit-Position: refs/heads/master@{#399808}
==========

[commit-bot: I haz the power, 2016-06-15 00:51:55]

Patchset 2 (id:??) landed as
https://crrev.com/6133d7c8452acc247fc01594b00c774b5c81be31
Cr-Commit-Position: refs/heads/master@{#399808}