Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true

Committed: https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
Cr-Commit-Position: refs/heads/master@{#372033}

[Ken Russell (switch to Gerrit), 2016-01-28 06:25:13]

Description was changed from

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json, and also simplified.

BUG=542370
==========

to

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
==========

[Ken Russell (switch to Gerrit), 2016-01-28 06:29:42]

kbr@chromium.org changed reviewers:
+ dpranke@chromium.org

[Ken Russell (switch to Gerrit), 2016-01-28 06:29:42]

Corentin, thanks for pointing out the fact that the chromium.gpu.fyi test
description was unmaintainable. This autogeneration script caught a bug in the
file.

There are a couple of small changes compared to the current file, but they're
easily reviewed.

I'm going to CQ this TBR'd and NOTRY. The only thing it can affect is the
chromium.gpu.fyi waterfall.

[Ken Russell (switch to Gerrit), 2016-01-28 06:30:00]

Description was changed from

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
==========

to

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true
==========

[Ken Russell (switch to Gerrit), 2016-01-28 06:30:18]

The CQ bit was checked by kbr@chromium.org

[commit-bot: I haz the power, 2016-01-28 06:30:31]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1647833004/20001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1647833004/20001

[commit-bot: I haz the power, 2016-01-28 06:35:22]

Description was changed from

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true
==========

to

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true
==========

[commit-bot: I haz the power, 2016-01-28 06:35:23]

Committed patchset #2 (id:20001)

[commit-bot: I haz the power, 2016-01-28 06:36:16]

Description was changed from

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true
==========

to

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true

Committed: https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
Cr-Commit-Position: refs/heads/master@{#372033}
==========

[commit-bot: I haz the power, 2016-01-28 06:36:17]

Patchset 2 (id:??) landed as
https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
Cr-Commit-Position: refs/heads/master@{#372033}

[Corentin Wallez, 2016-01-28 17:59:26]

On 2016/01/28 06:36:17, commit-bot: I haz the power wrote:
> Patchset 2 (id:??) landed as
> https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
> Cr-Commit-Position: refs/heads/master@{#372033}

LGTM, this is so much better it is not even fair!

[Ken Russell (switch to Gerrit), 2016-01-28 18:16:46]

On 2016/01/28 17:59:26, cwallez1 wrote:
> On 2016/01/28 06:36:17, commit-bot: I haz the power wrote:
> > Patchset 2 (id:??) landed as
> > https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
> > Cr-Commit-Position: refs/heads/master@{#372033}
> 
> LGTM, this is so much better it is not even fair!

:)

[Dirk Pranke, 2016-01-28 23:49:15]

Description was changed from

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true

Committed: https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
Cr-Commit-Position: refs/heads/master@{#372033}
==========

to

==========
Add script for autogenerating testing/buildbot/chromium.gpu.fyi.json .

cwallez@ pointed out the file was unmaintainable. Generate it from a
script instead. Effort was expended to minimize the initial changes. The
only changes are:

1. webgl_conformance_tests and webgl2_conformance_tests are swapped.
2. The D3D9 and GL versions of gles2_conform_test on the Windows testers
   come first.
3. content_unittests was missed on several testers, and is now present.

This script will be generalized later to create the forthcoming
chromium.gpu.json.

BUG=542370
TBR=dpranke@chromium.org
NOTRY=true

Committed: https://crrev.com/65b5f0e3d9e3c819910930a067495265d2cd3b74
Cr-Commit-Position: refs/heads/master@{#372033}
==========

[Dirk Pranke, 2016-01-28 23:49:15]

dpranke@chromium.org changed reviewers:
+ phajdan.jr@chromium.org

[Dirk Pranke, 2016-01-28 23:53:24]

(adding phajdan.jr fyi ...)

lgtm as an incremental improvement.

that said, this is yet another script-containing-a-config-file layer piled on
top of the others :(. I'm really looking forward to having src-side recipes
working so we can simplify and collapse layers rather than having to create more
ad hoc solutions.

https://codereview.chromium.org/1647833004/diff/20001/content/test/gpu/genera...
File content/test/gpu/generate_buildbot_json.py (right):

https://codereview.chromium.org/1647833004/diff/20001/content/test/gpu/genera...
content/test/gpu/generate_buildbot_json.py:404: tests['AAAAA2 See
generate_buildbot_json.py to make changes'] = {}
these two lines are part of the reason I wish we had used .pyl instead :).