Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(230)

Issue 2439153002: Script for exporting WPT (Closed)

Created:
4 years, 1 month ago by jeffcarp
Modified:
4 years, 1 month ago
Reviewers:
qyearsley, foolip
CC:
blink-reviews, blink-reviews-w3ctests_chromium.org, chromium-reviews, Dirk Pranke
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

This CL adds a script, sync-w3c-tests, that will eventually be a script that syncs our local WPT with the upstream GitHub repo in one atomic operation. This CL adds the export side of that script. BUG=657117 Committed: https://crrev.com/826ed2a741422fa8007dce9bd006da6652cad69e Cr-Commit-Position: refs/heads/master@{#430425}

Patch Set 1 #

Patch Set 2 : Add logic for going back in WPT commits to get last export #

Patch Set 3 : Add two unit tests for sync script #

Patch Set 4 : Add more cases to check for in local/remote WPT branches #

Total comments: 16

Patch Set 5 : Refactor into classes TestExporter and LocalWPT #

Patch Set 6 : Refactor and add create GH PR method #

Patch Set 7 : Remove hard-coded WPT stop point now that an export commit is in WPT #

Patch Set 8 : Add more unit tests #

Patch Set 9 : Linting #

Total comments: 1

Patch Set 10 : Fold TestExporter into sync, improve messaging #

Patch Set 11 : Clean up finding Cr-Commit-Pos in WPT with one neat trick #

Total comments: 62

Patch Set 12 : Address most of CL feedback #

Total comments: 11

Patch Set 13 : Address feedback, move from printing to logging #

Patch Set 14 : Add configure_logging from test_importer #

Patch Set 15 : Filter out WPT import commits #

Total comments: 14

Patch Set 16 : Address CL feedback #

Patch Set 17 : . #

Patch Set 18 : Oops, add newlines to multi line strings #

Patch Set 19 : Fix spacing issues #

Unified diffs Side-by-side diffs Delta from patch set Stats (+421 lines, -6 lines) Patch
A + third_party/WebKit/Tools/Scripts/sync-wpt View 1 2 3 4 5 6 7 8 9 10 11 1 chunk +6 lines, -6 lines 0 comments Download
A third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 1 chunk +79 lines, -0 lines 0 comments Download
A third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +48 lines, -0 lines 0 comments Download
A third_party/WebKit/Tools/Scripts/webkitpy/w3c/local_wpt.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 1 chunk +96 lines, -0 lines 0 comments Download
A third_party/WebKit/Tools/Scripts/webkitpy/w3c/local_wpt_unittest.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 1 chunk +86 lines, -0 lines 0 comments Download
A third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync_wpt.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 1 chunk +106 lines, -0 lines 0 comments Download

Messages

Total messages: 45 (13 generated)
foolip
https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html File third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html (right): https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html#newcode17 third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html:17: // Test change for Chromium exporter If you need ...
4 years, 1 month ago (2016-10-25 19:31:41 UTC) #2
jeffcarp
https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html File third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html (right): https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html#newcode17 third_party/WebKit/LayoutTests/imported/wpt/html/semantics/forms/the-input-element/checkbox.html:17: // Test change for Chromium exporter On 2016/10/25 at ...
4 years, 1 month ago (2016-10-26 20:19:18 UTC) #3
jeffcarp
https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py (right): https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py#newcode109 third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py:109: # The diff for the entire history of WPT ...
4 years, 1 month ago (2016-10-26 22:06:12 UTC) #8
foolip
https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py (right): https://codereview.chromium.org/2439153002/diff/60001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py#newcode109 third_party/WebKit/Tools/Scripts/webkitpy/w3c/sync.py:109: # The diff for the entire history of WPT ...
4 years, 1 month ago (2016-10-26 22:34:36 UTC) #9
jeffcarp
I addressed (hopefully) all of the comments @foolip had, and also refactored things and added ...
4 years, 1 month ago (2016-10-31 18:44:49 UTC) #12
jeffcarp
https://codereview.chromium.org/2439153002/diff/150001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/test_exporter.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/test_exporter.py (right): https://codereview.chromium.org/2439153002/diff/150001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/test_exporter.py#newcode61 third_party/WebKit/Tools/Scripts/webkitpy/w3c/test_exporter.py:61: Notes on this file: I'm thinking of removing the ...
4 years, 1 month ago (2016-10-31 18:46:34 UTC) #13
foolip
Many comments, but this looks great, I'm excited! Don't worry about addressing everything, where you ...
4 years, 1 month ago (2016-11-01 22:07:45 UTC) #14
foolip
qyearsley@, can you also review this? Because of our timezones, I think it'd be good ...
4 years, 1 month ago (2016-11-01 22:08:47 UTC) #16
jeffcarp
https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html File third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html (left): https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html#oldcode17 third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html:17: On 2016/11/01 at 22:07:44, foolip wrote: > Good changes ...
4 years, 1 month ago (2016-11-01 22:24:42 UTC) #17
qyearsley
I'm still not really sure whether it will be nicer to have a separate importer ...
4 years, 1 month ago (2016-11-01 22:57:45 UTC) #18
jeffcarp
https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py (right): https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py#newcode10 third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py:10: class ChromiumWPT(object): On 2016/11/01 at 22:07:44, foolip wrote: > ...
4 years, 1 month ago (2016-11-01 23:21:18 UTC) #19
foolip
https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html File third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html (left): https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html#oldcode17 third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html:17: On 2016/11/01 22:24:42, jeffcarp wrote: > On 2016/11/01 at ...
4 years, 1 month ago (2016-11-02 13:15:33 UTC) #20
jeffcarp
https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py (right): https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py#newcode18 third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py:18: return '\n'.join([ On 2016/11/02 at 13:15:32, foolip wrote: > ...
4 years, 1 month ago (2016-11-03 22:33:00 UTC) #21
jeffcarp
On 2016/11/03 at 22:33:00, jeffcarp wrote: > https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py > File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py (right): > > https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py#newcode18 ...
4 years, 1 month ago (2016-11-03 23:28:35 UTC) #22
foolip
lgtm
4 years, 1 month ago (2016-11-03 23:36:03 UTC) #23
foolip
https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py (right): https://codereview.chromium.org/2439153002/diff/200001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py#newcode33 third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py:33: return """ On 2016/11/02 13:15:33, foolip wrote: > These ...
4 years, 1 month ago (2016-11-03 23:40:31 UTC) #24
jeffcarp
https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html File third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html (left): https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html#oldcode17 third_party/WebKit/LayoutTests/imported/wpt/html/semantics/scripting-1/the-template-element/template-element/node-document-changes.html:17: On 2016/11/02 at 13:15:32, foolip wrote: > On 2016/11/01 ...
4 years, 1 month ago (2016-11-03 23:54:07 UTC) #25
qyearsley
https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py (right): https://codereview.chromium.org/2439153002/diff/180001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py#newcode5 third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt_unittest.py:5: import unittest On 2016/11/03 at 23:54:07, jeffcarp wrote: > ...
4 years, 1 month ago (2016-11-04 17:40:32 UTC) #26
qyearsley
https://codereview.chromium.org/2439153002/diff/260001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py (right): https://codereview.chromium.org/2439153002/diff/260001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py#newcode5 third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py:5: CR_WPT_DIR = 'third_party/WebKit/LayoutTests/imported/wpt/' On 2016/11/04 at 17:40:32, qyearsley wrote: ...
4 years, 1 month ago (2016-11-04 17:42:04 UTC) #27
jeffcarp
On 2016/11/04 at 17:42:04, qyearsley wrote: > https://codereview.chromium.org/2439153002/diff/260001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py > File third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py (right): > > https://codereview.chromium.org/2439153002/diff/260001/third_party/WebKit/Tools/Scripts/webkitpy/w3c/chromium_wpt.py#newcode5 ...
4 years, 1 month ago (2016-11-04 22:25:20 UTC) #28
qyearsley
On 2016/11/04 at 22:25:20, jeffcarp wrote: > On 2016/11/04 at 17:42:04, qyearsley wrote: > > ...
4 years, 1 month ago (2016-11-04 23:03:12 UTC) #29
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2439153002/340001
4 years, 1 month ago (2016-11-04 23:08:43 UTC) #32
jeffcarp
On 2016/11/04 at 23:03:12, qyearsley wrote: > On 2016/11/04 at 22:25:20, jeffcarp wrote: > > ...
4 years, 1 month ago (2016-11-04 23:15:47 UTC) #33
commit-bot: I haz the power
Try jobs failed on following builders: win_chromium_rel_ng on master.tryserver.chromium.win (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_rel_ng/builds/326241)
4 years, 1 month ago (2016-11-05 01:54:09 UTC) #35
foolip
On 2016/11/04 23:15:47, jeffcarp wrote: > On 2016/11/04 at 23:03:12, qyearsley wrote: > > On ...
4 years, 1 month ago (2016-11-05 22:10:20 UTC) #36
blink-reviews
We'll pair this week and see what logic we can merge together. On Sat, Nov ...
4 years, 1 month ago (2016-11-07 21:29:19 UTC) #37
chromium-reviews
We'll pair this week and see what logic we can merge together. On Sat, Nov ...
4 years, 1 month ago (2016-11-07 21:29:19 UTC) #38
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2439153002/340001
4 years, 1 month ago (2016-11-07 22:30:44 UTC) #40
commit-bot: I haz the power
Committed patchset #19 (id:340001)
4 years, 1 month ago (2016-11-07 23:53:42 UTC) #41
commit-bot: I haz the power
Patchset 19 (id:??) landed as https://crrev.com/826ed2a741422fa8007dce9bd006da6652cad69e Cr-Commit-Position: refs/heads/master@{#430425}
4 years, 1 month ago (2016-11-07 23:58:08 UTC) #43
foolip
Just as an FYI, it looks like you edited the description and dropped the "Script ...
4 years, 1 month ago (2016-11-08 09:09:08 UTC) #44
jeffcarp
4 years, 1 month ago (2016-11-08 19:18:52 UTC) #45
Message was sent while issue was closed.
On 2016/11/08 at 09:09:08, foolip wrote:
> Just as an FYI, it looks like you edited the description and dropped the
"Script for exporting WPT" line. The resulting commit doesn't have the title
line at all. (A common accident, I've done it too.)

Oops thanks for pointing that out, I didn't realize the first line was used that
way.

Powered by Google App Engine
This is Rietveld 408576698