Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(72)

Issue 1259743005: Delete (nearly) all the flaky pass lines from TestExpectations. (Closed)

Created:
5 years, 4 months ago by ojan
Modified:
5 years, 4 months ago
Reviewers:
Peter Kasting, eae
CC:
blink-reviews, keishi
Base URL:
https://chromium.googlesource.com/chromium/blink.git@master
Target Ref:
refs/heads/master
Project:
blink
Visibility:
Public.

Description

Delete (nearly) all the flaky pass lines from TestExpectations. Now that we retry tests 3 times instead of once, it's unclear if any of these flaky lines apply and there's no automated way to figure it out. Delete the lines for now. The added lines are for tests that have stopped being flaky and become reliable failures. A followup patch will rebaseline them. This leaves in any lines that have Slow, NeedsRebaseline or NeedsManualRebaseline and any flakes that don't include a Pass. BUG=517148 Committed: https://src.chromium.org/viewvc/blink?view=rev&revision=200095

Patch Set 1 #

Patch Set 2 : fix lines and merge to ToT #

Patch Set 3 : get tests passing locally #

Patch Set 4 : Update with try run results #

Patch Set 5 : add bug numbers #

Total comments: 1

Patch Set 6 : merge to ToT #

Patch Set 7 : merge to ToT #

Total comments: 1

Patch Set 8 : add a couple more lines #

Patch Set 9 : add LinkStyle.html and merge to ToT #

Patch Set 10 : add smil-leak-element-instances.svg #

Patch Set 11 : add more flakes. merge to ToT #

Patch Set 12 : merge to ToT #

Patch Set 13 : add another flake #

Unified diffs Side-by-side diffs Delta from patch set Stats (+109 lines, -899 lines) Patch
M LayoutTests/TestExpectations View 1 2 3 4 5 6 7 8 9 10 11 12 26 chunks +109 lines, -899 lines 0 comments Download

Messages

Total messages: 57 (28 generated)
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/1 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/1
5 years, 4 months ago (2015-08-05 00:43:01 UTC) #2
commit-bot: I haz the power
Dry run: Try jobs failed on following builders: android_blink_compile_dbg on tryserver.blink (JOB_FAILED, http://build.chromium.org/p/tryserver.blink/builders/android_blink_compile_dbg/builds/45055)
5 years, 4 months ago (2015-08-05 00:46:26 UTC) #4
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/20001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/20001
5 years, 4 months ago (2015-08-05 00:52:30 UTC) #7
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/40001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/40001
5 years, 4 months ago (2015-08-05 01:25:33 UTC) #9
commit-bot: I haz the power
Dry run: Try jobs failed on following builders: mac_blink_rel on tryserver.blink (JOB_FAILED, http://build.chromium.org/p/tryserver.blink/builders/mac_blink_rel/builds/65073)
5 years, 4 months ago (2015-08-05 02:18:09 UTC) #11
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/60001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/60001
5 years, 4 months ago (2015-08-05 16:50:41 UTC) #13
commit-bot: I haz the power
Dry run: Try jobs failed on following builders: mac_blink_rel on tryserver.blink (JOB_FAILED, http://build.chromium.org/p/tryserver.blink/builders/mac_blink_rel/builds/65141)
5 years, 4 months ago (2015-08-05 18:15:59 UTC) #15
ojan
keishi/pkasting: FYI, there might be a little increased flakiness after this patch. We'll just need ...
5 years, 4 months ago (2015-08-05 18:34:36 UTC) #17
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/120001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/120001
5 years, 4 months ago (2015-08-05 18:35:09 UTC) #19
ojan
https://codereview.chromium.org/1259743005/diff/120001/LayoutTests/TestExpectations File LayoutTests/TestExpectations (right): https://codereview.chromium.org/1259743005/diff/120001/LayoutTests/TestExpectations#newcode185 LayoutTests/TestExpectations:185: crbug.com/490511 imported/web-platform-tests/html/semantics/scripting-1/the-template-element/template-element/template-content-node-document.html [ Failure Timeout ] This was wrong. ...
5 years, 4 months ago (2015-08-05 18:36:37 UTC) #20
eae
The CL also adds a bunch of new Failure lines (as mentioned in the CL ...
5 years, 4 months ago (2015-08-05 18:38:56 UTC) #21
ojan
On 2015/08/05 at 18:38:56, eae wrote: > The CL also adds a bunch of new ...
5 years, 4 months ago (2015-08-05 18:41:45 UTC) #22
ojan
On 2015/08/05 at 18:41:45, ojan wrote: > On 2015/08/05 at 18:38:56, eae wrote: > > ...
5 years, 4 months ago (2015-08-05 18:43:08 UTC) #23
eae
On 2015/08/05 18:43:08, ojan wrote: > On 2015/08/05 at 18:41:45, ojan wrote: > > On ...
5 years, 4 months ago (2015-08-05 18:44:43 UTC) #24
Peter Kasting
What about commenting out these lines instead of deleting them? Then when we get new ...
5 years, 4 months ago (2015-08-05 19:40:58 UTC) #26
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/140001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/140001
5 years, 4 months ago (2015-08-05 20:41:11 UTC) #29
ojan
On 2015/08/05 at 19:40:58, pkasting wrote: > What about commenting out these lines instead of ...
5 years, 4 months ago (2015-08-05 20:42:40 UTC) #30
Peter Kasting
On 2015/08/05 20:42:40, ojan wrote: > On 2015/08/05 at 19:40:58, pkasting wrote: > > What ...
5 years, 4 months ago (2015-08-05 20:46:11 UTC) #31
ojan
On 2015/08/05 at 20:46:11, pkasting wrote: > On 2015/08/05 20:42:40, ojan wrote: > > On ...
5 years, 4 months ago (2015-08-05 20:47:52 UTC) #32
commit-bot: I haz the power
Try jobs failed on following builders: linux_blink_rel on tryserver.blink (JOB_FAILED, http://build.chromium.org/p/tryserver.blink/builders/linux_blink_rel/builds/74078)
5 years, 4 months ago (2015-08-05 21:29:38 UTC) #34
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/160001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/160001
5 years, 4 months ago (2015-08-05 21:52:25 UTC) #37
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/180001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/180001
5 years, 4 months ago (2015-08-05 22:05:06 UTC) #40
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/200001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/200001
5 years, 4 months ago (2015-08-06 00:02:58 UTC) #43
commit-bot: I haz the power
Failed to apply patch for LayoutTests/TestExpectations: While running patch -p1 --forward --force --no-backup-if-mismatch; patching file ...
5 years, 4 months ago (2015-08-06 01:03:18 UTC) #45
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/220001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/220001
5 years, 4 months ago (2015-08-06 01:08:01 UTC) #49
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/240001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/240001
5 years, 4 months ago (2015-08-06 03:04:20 UTC) #52
commit-bot: I haz the power
Try jobs failed on following builders: win_blink_rel on tryserver.blink (JOB_FAILED, http://build.chromium.org/p/tryserver.blink/builders/win_blink_rel/builds/72753)
5 years, 4 months ago (2015-08-06 03:49:02 UTC) #54
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1259743005/240001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1259743005/240001
5 years, 4 months ago (2015-08-06 04:52:38 UTC) #56
commit-bot: I haz the power
5 years, 4 months ago (2015-08-06 04:55:35 UTC) #57
Message was sent while issue was closed.
Committed patchset #13 (id:240001) as
https://src.chromium.org/viewvc/blink?view=rev&revision=200095

Powered by Google App Engine
This is Rietveld 408576698