third_party/WebKit/LayoutTests/TestExpectations - Issue 1644763002: Add virtual layout test for GPU accelerated decoding.

Side by Side Diff: third_party/WebKit/LayoutTests/TestExpectations

Issue 1644763002: Add virtual layout test for GPU accelerated decoding. (Closed) Base URL: https://chromium.googlesource.com/chromium/src.git@master

Patch Set: Use virtual mediasource-play in SmokeTests. Created 4 years, 5 months ago

Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.

Jump to:

View unified diff | Download patch

« content/browser/gpu/gpu_process_host.cc ('K') | « third_party/WebKit/LayoutTests/SmokeTests ('k') | third_party/WebKit/LayoutTests/VirtualTestSuites » ('j') | no next file with comments »

OLD	NEW
1 # ====== Oilpan-only failures from here ======	1 # ====== Oilpan-only failures from here ======

2 # Most of these actually cause the tests to report success, rather than	2 # Most of these actually cause the tests to report success, rather than

3 # failure. Expected outputs will be adjusted for the better once Oilpan	3 # failure. Expected outputs will be adjusted for the better once Oilpan

4 # has been well and truly enabled always.	4 # has been well and truly enabled always.

5	5

6 crbug.com/420008 inspector/tracing/worker-js-frames.html [ Pass Timeout Failure ]	6 crbug.com/420008 inspector/tracing/worker-js-frames.html [ Pass Timeout Failure ]

7 crbug.com/420008 virtual/threaded/inspector/tracing/worker-js-frames.html [ Pass Timeout Failure ]	7 crbug.com/420008 virtual/threaded/inspector/tracing/worker-js-frames.html [ Pass Timeout Failure ]

8 crbug.com/596940 inspector-protocol/runtime/runtime-execution-contexts-events.ht ml [ Pass Timeout ]	8 crbug.com/596940 inspector-protocol/runtime/runtime-execution-contexts-events.ht ml [ Pass Timeout ]

9 crbug.com/597572 [ Debug ] http/tests/inspector/resource-tree/resource-tree-relo ad.html [ Pass Failure ]	9 crbug.com/597572 [ Debug ] http/tests/inspector/resource-tree/resource-tree-relo ad.html [ Pass Failure ]

10	10

(...skipping 717 matching lines...) Expand 10 before \| Expand all \| Expand 10 after Loading...
728 crbug.com/624285 inspector/console/console-stack-overflow.html [ NeedsManualReba seline ]	728 crbug.com/624285 inspector/console/console-stack-overflow.html [ NeedsManualReba seline ]

729	729

730 crbug.com/474987 [ Win Mac ] css3/flexbox/auto-margins.html [ Failure ]	730 crbug.com/474987 [ Win Mac ] css3/flexbox/auto-margins.html [ Failure ]

731	731

732 crbug.com/267206 [ Mac ] fast/scrolling/scrollbar-tickmarks-hittest.html [ Timeo ut ]	732 crbug.com/267206 [ Mac ] fast/scrolling/scrollbar-tickmarks-hittest.html [ Timeo ut ]

733 crbug.com/267206 [ Mac ] virtual/scroll_customization/fast/scrolling/scrollbar-t ickmarks-hittest.html [ Timeout ]	733 crbug.com/267206 [ Mac ] virtual/scroll_customization/fast/scrolling/scrollbar-t ickmarks-hittest.html [ Timeout ]

734	734

735 crbug.com/524160 [ Debug ] http/tests/media/media-source/mediasource-appendbuffe r-quota-exceeded.html [ Timeout ]	735 crbug.com/524160 [ Debug ] http/tests/media/media-source/mediasource-appendbuffe r-quota-exceeded.html [ Timeout ]

736 crbug.com/524160 [ Debug ] http/tests/media/media-source/mediasource-appendstrea m-quota-exceeded.html [ Timeout ]	736 crbug.com/524160 [ Debug ] http/tests/media/media-source/mediasource-appendstrea m-quota-exceeded.html [ Timeout ]

737	737

738 crbug.com/568827 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-audio-bitrate.html [ Failure ]	738 # These tests use gpu accelerated decoding and need special flags to disable Mes a GL. See media-gpu-accelerated VirtualTestSuites.
	wolenetz 2016/07/19 20:47:10 Why crash? Can we make these tests have platform-s Why crash? Can we make these tests have platform-specific and flag-specific failure expectations without crashing? desktop: should pass android with flags in virtual suite: should pass android without flags (no virtual suite): should fail (but not crash) Is this possible? Dirk Pranke 2016/07/21 20:45:05 If they're always going to fail, why run them at a Show quoted text On 2016/07/19 20:47:10, wolenetz wrote: > Why crash? Can we make these tests have platform-specific and flag-specific > failure expectations without crashing? > desktop: should pass > android with flags in virtual suite: should pass > android without flags (no virtual suite): should fail (but not crash) > > Is this possible? If they're always going to fail, why run them at all? chcunningham 2016/07/21 21:04:36 They will always fail, but they aren't actually be Show quoted text On 2016/07/21 20:45:05, Dirk Pranke wrote: > On 2016/07/19 20:47:10, wolenetz wrote: > > Why crash? Can we make these tests have platform-specific and flag-specific > > failure expectations without crashing? > > desktop: should pass > > android with flags in virtual suite: should pass > > android without flags (no virtual suite): should fail (but not crash) > > > > Is this possible? > > If they're always going to fail, why run them at all? They will always fail, but they aren't actually being run anywhere - this serves to document what is expected if someone attempts to manually run. The android bots will instead run a subset of these via the virtual test suite - and those are all expected to pass. Dirk Pranke 2016/07/21 21:07:31 Ah, then move these entries to NeverFixTests. Show quoted text On 2016/07/21 21:04:36, chcunningham wrote: > On 2016/07/21 20:45:05, Dirk Pranke wrote: > > On 2016/07/19 20:47:10, wolenetz wrote: > > > Why crash? Can we make these tests have platform-specific and flag-specific > > > failure expectations without crashing? > > > desktop: should pass > > > android with flags in virtual suite: should pass > > > android without flags (no virtual suite): should fail (but not crash) > > > > > > Is this possible? > > > > If they're always going to fail, why run them at all? > > They will always fail, but they aren't actually being run anywhere - this serves > to document what is expected if someone attempts to manually run. The android > bots will instead run a subset of these via the virtual test suite - and those > are all expected to pass. Ah, then move these entries to NeverFixTests.
739 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-framesize.html [ Failure ]	739 crbug.com/568827 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-audio-bitrate.html [ Failure Crash ]

740 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-video-bitrate.html [ Failure ]	740 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-framesize.html [ Failure Crash ]

741 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-bitrate.html [ Failure ]	741 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-av-video-bitrate.html [ Failure Crash ]

742 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-framerate.html [ Failure ]	742 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-bitrate.html [ Failure Crash ]

743 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-framesize.html [ Failure ]	743 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-framerate.html [ Failure Crash ]

	744 crbug.com/555703 [ Android ] http/tests/media/media-source/mediasource-config-ch ange-mp4-v-framesize.html [ Failure Crash ]

744	745

745 crbug.com/517449 [ Android ] css3/images/optimize-contrast-image.html [ Failure ]	746 crbug.com/517449 [ Android ] css3/images/optimize-contrast-image.html [ Failure ]

746	747

747 crbug.com/309675 compositing/gestures/gesture-tapHighlight-simple-longPress.html [ Failure ]	748 crbug.com/309675 compositing/gestures/gesture-tapHighlight-simple-longPress.html [ Failure ]

748 crbug.com/245556 compositing/transitions/transform-on-large-layer.html [ Failure ]	749 crbug.com/245556 compositing/transitions/transform-on-large-layer.html [ Failure ]

749	750

750 crbug.com/253763 fast/text-autosizing/first-line-scale-factor.html [ Failure ]	751 crbug.com/253763 fast/text-autosizing/first-line-scale-factor.html [ Failure ]

751	752

752 # Started failing after r162705.	753 # Started failing after r162705.

753 crbug.com/324370 compositing/video/video-reflection.html [ Failure ]	754 crbug.com/324370 compositing/video/video-reflection.html [ Failure ]

(...skipping 626 matching lines...) Expand 10 before \| Expand all \| Expand 10 after Loading...
1380 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-munsell-ado be-to-srgb.html [ NeedsManualRebaseline ]	1381 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-munsell-ado be-to-srgb.html [ NeedsManualRebaseline ]

1381 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-mask-image- svg.html [ NeedsManualRebaseline ]	1382 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-mask-image- svg.html [ NeedsManualRebaseline ]

1382 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-group.html [ NeedsManualRebaseline ]	1383 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-group.html [ NeedsManualRebaseline ]

1383 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-image-canva s.html [ NeedsManualRebaseline ]	1384 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-image-canva s.html [ NeedsManualRebaseline ]

1384 crbug.com/627844 virtual/gpu-rasterization/fast/images/jpeg-with-color-profile.h tml [ NeedsManualRebaseline ]	1385 crbug.com/627844 virtual/gpu-rasterization/fast/images/jpeg-with-color-profile.h tml [ NeedsManualRebaseline ]

1385 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-svg.html [ NeedsManualRebaseline ]	1386 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-svg.html [ NeedsManualRebaseline ]

1386 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-background- image-cover.html [ NeedsManualRebaseline ]	1387 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-background- image-cover.html [ NeedsManualRebaseline ]

1387 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-object.html [ NeedsManualRebaseline ]	1388 crbug.com/627844 virtual/gpu-rasterization/fast/images/color-profile-object.html [ NeedsManualRebaseline ]

1388 crbug.com/627844 virtual/gpu-rasterization/fast/images/ycbcr-with-cmyk-color-pro file.html [ NeedsManualRebaseline ]	1389 crbug.com/627844 virtual/gpu-rasterization/fast/images/ycbcr-with-cmyk-color-pro file.html [ NeedsManualRebaseline ]

1389 crbug.com/627844 virtual/gpu/fast/canvas/canvas-createImageBitmap-colorClamping. html [ Pass Failure ]	1390 crbug.com/627844 virtual/gpu/fast/canvas/canvas-createImageBitmap-colorClamping. html [ Pass Failure ]

OLD	NEW