Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(1)

Side by Side Diff: webkit/tools/layout_tests/test_expectations.txt

Issue 295040: Cleaning up media layout tests expectations. (Closed)
Patch Set: Created 11 years, 2 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // This file consists of lines with specifications of what 1 // This file consists of lines with specifications of what
2 // to expect from layout test cases. The test cases can be directories 2 // to expect from layout test cases. The test cases can be directories
3 // in which case the expectations apply to all test cases in that 3 // in which case the expectations apply to all test cases in that
4 // directory and any subdirectory. The format of the file is along the 4 // directory and any subdirectory. The format of the file is along the
5 // lines of: 5 // lines of:
6 // 6 //
7 // LayoutTests/fast/js/fixme.js = FAIL 7 // LayoutTests/fast/js/fixme.js = FAIL
8 // LayoutTests/fast/js/flaky.js = FAIL PASS 8 // LayoutTests/fast/js/flaky.js = FAIL PASS
9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS 9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS
10 // 10 //
(...skipping 752 matching lines...) Expand 10 before | Expand all | Expand 10 after
763 // These tests are disabled until <audio> and <video> tags are supported. 763 // These tests are disabled until <audio> and <video> tags are supported.
764 // Disable <video> and <audio> tests for mac and linux until there is 764 // Disable <video> and <audio> tests for mac and linux until there is
765 // proper support. 765 // proper support.
766 BUG13907 : LayoutTests/fast/layers/video-layer.html = FAIL 766 BUG13907 : LayoutTests/fast/layers/video-layer.html = FAIL
767 BUG4363 LINUX MAC SKIP : LayoutTests/fast/media = PASS FAIL 767 BUG4363 LINUX MAC SKIP : LayoutTests/fast/media = PASS FAIL
768 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-poster-from -remote.html = FAIL TIMEOUT 768 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-poster-from -remote.html = FAIL TIMEOUT
769 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-src-from-re mote.html = PASS FAIL 769 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-src-from-re mote.html = PASS FAIL
770 BUG13907 SKIP : LayoutTests/accessibility/media-element.html = TIMEOUT 770 BUG13907 SKIP : LayoutTests/accessibility/media-element.html = TIMEOUT
771 BUG13907 SKIP : LayoutTests/http/tests/security/local-video-source-from-remote.h tml = FAIL 771 BUG13907 SKIP : LayoutTests/http/tests/security/local-video-source-from-remote.h tml = FAIL
772 BUG13907 SKIP : LayoutTests/http/tests/media = FAIL 772 BUG13907 SKIP : LayoutTests/http/tests/media = FAIL
773 BUG13907 SKIP : LayoutTests/media/audio-constructor-autobuffer.html = FAIL 773
774 // Linux debug media tests have spurious timeouts and it's annoying. We have no idea why.
775 BUG13907 BUG25094 SKIP LINUX DEBUG : LayoutTests/media = TIMEOUT
776
777 // We don't autoload when src is assigned... we rely on load().
778 BUG9798 BUG13907 SKIP: LayoutTests/media/video-currentTime-set.html = FAIL TIMEO UT
779
780 // The first load event fires occasionally, ending the test early.
781 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS
782
783 // We have issues with our implementation of played time ranges.
784 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-collapse.html = FAIL
785 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-ranges-1.html = FAIL
786 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-reset.html = FAIL
787
788 // Seeking to 500s causes us to seek to 0s and continue playing (expected), but WebKit checks too fast.
789 // The test uses setTimeout() and is flaky.
790 BUG13907 SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL
791
792 // We sometimes emit an error from the same source element twice.
793 BUG9798 BUG13907 SLOW : LayoutTests/media/video-source-error.html = FAIL PASS
794
795 // The test uses setTimeout() and is flaky.
796 BUG9798 BUG13907 : LayoutTests/media/video-src-invalid-remove.html = FAIL PASS
797
798 // Failing because we sometimes emit additional timeupdate events.
799 // Test may need to be rewritten or only log the first timeupdate event.
800 BUG13907 : LayoutTests/media/audio-delete-while-slider-thumb-clicked.html = PASS FAIL
801
802 // Failing because we sometimes emit additional timeupdate events.
803 // Test might be WONTFIX because we don't export a step button in the first plac e.
804 BUG13907 BUG25375 SKIP : LayoutTests/media/audio-delete-while-step-button-clicke d.html = FAIL
805
806 // Will be fixed when https://bugs.webkit.org/show_bug.cgi?id=30435 lands.
774 BUG13907 SKIP : LayoutTests/media/audio-constructor-src.html = TIMEOUT 807 BUG13907 SKIP : LayoutTests/media/audio-constructor-src.html = TIMEOUT
775 BUG13907 : LayoutTests/media/audio-delete-while-slider-thumb-clicked.html = PASS FAIL CRASH
776 BUG13907 LINUX WIN RELEASE : LayoutTests/media/audio-delete-while-step-button-cl icked.html = FAIL
777 BUG13907 LINUX WIN DEBUG SLOW : LayoutTests/media/audio-delete-while-step-button -clicked.html = FAIL
778 BUG13907 MAC : LayoutTests/media/audio-delete-while-step-button-clicked.html = F AIL
779 BUG13907 SKIP : LayoutTests/media/audio-play-event.html = TIMEOUT 808 BUG13907 SKIP : LayoutTests/media/audio-play-event.html = TIMEOUT
809 BUG13907 SKIP : LayoutTests/media/video-no-audio.html = TIMEOUT
810 BUG13907 SKIP : LayoutTests/media/video-source-add-src.html = TIMEOUT
811
812 // Needs to use findMediaFile().
780 BUG13907 SKIP : LayoutTests/media/controls-drag-timebar.html = TIMEOUT 813 BUG13907 SKIP : LayoutTests/media/controls-drag-timebar.html = TIMEOUT
781 BUG13907 RELEASE : LayoutTests/media/controls-styling.html = FAIL 814
782 BUG13907 DEBUG SLOW : LayoutTests/media/controls-styling.html = FAIL 815 // Seeks to the end of file, which results in ogg packets with no timestamps.
783 BUG13907 SKIP : LayoutTests/media/event-attributes.html = TIMEOUT 816 BUG13907 SKIP : LayoutTests/media/event-attributes.html = TIMEOUT
784 BUG13907 MAC : LayoutTests/media/video-canvas-source.html = FAIL
785 BUG13907 WIN LINUX RELEASE : LayoutTests/media/video-canvas-source.html = FAIL
786 BUG13907 WIN LINUX DEBUG SLOW : LayoutTests/media/video-canvas-source.html = FAI L
787 BUG13907 : LayoutTests/media/video-controls-transformed.html = FAIL
788 BUG9798 BUG13907 SKIP: LayoutTests/media/video-currentTime-set.html = FAIL TIMEO UT
789 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS
790 BUG9798 BUG13907 WIN LINUX DEBUG : LayoutTests/media/video-load-networkState.htm l = TIMEOUT PASS
791 BUG13907 SLOW: LayoutTests/media/video-loop.html = FAIL
792 BUG13907 SKIP : LayoutTests/media/video-no-audio.html = TIMEOUT
793 BUG13907 SLOW : LayoutTests/media/video-played-collapse.html = FAIL
794 BUG13907 SLOW : LayoutTests/media/video-played-ranges-1.html = FAIL
795 BUG13907 RELEASE : LayoutTests/media/video-played-reset.html = FAIL
796 BUG13907 DEBUG SLOW : LayoutTests/media/video-played-reset.html = FAIL
797 BUG13907 : LayoutTests/media/video-play-pause-events.html = TIMEOUT PASS
798 BUG13907 RELEASE : LayoutTests/media/video-seek-past-end-playing.html = FAIL
799 BUG13907 DEBUG SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL
800 BUG13907 SKIP : LayoutTests/media/video-source-add-src.html = TIMEOUT
801 BUG9798 BUG13907 WIN LINUX DEBUG SLOW : LayoutTests/media/video-source-error.htm l = FAIL PASS
802 BUG9798 BUG13907 WIN LINUX DEBUG : LayoutTests/media/video-src-invalid-remove.ht ml = FAIL PASS
803 817
804 // The media time display isn't appearing. 818 // The media time display isn't appearing.
805 BUG13907 SKIP : LayoutTests/media/video-zoom-controls.html = FAIL 819 BUG13907 SKIP : LayoutTests/media/video-zoom-controls.html = FAIL
806 820
807 // The video appears as a white box on Windows. Fail whole test for now. 821 // The video appears as a white box on Windows.
808 BUG13907 SKIP WIN : LayoutTests/media/video-zoom.html = FAIL 822 BUG13907 SKIP WIN : LayoutTests/media/video-zoom.html = FAIL
809 823
810 // Video appears with a green background. Probably due to repaint debugging cod e. 824 // Video has a green background, probably due to Mac repaint debugging code.
811 BUG13907 MAC DEBUG : LayoutTests/media/video-empty-source.html = FAIL 825 BUG13907 BUG25376 MAC DEBUG : LayoutTests/media/video-empty-source.html = FAIL
812 826
813 // Every linux debug media test have spurious timeouts and it's annoying. 827 // The media time display is getting styled when it shouldn't be.
814 // We have no idea why. 828 BUG13907 : LayoutTests/media/controls-styling.html = FAIL
815 BUG13907 BUG25094 SKIP LINUX DEBUG : LayoutTests/media = TIMEOUT
816 829
817 // These have super subtle pixel differences. 830 // We currently throw a DOM security exception during the getImageData() call.
818 BUG9798 BUG13907 : LayoutTests/media/audio-no-installed-engines.html = PASS FAIL 831 BUG13907 SKIP : LayoutTests/media/video-canvas-source.html = FAIL
819 BUG9798 BUG13907 : LayoutTests/media/video-aspect-ratio.html = PASS FAIL
820 BUG9798 BUG13907 : LayoutTests/media/video-transformed.html = PASS FAIL
821 BUG9798 BUG13907 MAC : LayoutTests/media/video-layer-crash.html = PASS FAIL
822 832
833 // These tests are flaky with subtle pixel differences.
834 BUG9798 BUG13907 : LayoutTests/media/audio-no-installed-engines.html = IMAGE
835 BUG9798 BUG13907 : LayoutTests/media/video-aspect-ratio.html = IMAGE
836 BUG9798 BUG13907 : LayoutTests/media/video-transformed.html = IMAGE
837 BUG9798 BUG13907 MAC : LayoutTests/media/video-layer-crash.html = IMAGE
823 838
824 // These tests are WONTFIX because they uess codecs chromium doesn't support. 839 // These tests are failing because they use position-dependent mouse clicks.
840 BUG13907 BUG25375 : LayoutTests/media/video-controls-transformed.html = FAIL
841
842 // These tests are WONTFIX because they use codecs Chromium doesn't support.
825 BUG16779 WONTFIX SKIP : LayoutTests/media/video-can-play-type.html = FAIL TIMEOU T 843 BUG16779 WONTFIX SKIP : LayoutTests/media/video-can-play-type.html = FAIL TIMEOU T
826 BUG16779 WONTFIX SKIP : LayoutTests/media/video-document-types.html = FAIL TIMEO UT 844 BUG16779 WONTFIX SKIP : LayoutTests/media/video-document-types.html = FAIL TIMEO UT
827 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-mpeg-supported.html = FAIL TIMEO UT 845 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-mpeg-supported.html = FAIL TIMEO UT
828 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-data-url.html = FAIL TIMEOUT 846 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-data-url.html = FAIL TIMEOUT
829 BUG16779 WONTFIX SKIP : LayoutTests/media/video-size-intrinsic-scale.html = FAIL TIMEOUT 847 BUG16779 WONTFIX SKIP : LayoutTests/media/video-size-intrinsic-scale.html = FAIL TIMEOUT
830 848
849
831 // Function arguments object is copied for each access. 850 // Function arguments object is copied for each access.
832 BUG24194 : LayoutTests/fast/js/kde/function_arguments.html = FAIL 851 BUG24194 : LayoutTests/fast/js/kde/function_arguments.html = FAIL
833 852
834 // It looks like the upstream test is incorrectly using font-family: Times 853 // It looks like the upstream test is incorrectly using font-family: Times
835 // instead of font-family: times new roman. This broke when we recently moved 854 // instead of font-family: times new roman. This broke when we recently moved
836 // more of our font default settings to 'times new roman' from 'Times'. This 855 // more of our font default settings to 'times new roman' from 'Times'. This
837 // should be fixed upstream. https://bugs.webkit.org/show_bug.cgi?id=16348 856 // should be fixed upstream. https://bugs.webkit.org/show_bug.cgi?id=16348
838 BUG10277 LINUX : LayoutTests/fast/css/font-face-default-font.html = FAIL 857 BUG10277 LINUX : LayoutTests/fast/css/font-face-default-font.html = FAIL
839 858
840 // We don't support dynamic fonts on Linux. 859 // We don't support dynamic fonts on Linux.
(...skipping 2327 matching lines...) Expand 10 before | Expand all | Expand 10 after
3168 3187
3169 // Test expectation for MAC is located above. 3188 // Test expectation for MAC is located above.
3170 // Please remove CRASH from that line when the fix is in. 3189 // Please remove CRASH from that line when the fix is in.
3171 BUG_YUTAK WIN LINUX : LayoutTests/fast/frames/invalid.html = CRASH PASS 3190 BUG_YUTAK WIN LINUX : LayoutTests/fast/frames/invalid.html = CRASH PASS
3172 3191
3173 // WebKit Roll 49830:49844 3192 // WebKit Roll 49830:49844
3174 BUG_YUTAK WIN DEBUG : LayoutTests/fast/frames/calculate-fixed.html = CRASH 3193 BUG_YUTAK WIN DEBUG : LayoutTests/fast/frames/calculate-fixed.html = CRASH
3175 3194
3176 // Not sure when the flakiness started. 3195 // Not sure when the flakiness started.
3177 BUG25378 WIN LINUX : LayoutTests/fast/forms/search-hidden-cancel-button.html = C RASH PASS 3196 BUG25378 WIN LINUX : LayoutTests/fast/forms/search-hidden-cancel-button.html = C RASH PASS
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698