Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(148)

Side by Side Diff: webkit/tools/layout_tests/test_expectations.txt

Issue 315003: Revert 29678 - Cleaning up media layout tests expectations.... (Closed) Base URL: svn://chrome-svn/chrome/trunk/src/
Patch Set: Created 11 years, 2 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // This file consists of lines with specifications of what 1 // This file consists of lines with specifications of what
2 // to expect from layout test cases. The test cases can be directories 2 // to expect from layout test cases. The test cases can be directories
3 // in which case the expectations apply to all test cases in that 3 // in which case the expectations apply to all test cases in that
4 // directory and any subdirectory. The format of the file is along the 4 // directory and any subdirectory. The format of the file is along the
5 // lines of: 5 // lines of:
6 // 6 //
7 // LayoutTests/fast/js/fixme.js = FAIL 7 // LayoutTests/fast/js/fixme.js = FAIL
8 // LayoutTests/fast/js/flaky.js = FAIL PASS 8 // LayoutTests/fast/js/flaky.js = FAIL PASS
9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS 9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS
10 // 10 //
(...skipping 752 matching lines...) Expand 10 before | Expand all | Expand 10 after
763 // These tests are disabled until <audio> and <video> tags are supported. 763 // These tests are disabled until <audio> and <video> tags are supported.
764 // Disable <video> and <audio> tests for mac and linux until there is 764 // Disable <video> and <audio> tests for mac and linux until there is
765 // proper support. 765 // proper support.
766 BUG13907 : LayoutTests/fast/layers/video-layer.html = FAIL 766 BUG13907 : LayoutTests/fast/layers/video-layer.html = FAIL
767 BUG4363 LINUX MAC SKIP : LayoutTests/fast/media = PASS FAIL 767 BUG4363 LINUX MAC SKIP : LayoutTests/fast/media = PASS FAIL
768 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-poster-from -remote.html = FAIL TIMEOUT 768 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-poster-from -remote.html = FAIL TIMEOUT
769 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-src-from-re mote.html = PASS FAIL 769 BUG4363 LINUX MAC SKIP : LayoutTests/http/tests/security/local-video-src-from-re mote.html = PASS FAIL
770 BUG13907 SKIP : LayoutTests/accessibility/media-element.html = TIMEOUT 770 BUG13907 SKIP : LayoutTests/accessibility/media-element.html = TIMEOUT
771 BUG13907 SKIP : LayoutTests/http/tests/security/local-video-source-from-remote.h tml = FAIL 771 BUG13907 SKIP : LayoutTests/http/tests/security/local-video-source-from-remote.h tml = FAIL
772 BUG13907 SKIP : LayoutTests/http/tests/media = FAIL 772 BUG13907 SKIP : LayoutTests/http/tests/media = FAIL
773 773 BUG13907 SKIP : LayoutTests/media/audio-constructor-autobuffer.html = FAIL
774 // Linux debug media tests have spurious timeouts and it's annoying. We have no idea why. 774 BUG13907 SKIP : LayoutTests/media/audio-constructor-src.html = TIMEOUT
775 BUG13907 BUG25094 SKIP LINUX DEBUG : LayoutTests/media = TIMEOUT 775 BUG13907 : LayoutTests/media/audio-delete-while-slider-thumb-clicked.html = PASS FAIL CRASH
776 776 BUG13907 LINUX WIN RELEASE : LayoutTests/media/audio-delete-while-step-button-cl icked.html = FAIL
777 // We don't autoload when src is assigned... we rely on load(). 777 BUG13907 LINUX WIN DEBUG SLOW : LayoutTests/media/audio-delete-while-step-button -clicked.html = FAIL
778 BUG13907 MAC : LayoutTests/media/audio-delete-while-step-button-clicked.html = F AIL
779 BUG13907 SKIP : LayoutTests/media/audio-play-event.html = TIMEOUT
780 BUG13907 SKIP : LayoutTests/media/controls-drag-timebar.html = TIMEOUT
781 BUG13907 RELEASE : LayoutTests/media/controls-styling.html = FAIL
782 BUG13907 DEBUG SLOW : LayoutTests/media/controls-styling.html = FAIL
783 BUG13907 SKIP : LayoutTests/media/event-attributes.html = TIMEOUT
784 BUG13907 MAC : LayoutTests/media/video-canvas-source.html = FAIL
785 BUG13907 WIN LINUX RELEASE : LayoutTests/media/video-canvas-source.html = FAIL
786 BUG13907 WIN LINUX DEBUG SLOW : LayoutTests/media/video-canvas-source.html = FAI L
787 BUG13907 : LayoutTests/media/video-controls-transformed.html = FAIL
778 BUG9798 BUG13907 SKIP: LayoutTests/media/video-currentTime-set.html = FAIL TIMEO UT 788 BUG9798 BUG13907 SKIP: LayoutTests/media/video-currentTime-set.html = FAIL TIMEO UT
779
780 // The first load event fires occasionally, ending the test early.
781 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS 789 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS
782 790 BUG9798 BUG13907 WIN LINUX DEBUG : LayoutTests/media/video-load-networkState.htm l = TIMEOUT PASS
783 // We have issues with our implementation of played time ranges. 791 BUG13907 SLOW: LayoutTests/media/video-loop.html = FAIL
784 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-collapse.html = FAIL
785 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-ranges-1.html = FAIL
786 BUG13907 BUG25380 SLOW : LayoutTests/media/video-played-reset.html = FAIL
787
788 // Seeking to 500s causes us to seek to 0s and continue playing (expected), but WebKit checks too fast.
789 // The test uses setTimeout() and is flaky.
790 BUG13907 SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL
791
792 // We sometimes emit an error from the same source element twice.
793 BUG9798 BUG13907 SLOW : LayoutTests/media/video-source-error.html = FAIL PASS
794
795 // The test uses setTimeout() and is flaky.
796 BUG9798 BUG13907 : LayoutTests/media/video-src-invalid-remove.html = FAIL PASS
797
798 // Failing because we sometimes emit additional timeupdate events.
799 // Test may need to be rewritten or only log the first timeupdate event.
800 BUG13907 : LayoutTests/media/audio-delete-while-slider-thumb-clicked.html = PASS FAIL
801
802 // Failing because we sometimes emit additional timeupdate events.
803 // Test might be WONTFIX because we don't export a step button in the first plac e.
804 BUG13907 BUG25375 SKIP : LayoutTests/media/audio-delete-while-step-button-clicke d.html = FAIL
805
806 // Will be fixed when https://bugs.webkit.org/show_bug.cgi?id=30435 lands.
807 BUG13907 SKIP : LayoutTests/media/audio-constructor-src.html = TIMEOUT
808 BUG13907 SKIP : LayoutTests/media/audio-play-event.html = TIMEOUT
809 BUG13907 SKIP : LayoutTests/media/video-no-audio.html = TIMEOUT 792 BUG13907 SKIP : LayoutTests/media/video-no-audio.html = TIMEOUT
793 BUG13907 SLOW : LayoutTests/media/video-played-collapse.html = FAIL
794 BUG13907 SLOW : LayoutTests/media/video-played-ranges-1.html = FAIL
795 BUG13907 RELEASE : LayoutTests/media/video-played-reset.html = FAIL
796 BUG13907 DEBUG SLOW : LayoutTests/media/video-played-reset.html = FAIL
797 BUG13907 : LayoutTests/media/video-play-pause-events.html = TIMEOUT PASS
798 BUG13907 RELEASE : LayoutTests/media/video-seek-past-end-playing.html = FAIL
799 BUG13907 DEBUG SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL
810 BUG13907 SKIP : LayoutTests/media/video-source-add-src.html = TIMEOUT 800 BUG13907 SKIP : LayoutTests/media/video-source-add-src.html = TIMEOUT
811 801 BUG9798 BUG13907 WIN LINUX DEBUG SLOW : LayoutTests/media/video-source-error.htm l = FAIL PASS
812 // Needs to use findMediaFile(). 802 BUG9798 BUG13907 WIN LINUX DEBUG : LayoutTests/media/video-src-invalid-remove.ht ml = FAIL PASS
813 BUG13907 SKIP : LayoutTests/media/controls-drag-timebar.html = TIMEOUT
814
815 // Seeks to the end of file, which results in ogg packets with no timestamps.
816 BUG13907 SKIP : LayoutTests/media/event-attributes.html = TIMEOUT
817 803
818 // The media time display isn't appearing. 804 // The media time display isn't appearing.
819 BUG13907 SKIP : LayoutTests/media/video-zoom-controls.html = FAIL 805 BUG13907 SKIP : LayoutTests/media/video-zoom-controls.html = FAIL
820 806
821 // The video appears as a white box on Windows. 807 // The video appears as a white box on Windows. Fail whole test for now.
822 BUG13907 SKIP WIN : LayoutTests/media/video-zoom.html = FAIL 808 BUG13907 SKIP WIN : LayoutTests/media/video-zoom.html = FAIL
823 809
824 // Video has a green background, probably due to Mac repaint debugging code. 810 // Video appears with a green background. Probably due to repaint debugging cod e.
825 BUG13907 BUG25376 MAC DEBUG : LayoutTests/media/video-empty-source.html = FAIL 811 BUG13907 MAC DEBUG : LayoutTests/media/video-empty-source.html = FAIL
826 812
827 // The media time display is getting styled when it shouldn't be. 813 // Every linux debug media test have spurious timeouts and it's annoying.
828 BUG13907 : LayoutTests/media/controls-styling.html = FAIL 814 // We have no idea why.
815 BUG13907 BUG25094 SKIP LINUX DEBUG : LayoutTests/media = TIMEOUT
829 816
830 // We currently throw a DOM security exception during the getImageData() call. 817 // These have super subtle pixel differences.
831 BUG13907 SKIP : LayoutTests/media/video-canvas-source.html = FAIL 818 BUG9798 BUG13907 : LayoutTests/media/audio-no-installed-engines.html = PASS FAIL
819 BUG9798 BUG13907 : LayoutTests/media/video-aspect-ratio.html = PASS FAIL
820 BUG9798 BUG13907 : LayoutTests/media/video-transformed.html = PASS FAIL
821 BUG9798 BUG13907 MAC : LayoutTests/media/video-layer-crash.html = PASS FAIL
832 822
833 // These tests are flaky with subtle pixel differences.
834 BUG9798 BUG13907 : LayoutTests/media/audio-no-installed-engines.html = IMAGE
835 BUG9798 BUG13907 : LayoutTests/media/video-aspect-ratio.html = IMAGE
836 BUG9798 BUG13907 : LayoutTests/media/video-transformed.html = IMAGE
837 BUG9798 BUG13907 MAC : LayoutTests/media/video-layer-crash.html = IMAGE
838 823
839 // These tests are failing because they use position-dependent mouse clicks. 824 // These tests are WONTFIX because they uess codecs chromium doesn't support.
840 BUG13907 BUG25375 : LayoutTests/media/video-controls-transformed.html = FAIL
841
842 // These tests are WONTFIX because they use codecs Chromium doesn't support.
843 BUG16779 WONTFIX SKIP : LayoutTests/media/video-can-play-type.html = FAIL TIMEOU T 825 BUG16779 WONTFIX SKIP : LayoutTests/media/video-can-play-type.html = FAIL TIMEOU T
844 BUG16779 WONTFIX SKIP : LayoutTests/media/video-document-types.html = FAIL TIMEO UT 826 BUG16779 WONTFIX SKIP : LayoutTests/media/video-document-types.html = FAIL TIMEO UT
845 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-mpeg-supported.html = FAIL TIMEO UT 827 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-mpeg-supported.html = FAIL TIMEO UT
846 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-data-url.html = FAIL TIMEOUT 828 BUG16779 WONTFIX SKIP : LayoutTests/media/audio-data-url.html = FAIL TIMEOUT
847 BUG16779 WONTFIX SKIP : LayoutTests/media/video-size-intrinsic-scale.html = FAIL TIMEOUT 829 BUG16779 WONTFIX SKIP : LayoutTests/media/video-size-intrinsic-scale.html = FAIL TIMEOUT
848 830
849
850 // Function arguments object is copied for each access. 831 // Function arguments object is copied for each access.
851 BUG24194 : LayoutTests/fast/js/kde/function_arguments.html = FAIL 832 BUG24194 : LayoutTests/fast/js/kde/function_arguments.html = FAIL
852 833
853 // It looks like the upstream test is incorrectly using font-family: Times 834 // It looks like the upstream test is incorrectly using font-family: Times
854 // instead of font-family: times new roman. This broke when we recently moved 835 // instead of font-family: times new roman. This broke when we recently moved
855 // more of our font default settings to 'times new roman' from 'Times'. This 836 // more of our font default settings to 'times new roman' from 'Times'. This
856 // should be fixed upstream. https://bugs.webkit.org/show_bug.cgi?id=16348 837 // should be fixed upstream. https://bugs.webkit.org/show_bug.cgi?id=16348
857 BUG10277 LINUX : LayoutTests/fast/css/font-face-default-font.html = FAIL 838 BUG10277 LINUX : LayoutTests/fast/css/font-face-default-font.html = FAIL
858 839
859 // We don't support dynamic fonts on Linux. 840 // We don't support dynamic fonts on Linux.
(...skipping 2326 matching lines...) Expand 10 before | Expand all | Expand 10 after
3186 // WebKit Roll 49830:49844 3167 // WebKit Roll 49830:49844
3187 BUG_YUTAK WIN DEBUG : LayoutTests/fast/frames/calculate-fixed.html = CRASH 3168 BUG_YUTAK WIN DEBUG : LayoutTests/fast/frames/calculate-fixed.html = CRASH
3188 3169
3189 // Not sure when the flakiness started. 3170 // Not sure when the flakiness started.
3190 BUG25378 WIN LINUX : LayoutTests/fast/forms/search-hidden-cancel-button.html = C RASH PASS 3171 BUG25378 WIN LINUX : LayoutTests/fast/forms/search-hidden-cancel-button.html = C RASH PASS
3191 3172
3192 // Caused by ukai at revision 29626 (WebSockets) 3173 // Caused by ukai at revision 29626 (WebSockets)
3193 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-gc.html = CRASH PA SS 3174 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-gc.html = CRASH PA SS
3194 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-get.xhtml = CRASH PASS 3175 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-get.xhtml = CRASH PASS
3195 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-html-response-enco ding.html = CRASH PASS 3176 BUG25399 WIN : LayoutTests/fast/xmlhttprequest/xmlhttprequest-html-response-enco ding.html = CRASH PASS
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698