Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(74)

Side by Side Diff: webkit/tools/layout_tests/test_expectations.txt

Issue 340068: Some more test_expectations cleanup. Trying to document some flakiness from ... (Closed) Base URL: svn://chrome-svn/chrome/trunk/src/
Patch Set: Created 11 years, 1 month ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // This file consists of lines with specifications of what 1 // This file consists of lines with specifications of what
2 // to expect from layout test cases. The test cases can be directories 2 // to expect from layout test cases. The test cases can be directories
3 // in which case the expectations apply to all test cases in that 3 // in which case the expectations apply to all test cases in that
4 // directory and any subdirectory. The format of the file is along the 4 // directory and any subdirectory. The format of the file is along the
5 // lines of: 5 // lines of:
6 // 6 //
7 // LayoutTests/fast/js/fixme.js = FAIL 7 // LayoutTests/fast/js/fixme.js = FAIL
8 // LayoutTests/fast/js/flaky.js = FAIL PASS 8 // LayoutTests/fast/js/flaky.js = FAIL PASS
9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS 9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS
10 // 10 //
(...skipping 781 matching lines...) Expand 10 before | Expand all | Expand 10 after
792 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-collapse.html = PASS FAIL 792 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-collapse.html = PASS FAIL
793 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-ranges-1.html = PASS FAIL 793 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-ranges-1.html = PASS FAIL
794 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-reset.html = PASS FAIL 794 BUG9798 BUG13907 SLOW : LayoutTests/media/video-played-reset.html = PASS FAIL
795 795
796 // The first load event fires occasionally, ending the test early. 796 // The first load event fires occasionally, ending the test early.
797 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS 797 BUG9798 BUG13907 WIN RELEASE : LayoutTests/media/video-error-abort.html = FAIL P ASS
798 798
799 // We output an extra playing event and video durations are different. 799 // We output an extra playing event and video durations are different.
800 BUG13907 SKIP : LayoutTests/media/video-loop.html = FAIL 800 BUG13907 SKIP : LayoutTests/media/video-loop.html = FAIL
801 801
802 // This one times out occasionally.
803 BUG13907 WIN : LayoutTests/media/video-load-networkState.html = PASS TIMEOUT
804
802 // We occasionally fail to perform the third seek. 805 // We occasionally fail to perform the third seek.
803 BUG13907 MAC WIN : LayoutTests/media/video-seeking.html = PASS FAIL 806 BUG13907 MAC WIN : LayoutTests/media/video-seeking.html = PASS FAIL
804 BUG13907 LINUX RELEASE : LayoutTests/media/video-seeking.html = PASS FAIL 807 BUG13907 LINUX RELEASE : LayoutTests/media/video-seeking.html = PASS FAIL
805 BUG13907 LINUX DEBUG : LayoutTests/media/video-seeking.html = PASS FAIL TIMEOUT 808 BUG13907 LINUX DEBUG : LayoutTests/media/video-seeking.html = PASS FAIL TIMEOUT
806 809
807 // Seeking to 500s causes us to seek to 0s and continue playing (expected), but WebKit checks too fast. 810 // Seeking to 500s causes us to seek to 0s and continue playing (expected), but WebKit checks too fast.
808 // The test uses setTimeout() and is flaky. 811 // The test uses setTimeout() and is flaky.
809 BUG13907 SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL 812 BUG13907 SLOW : LayoutTests/media/video-seek-past-end-playing.html = FAIL
810 813
811 // We sometimes emit an error from the same source element twice. 814 // We sometimes emit an error from the same source element twice.
(...skipping 1799 matching lines...) Expand 10 before | Expand all | Expand 10 after
2611 BUG9798 LINUX MAC : LayoutTests/http/tests/navigation/reload-subframe-iframe.htm l = PASS TIMEOUT 2614 BUG9798 LINUX MAC : LayoutTests/http/tests/navigation/reload-subframe-iframe.htm l = PASS TIMEOUT
2612 BUG9798 WIN DEBUG : LayoutTests/fast/inline-block/contenteditable-baseline.html = CRASH PASS 2615 BUG9798 WIN DEBUG : LayoutTests/fast/inline-block/contenteditable-baseline.html = CRASH PASS
2613 BUG9798 WIN LINUX : LayoutTests/svg/custom/js-update-transform-addition.svg = CR ASH PASS 2616 BUG9798 WIN LINUX : LayoutTests/svg/custom/js-update-transform-addition.svg = CR ASH PASS
2614 BUG9798 MAC : LayoutTests/editing/selection/drag-in-iframe.html = FAIL PASS 2617 BUG9798 MAC : LayoutTests/editing/selection/drag-in-iframe.html = FAIL PASS
2615 BUG9798 WIN LINUX : LayoutTests/svg/custom/use-property-changes-through-svg-dom. svg = FAIL PASS 2618 BUG9798 WIN LINUX : LayoutTests/svg/custom/use-property-changes-through-svg-dom. svg = FAIL PASS
2616 BUG9798 LINUX : LayoutTests/svg/custom/js-update-transform-changes.svg = FAIL PA SS 2619 BUG9798 LINUX : LayoutTests/svg/custom/js-update-transform-changes.svg = FAIL PA SS
2617 // Occasionally times out. Not just slow. 2620 // Occasionally times out. Not just slow.
2618 BUG9798 MAC : LayoutTests/http/tests/misc/xmltokenizer-do-not-crash.pl = PASS TI MEOUT 2621 BUG9798 MAC : LayoutTests/http/tests/misc/xmltokenizer-do-not-crash.pl = PASS TI MEOUT
2619 // Occasionally times out. Not just slow. 2622 // Occasionally times out. Not just slow.
2620 BUG9798 WIN DEBUG : LayoutTests/http/tests/loading/redirect-methods.html = TIMEO UT PASS 2623 BUG9798 WIN DEBUG : LayoutTests/http/tests/loading/redirect-methods.html = TIMEO UT PASS
2624 BUG9798 MAC DEBUG : LayoutTests/plugins/geturl-replace-query.html = TEXT PASS
2621 2625
2622 // New tests or failures from WebKit merge 42324:42364. Re-baselined on 2626 // New tests or failures from WebKit merge 42324:42364. Re-baselined on
2623 // Windows. Probably just need the same on other platforms. 2627 // Windows. Probably just need the same on other platforms.
2624 BUG9962 LINUX : LayoutTests/fast/block/positioning/fixed-positioning-scrollbar-b ug.html = FAIL 2628 BUG9962 LINUX : LayoutTests/fast/block/positioning/fixed-positioning-scrollbar-b ug.html = FAIL
2625 BUG9962 MAC : LayoutTests/fast/js/function-apply-aliased.html = FAIL 2629 BUG9962 MAC : LayoutTests/fast/js/function-apply-aliased.html = FAIL
2626 2630
2627 // Regressions from WebKit merge 43264:42403, possibly due to r42375. 2631 // Regressions from WebKit merge 43264:42403, possibly due to r42375.
2628 BUG9992 WIN LINUX : LayoutTests/fast/text/shadow-no-blur.html = FAIL 2632 BUG9992 WIN LINUX : LayoutTests/fast/text/shadow-no-blur.html = FAIL
2629 2633
2630 // Regressions from WebKit merge 43264:42403, unknown cause(s) 2634 // Regressions from WebKit merge 43264:42403, unknown cause(s)
(...skipping 364 matching lines...) Expand 10 before | Expand all | Expand 10 after
2995 2999
2996 // WK roll 48388:48399 (brettw) 3000 // WK roll 48388:48399 (brettw)
2997 BUG21919 WIN : LayoutTests/http/tests/security/mixedContent/insecure-css-in-main -frame.html = FAIL PASS 3001 BUG21919 WIN : LayoutTests/http/tests/security/mixedContent/insecure-css-in-main -frame.html = FAIL PASS
2998 3002
2999 // Flaky. The width of containing RenderBlocks sometimes becomes larger 3003 // Flaky. The width of containing RenderBlocks sometimes becomes larger
3000 BUG21958 WIN LINUX DEBUG : LayoutTests/svg/hixie/error/012.xml = FAIL PASS 3004 BUG21958 WIN LINUX DEBUG : LayoutTests/svg/hixie/error/012.xml = FAIL PASS
3001 BUG21958 MAC : LayoutTests/svg/hixie/error/012.xml = FAIL PASS 3005 BUG21958 MAC : LayoutTests/svg/hixie/error/012.xml = FAIL PASS
3002 3006
3003 // WK roll 48399:48423 (brettw) 3007 // WK roll 48399:48423 (brettw)
3004 BUG22014 : LayoutTests/http/tests/loading/redirect-with-no-location-crash.html = FAIL 3008 BUG22014 : LayoutTests/http/tests/loading/redirect-with-no-location-crash.html = FAIL
3005 BUG22014 LINUX MAC : LayoutTests/transitions/hang-with-bad-transition-list.html = PASS FAIL 3009 BUG22014 : LayoutTests/transitions/hang-with-bad-transition-list.html = PASS FAI L
3006 3010
3007 // WebKit merge 48500:48585, newly implemented Object.defineProperty. 3011 // WebKit merge 48500:48585, newly implemented Object.defineProperty.
3008 BUG22526 : LayoutTests/fast/js/Object-create.html = FAIL 3012 BUG22526 : LayoutTests/fast/js/Object-create.html = FAIL
3009 BUG22526 : LayoutTests/fast/js/Object-defineProperties.html = FAIL 3013 BUG22526 : LayoutTests/fast/js/Object-defineProperties.html = FAIL
3010 BUG22526 : LayoutTests/fast/js/Object-defineProperty.html = FAIL 3014 BUG22526 : LayoutTests/fast/js/Object-defineProperty.html = FAIL
3011 BUG22526 : LayoutTests/http/tests/security/xss-DENIED-defineProperty.html = TIME OUT 3015 BUG22526 : LayoutTests/http/tests/security/xss-DENIED-defineProperty.html = TIME OUT
3012 3016
3013 // WebKit merge 48500:48585, due to newly added support for MathML. 3017 // WebKit merge 48500:48585, due to newly added support for MathML.
3014 BUG22554 SKIP : LayoutTests/mathml = FAIL 3018 BUG22554 SKIP : LayoutTests/mathml = FAIL
3015 3019
(...skipping 24 matching lines...) Expand all
3040 BUG24331 LINUX : LayoutTests/svg/text/text-tselect-02-f.svg = FAIL PASS 3044 BUG24331 LINUX : LayoutTests/svg/text/text-tselect-02-f.svg = FAIL PASS
3041 3045
3042 // WebKit update: 49190:49206 3046 // WebKit update: 49190:49206
3043 BUG_JPARENT WIN DEBUG : LayoutTests/fast/frames/calculate-percentage.html = CRAS H PASS 3047 BUG_JPARENT WIN DEBUG : LayoutTests/fast/frames/calculate-percentage.html = CRAS H PASS
3044 BUG_JPARENT LINUX DEBUG SLOW : LayoutTests/fast/frames/calculate-fixed.html = PA SS 3048 BUG_JPARENT LINUX DEBUG SLOW : LayoutTests/fast/frames/calculate-fixed.html = PA SS
3045 3049
3046 // Started failing for no apparent reason at r28124 3050 // Started failing for no apparent reason at r28124
3047 BUG23972 LINUX WIN : LayoutTests/fast/forms/form-element-geometry.html = CRASH P ASS 3051 BUG23972 LINUX WIN : LayoutTests/fast/forms/form-element-geometry.html = CRASH P ASS
3048 3052
3049 // Flaky timeouts first appearing at r27764 (webkit 48947) 3053 // Flaky timeouts first appearing at r27764 (webkit 48947)
3050 BUG9798 LINUX MAC : LayoutTests/http/tests/cookies/multiple-cookies.html = TIMEO UT PASS 3054 BUG9798 : LayoutTests/http/tests/cookies/multiple-cookies.html = TIMEOUT PASS
3051 3055
3052 // WebKit update: 49213:49221 3056 // WebKit update: 49213:49221
3053 BUG24063 : LayoutTests/fast/dom/Window/window-postmessage-clone.html = FAIL 3057 BUG24063 : LayoutTests/fast/dom/Window/window-postmessage-clone.html = FAIL
3054 3058
3055 // Got slow with V8 update to 1.3.15. Debug logging perhaps? 3059 // Got slow with V8 update to 1.3.15. Debug logging perhaps?
3056 BUG24182 DEBUG SLOW : LayoutTests/fast/forms/input-implicit-length-limit.html = PASS 3060 BUG24182 DEBUG SLOW : LayoutTests/fast/forms/input-implicit-length-limit.html = PASS
3057 BUG24182 DEBUG SLOW : LayoutTests/fast/forms/input-maxlength.html = PASS 3061 BUG24182 DEBUG SLOW : LayoutTests/fast/forms/input-maxlength.html = PASS
3058 3062
3059 // Failing after r28267 3063 // Failing after r28267
3060 BUG24116 SLOW : LayoutTests/http/tests/loading/gmail-assert-on-load.html = FAIL 3064 BUG24116 SLOW : LayoutTests/http/tests/loading/gmail-assert-on-load.html = FAIL
(...skipping 131 matching lines...) Expand 10 before | Expand all | Expand 10 after
3192 // WebKit roll 50248:50258 3196 // WebKit roll 50248:50258
3193 BUG26195 : LayoutTests/accessibility/aria-option-role.html = TEXT 3197 BUG26195 : LayoutTests/accessibility/aria-option-role.html = TEXT
3194 BUG26195 LINUX : LayoutTests/fast/forms/select-empty-option-height.html = PASS T IMEOUT 3198 BUG26195 LINUX : LayoutTests/fast/forms/select-empty-option-height.html = PASS T IMEOUT
3195 BUG26195 LINUX : LayoutTests/svg/custom/marker-default-width-height.svg = TEXT 3199 BUG26195 LINUX : LayoutTests/svg/custom/marker-default-width-height.svg = TEXT
3196 BUG26195 LINUX RELEASE : LayoutTests/fast/overflow/overflow_hidden.html = PASS C RASH 3200 BUG26195 LINUX RELEASE : LayoutTests/fast/overflow/overflow_hidden.html = PASS C RASH
3197 BUG26195 MAC : LayoutTests/css3/css3-modsel-33.html = TEXT 3201 BUG26195 MAC : LayoutTests/css3/css3-modsel-33.html = TEXT
3198 BUG26195 MAC : chrome/plugins/script-object-invoke.html = TEXT 3202 BUG26195 MAC : chrome/plugins/script-object-invoke.html = TEXT
3199 3203
3200 // randomly started to be flaky on r30451 (revision had only a check-in of text_ expectations.txt) 3204 // randomly started to be flaky on r30451 (revision had only a check-in of text_ expectations.txt)
3201 BUG26195 MAC DEBUG : LayoutTests/plugins/netscape-plugin-map-data-to-src.html = PASS TEXT 3205 BUG26195 MAC DEBUG : LayoutTests/plugins/netscape-plugin-map-data-to-src.html = PASS TEXT
3206 BUG26195 MAC DEBUG : LayoutTests/plugins/netscape-plugin-setwindow-size.html = P ASS TEXT
3202 BUG26195 MAC DEBUG : LayoutTests/http/tests/security/xssAuditor/script-tag-addsl ashes-single-quote.html = PASS TIMEOUT 3207 BUG26195 MAC DEBUG : LayoutTests/http/tests/security/xssAuditor/script-tag-addsl ashes-single-quote.html = PASS TIMEOUT
3203 3208
3204 // expected test failures (passed in roll to WebKit r50313) 3209 // expected test failures (passed in roll to WebKit r50313)
3205 BUG_HAMAJI : LayoutTests/fast/css/counters/invalidate-cached-counter-node.html = PASS FAIL 3210 BUG_HAMAJI : LayoutTests/fast/css/counters/invalidate-cached-counter-node.html = PASS FAIL
3206 3211
3207 // ==== WebKit roll 50258:50313 ==== 3212 // ==== WebKit roll 50258:50313 ====
3208 // --- Linux --- 3213 // --- Linux ---
3209 // Expected to fail since roll 50101:50158, but passed in roll to 50313 (47): 3214 // Expected to fail since roll 50101:50158, but passed in roll to 50313 (47):
3210 // Best guesses for culprit WebKit patches are 50108, 50115, and 50259. 3215 // Best guesses for culprit WebKit patches are 50108, 50115, and 50259.
3211 BUG26291 LINUX DEBUG : LayoutTests/editing/deleting/5026848-2.html = FAIL 3216 BUG26291 LINUX DEBUG : LayoutTests/editing/deleting/5026848-2.html = FAIL
(...skipping 44 matching lines...) Expand 10 before | Expand all | Expand 10 after
3256 BUG26291 MAC : LayoutTests/fast/text/drawBidiText.html = IMAGE 3261 BUG26291 MAC : LayoutTests/fast/text/drawBidiText.html = IMAGE
3257 BUG26291 MAC : LayoutTests/transforms/2d/hindi-rotated.html = IMAGE 3262 BUG26291 MAC : LayoutTests/transforms/2d/hindi-rotated.html = IMAGE
3258 3263
3259 // WebKit roll 50313:50324 3264 // WebKit roll 50313:50324
3260 BUG_ROLANDSTEINER MAC LINUX : LayoutTests/fast/block/float/float-in-float-hit-te sting.html = IMAGE 3265 BUG_ROLANDSTEINER MAC LINUX : LayoutTests/fast/block/float/float-in-float-hit-te sting.html = IMAGE
3261 BUG_ROLANDSTEINER LINUX : LayoutTests/fast/events/click-focus-anchor.html = TEXT 3266 BUG_ROLANDSTEINER LINUX : LayoutTests/fast/events/click-focus-anchor.html = TEXT
3262 BUG_ROLANDSTEINER MAC : LayoutTests/fast/events/click-focus-anchor.html = TEXT 3267 BUG_ROLANDSTEINER MAC : LayoutTests/fast/events/click-focus-anchor.html = TEXT
3263 BUG_ROLANDSTEINER MAC : LayoutTests/http/tests/plugins/interrupted-get-url.html = TEXT 3268 BUG_ROLANDSTEINER MAC : LayoutTests/http/tests/plugins/interrupted-get-url.html = TEXT
3264 BUG_ROLANDSTEINER WIN : LayoutTests/fast/events/click-focus-anchor.html = TEXT 3269 BUG_ROLANDSTEINER WIN : LayoutTests/fast/events/click-focus-anchor.html = TEXT
3265 BUG_ROLANDSTEINER WIN : LayoutTests/fast/block/float/float-in-float-hit-testing. html = IMAGE 3270 BUG_ROLANDSTEINER WIN : LayoutTests/fast/block/float/float-in-float-hit-testing. html = IMAGE
3266 BUG9798 WIN DEBUG : LayoutTests/dom/html/level2/html/HTMLAppletElement01.html = PASS TIMEOUT 3271 BUG9798 WIN : LayoutTests/dom/html/level2/html/HTMLAppletElement01.html = PASS T IMEOUT
3267 BUG24182 WIN RELEASE SLOW : LayoutTests/dom/html/level2/html/HTMLAppletElement01 .html = PASS 3272
3273 // Flaky since at least WebKit 50258.
3274 BUG9798 WIN DEBUG : LayoutTests/media/video-empty-source.html = IMAGE PASS
3275 BUG9798 WIN MAC RELEASE : LayoutTests/fast/dom/defaultView.html = TEXT PASS
3276 BUG9798 WIN RELEASE : LayoutTests/http/tests/navigation/no-referrer-reset.html = TIMEOUT PASS
3268 3277
3269 // Turned flaky at WebKit 50325:50358 3278 // Turned flaky at WebKit 50325:50358
3270 BUG_SENORBLANCO WIN DEBUG : LayoutTests/fast/css/last-of-type-pseudo-class.html = FAIL PASS 3279 BUG_SENORBLANCO WIN DEBUG : LayoutTests/fast/css/last-of-type-pseudo-class.html = FAIL PASS
3271 3280
3272 // WebKit 50358:50395 3281 // WebKit 50358:50395
3273 BUG_SENORBLANCO : LayoutTests/fast/text/international/thai-cursor-position.html = TEXT 3282 BUG_SENORBLANCO : LayoutTests/fast/text/international/thai-cursor-position.html = TEXT
3274 BUG_SENORBLANCO WIN : LayoutTests/transitions/multiple-background-size-transitio ns.html = TEXT 3283 BUG_SENORBLANCO WIN : LayoutTests/transitions/multiple-background-size-transitio ns.html = TEXT
3275 BUG_SENORBLANCO LINUX : LayoutTests/svg/custom/clip-path-units-changes.svg = IMA GE 3284 BUG_SENORBLANCO LINUX : LayoutTests/svg/custom/clip-path-units-changes.svg = IMA GE
3276 3285
3277 // WebKit 50395:50407 3286 // WebKit 50395:50407
(...skipping 68 matching lines...) Expand 10 before | Expand all | Expand 10 after
3346 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug46368-1.html = IMAGE+TEXT 3355 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug46368-1.html = IMAGE+TEXT
3347 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug46368-2.html = IMAGE+TEXT 3356 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug46368-2.html = IMAGE+TEXT
3348 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug50695-2.html = IMAGE+TEXT 3357 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/tables/mozilla/bugs/bug50695-2.html = IMAGE+TEXT
3349 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/webarchive/test-duplicate-resources.ht ml = IMAGE+TEXT 3358 BUG_SENORBLANCO LINUX DEBUG : LayoutTests/webarchive/test-duplicate-resources.ht ml = IMAGE+TEXT
3350 3359
3351 // WebKit 50407:50416 3360 // WebKit 50407:50416
3352 BUG_SENORBLANCO : LayoutTests/accessibility/aria-controls-with-tabs.html = TEXT 3361 BUG_SENORBLANCO : LayoutTests/accessibility/aria-controls-with-tabs.html = TEXT
3353 BUG_SENORBLANCO : LayoutTests/accessibility/aria-tab-roles.html = TEXT 3362 BUG_SENORBLANCO : LayoutTests/accessibility/aria-tab-roles.html = TEXT
3354 BUG_SENORBLANCO LINUX WIN : LayoutTests/svg/css/circle-in-mask-with-shadow.svg = IMAGE 3363 BUG_SENORBLANCO LINUX WIN : LayoutTests/svg/css/circle-in-mask-with-shadow.svg = IMAGE
3355 BUG_SENORBLANCO WIN : LayoutTests/svg/W3C-SVG-1.1/masking-intro-01-f.svg = IMAGE 3364 BUG_SENORBLANCO WIN : LayoutTests/svg/W3C-SVG-1.1/masking-intro-01-f.svg = IMAGE
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698