Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(130)

Side by Side Diff: webkit/tools/layout_tests/test_expectations.txt

Issue 164026: So tired of trying to keep up with these test expectations... (Closed) Base URL: svn://chrome-svn/chrome/trunk/src/
Patch Set: Created 11 years, 4 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // This file consists of lines with specifications of what 1 // This file consists of lines with specifications of what
2 // to expect from layout test cases. The test cases can be directories 2 // to expect from layout test cases. The test cases can be directories
3 // in which case the expectations apply to all test cases in that 3 // in which case the expectations apply to all test cases in that
4 // directory and any subdirectory. The format of the file is along the 4 // directory and any subdirectory. The format of the file is along the
5 // lines of: 5 // lines of:
6 // 6 //
7 // LayoutTests/fast/js/fixme.js = FAIL 7 // LayoutTests/fast/js/fixme.js = FAIL
8 // LayoutTests/fast/js/flaky.js = FAIL PASS 8 // LayoutTests/fast/js/flaky.js = FAIL PASS
9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS 9 // LayoutTests/fast/js/crash.js = CRASH TIMEOUT FAIL PASS
10 // 10 //
(...skipping 1283 matching lines...) Expand 10 before | Expand all | Expand 10 after
1294 BUG10667 MAC : chrome/plugins/get-file-url.html = CRASH TIMEOUT 1294 BUG10667 MAC : chrome/plugins/get-file-url.html = CRASH TIMEOUT
1295 // Skip because we throw an exception before we get to dumpAsText. 1295 // Skip because we throw an exception before we get to dumpAsText.
1296 BUG10667 SKIP MAC : chrome/plugins/get-url-with-blank-target.html = FAIL 1296 BUG10667 SKIP MAC : chrome/plugins/get-url-with-blank-target.html = FAIL
1297 BUG10667 MAC : chrome/plugins/multiple-plugins.html = FAIL 1297 BUG10667 MAC : chrome/plugins/multiple-plugins.html = FAIL
1298 BUG10667 MAC : chrome/plugins/nested-plugin-objects.html = FAIL 1298 BUG10667 MAC : chrome/plugins/nested-plugin-objects.html = FAIL
1299 BUG10667 MAC : chrome/plugins/refcount-leaks.html = FAIL 1299 BUG10667 MAC : chrome/plugins/refcount-leaks.html = FAIL
1300 BUG10667 MAC : chrome/plugins/return-npobject.html = FAIL 1300 BUG10667 MAC : chrome/plugins/return-npobject.html = FAIL
1301 BUG10667 MAC : chrome/plugins/script-object-invoke.html = FAIL 1301 BUG10667 MAC : chrome/plugins/script-object-invoke.html = FAIL
1302 BUG10667 MAC : pending/plugins/iframe-shims.html = FAIL CRASH 1302 BUG10667 MAC : pending/plugins/iframe-shims.html = FAIL CRASH
1303 BUG18027 MAC : LayoutTests/fast/dom/object-plugin-hides-properties.html = CRASH 1303 BUG18027 MAC : LayoutTests/fast/dom/object-plugin-hides-properties.html = CRASH
1304 BUG18027 MAC : LayoutTests/plugins/embed-attributes-style.html = PASS CRASH
1304 1305
1305 // NEW FOR MERGE 36102:37604 1306 // NEW FOR MERGE 36102:37604
1306 1307
1307 // We don't draw the spelling markers at all in test shell, and it's a low 1308 // We don't draw the spelling markers at all in test shell, and it's a low
1308 // priority, so I'm DEFERing. 1309 // priority, so I'm DEFERing.
1309 BUG10352 WIN LINUX : LayoutTests/editing/spelling/inline_spelling_markers.html = FAIL 1310 BUG10352 WIN LINUX : LayoutTests/editing/spelling/inline_spelling_markers.html = FAIL
1310 // New test. We should fix it, but it doesn't need to block the current release 1311 // New test. We should fix it, but it doesn't need to block the current release
1311 BUG10352 : LayoutTests/fast/js/arguments.html = FAIL 1312 BUG10352 : LayoutTests/fast/js/arguments.html = FAIL
1312 // New test. We should fix it, but it doesn't need to block the current release 1313 // New test. We should fix it, but it doesn't need to block the current release
1313 BUG10352 : LayoutTests/fast/js/primitive-method-this.html = FAIL 1314 BUG10352 : LayoutTests/fast/js/primitive-method-this.html = FAIL
(...skipping 155 matching lines...) Expand 10 before | Expand all | Expand 10 after
1469 // Ignored on Win/Linux because they rely on QT to provide a TIFF decoder. 1470 // Ignored on Win/Linux because they rely on QT to provide a TIFF decoder.
1470 BUG10378 MAC : LayoutTests/fast/images/embed-image.html = FAIL CRASH 1471 BUG10378 MAC : LayoutTests/fast/images/embed-image.html = FAIL CRASH
1471 BUG10378 MAC : LayoutTests/fast/images/object-image.html = FAIL CRASH 1472 BUG10378 MAC : LayoutTests/fast/images/object-image.html = FAIL CRASH
1472 1473
1473 // Some times it fails because the animation starts before the first dom dump 1474 // Some times it fails because the animation starts before the first dom dump
1474 // so the text doesn't match. 1475 // so the text doesn't match.
1475 BUG10379 MAC : LayoutTests/svg/hixie/perf/007.xml = FAIL PASS 1476 BUG10379 MAC : LayoutTests/svg/hixie/perf/007.xml = FAIL PASS
1476 1477
1477 // To be figured out, probably timing due to the dual status 1478 // To be figured out, probably timing due to the dual status
1478 BUG10380 MAC : LayoutTests/animations/combo-transform-translate+scale.html = FAI L PASS 1479 BUG10380 MAC : LayoutTests/animations/combo-transform-translate+scale.html = FAI L PASS
1479 BUG10380 MAC : LayoutTests/animations/change-one-anim.html = FAIL PASS
1480 1480
1481 // All of these svg tests seem to be hit or miss on the mac. the issue is they 1481 // All of these svg tests seem to be hit or miss on the mac. the issue is they
1482 // seem not always take the dom snapshot at a consistent state, so some times 1482 // seem not always take the dom snapshot at a consistent state, so some times
1483 // animations have started and sometimes they haven't. It looks like win and 1483 // animations have started and sometimes they haven't. It looks like win and
1484 // linux have rebaselined to what is most common cases for the build bots, but 1484 // linux have rebaselined to what is most common cases for the build bots, but
1485 // we're not seeing that sorta stability on mac. So for now we tag them as 1485 // we're not seeing that sorta stability on mac. So for now we tag them as
1486 // pass & fail, but we really need to fix these tests upstream to have 1486 // pass & fail, but we really need to fix these tests upstream to have
1487 // a consistent behavior (and probably update win/linux expected values). 1487 // a consistent behavior (and probably update win/linux expected values).
1488 BUG10381 MAC LINUX : LayoutTests/svg/W3C-SVG-1.1/animate-elem-03-t.svg = FAIL PA SS 1488 BUG10381 MAC LINUX : LayoutTests/svg/W3C-SVG-1.1/animate-elem-03-t.svg = FAIL PA SS
1489 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-04-t.svg = FAIL PASS 1489 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-04-t.svg = FAIL PASS
(...skipping 19 matching lines...) Expand all
1509 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-41-t.svg = FAIL PASS 1509 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-41-t.svg = FAIL PASS
1510 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-46-t.svg = FAIL PASS 1510 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-46-t.svg = FAIL PASS
1511 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-81-t.svg = FAIL PASS 1511 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-81-t.svg = FAIL PASS
1512 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-85-t.svg = FAIL PASS 1512 BUG10381 MAC : LayoutTests/svg/W3C-SVG-1.1/animate-elem-85-t.svg = FAIL PASS
1513 // This next one seems to be timing related (passes some times) 1513 // This next one seems to be timing related (passes some times)
1514 BUG10381 DEBUG MAC : LayoutTests/editing/execCommand/paste-1.html = FAIL PASS 1514 BUG10381 DEBUG MAC : LayoutTests/editing/execCommand/paste-1.html = FAIL PASS
1515 1515
1516 // These may be similar timing issue as above. 1516 // These may be similar timing issue as above.
1517 BUG10382 MAC : LayoutTests/transitions/change-values-during-transition.html = FA IL PASS 1517 BUG10382 MAC : LayoutTests/transitions/change-values-during-transition.html = FA IL PASS
1518 BUG10382 MAC : LayoutTests/transitions/shorthand-border-transitions.html = FAIL PASS 1518 BUG10382 MAC : LayoutTests/transitions/shorthand-border-transitions.html = FAIL PASS
1519 BUG10382 MAC : LayoutTests/transitions/shorthand-transitions.html = FAIL PASS
1520 BUG10382 MAC : LayoutTests/animations/change-keyframes-name.html = FAIL PASS 1519 BUG10382 MAC : LayoutTests/animations/change-keyframes-name.html = FAIL PASS
1521 1520
1522 // Most of the http tests seem to be flaky on the mac. 1521 // Most of the http tests seem to be flaky on the mac.
1523 // Don't mark these as FAIL since we want to know if tests start failing. 1522 // Don't mark these as FAIL since we want to know if tests start failing.
1524 // TODO(ojan): Remove all the mac http tests that are now redundant with the 1523 // TODO(ojan): Remove all the mac http tests that are now redundant with the
1525 // following two lines. 1524 // following two lines.
1526 BUG10383 MAC : LayoutTests/http = CRASH TIMEOUT PASS 1525 BUG10383 MAC : LayoutTests/http = CRASH TIMEOUT PASS
1527 BUG10672 MAC : chrome/http = PASS CRASH TIMEOUT 1526 BUG10672 MAC : chrome/http = PASS CRASH TIMEOUT
1528 1527
1529 // The following are flaky in that some times the timeout or crash, but we think 1528 // The following are flaky in that some times the timeout or crash, but we think
(...skipping 163 matching lines...) Expand 10 before | Expand all | Expand 10 after
1693 // Popup-menu doesn't draw in layout tests 1692 // Popup-menu doesn't draw in layout tests
1694 BUG10408 MAC : LayoutTests/fast/forms/menulist-no-overflow.html = FAIL 1693 BUG10408 MAC : LayoutTests/fast/forms/menulist-no-overflow.html = FAIL
1695 1694
1696 // Pass locally but fail on the bots. 1695 // Pass locally but fail on the bots.
1697 BUG10409 MAC : LayoutTests/fast/forms/002.html = FAIL 1696 BUG10409 MAC : LayoutTests/fast/forms/002.html = FAIL
1698 BUG10409 MAC LINUX : LayoutTests/svg/custom/clip-path-units-changes.svg = FAIL 1697 BUG10409 MAC LINUX : LayoutTests/svg/custom/clip-path-units-changes.svg = FAIL
1699 1698
1700 // We disallow file:// urls from doing XHR to data:. 1699 // We disallow file:// urls from doing XHR to data:.
1701 BUG9275 : LayoutTests/fast/encoding/char-decoding.html = FAIL 1700 BUG9275 : LayoutTests/fast/encoding/char-decoding.html = FAIL
1702 1701
1703 // Flakey tests
1704 BUG10410 LINUX : LayoutTests/transitions/shorthand-transitions.html = FAIL PASS
1705
1706 // intermittent failures on the buildbot 1702 // intermittent failures on the buildbot
1707 BUG10411 : LayoutTests/svg/custom/gradient-stop-style-change.svg = FAIL PASS 1703 BUG10411 : LayoutTests/svg/custom/gradient-stop-style-change.svg = FAIL PASS
1708 1704
1709 // The 7th column should not be top aligned. 1705 // The 7th column should not be top aligned.
1710 // New test. We should fix it, but it doesn't need to block the current release 1706 // New test. We should fix it, but it doesn't need to block the current release
1711 BUG10412 WIN LINUX : LayoutTests/fast/table/vertical-align-baseline.html = FAIL 1707 BUG10412 WIN LINUX : LayoutTests/fast/table/vertical-align-baseline.html = FAIL
1712 1708
1713 // Merge 40165:40297 -- regressions 1709 // Merge 40165:40297 -- regressions
1714 // New test. We should fix it, but it doesn't need to block the current release 1710 // New test. We should fix it, but it doesn't need to block the current release
1715 BUG10413 WIN LINUX : LayoutTests/fast/repaint/dynamic-table-vertical-alignment-c hange.html = FAIL 1711 BUG10413 WIN LINUX : LayoutTests/fast/repaint/dynamic-table-vertical-alignment-c hange.html = FAIL
(...skipping 371 matching lines...) Expand 10 before | Expand all | Expand 10 after
2087 BUG9798 : LayoutTests/http/tests/misc/css-reject-any-type-in-strict-mode.html = TIMEOUT PASS 2083 BUG9798 : LayoutTests/http/tests/misc/css-reject-any-type-in-strict-mode.html = TIMEOUT PASS
2088 BUG9798 : LayoutTests/http/tests/misc/image-blocked-src-change.html = FAIL PASS 2084 BUG9798 : LayoutTests/http/tests/misc/image-blocked-src-change.html = FAIL PASS
2089 BUG9798 : LayoutTests/http/tests/misc/redirect-with-quotes.php = TIMEOUT PASS 2085 BUG9798 : LayoutTests/http/tests/misc/redirect-with-quotes.php = TIMEOUT PASS
2090 BUG9798 : LayoutTests/http/tests/xmlhttprequest/basic-auth.html = TIMEOUT PASS 2086 BUG9798 : LayoutTests/http/tests/xmlhttprequest/basic-auth.html = TIMEOUT PASS
2091 BUG9798 DEBUG : LayoutTests/editing/execCommand/paste-2.html = FAIL PASS 2087 BUG9798 DEBUG : LayoutTests/editing/execCommand/paste-2.html = FAIL PASS
2092 BUG9798 DEBUG : LayoutTests/editing/selection/4776665.html = FAIL PASS 2088 BUG9798 DEBUG : LayoutTests/editing/selection/4776665.html = FAIL PASS
2093 BUG9798 DEBUG : LayoutTests/svg/custom/path-bad-data.svg = CRASH FAIL 2089 BUG9798 DEBUG : LayoutTests/svg/custom/path-bad-data.svg = CRASH FAIL
2094 BUG9798 : chrome/fast/dom/extensions/interval.html = CRASH FAIL PASS 2090 BUG9798 : chrome/fast/dom/extensions/interval.html = CRASH FAIL PASS
2095 BUG9798 LINUX : LayoutTests/animations/animation-iteration-event-destroy-rendere r.html = TIMEOUT PASS 2091 BUG9798 LINUX : LayoutTests/animations/animation-iteration-event-destroy-rendere r.html = TIMEOUT PASS
2096 BUG9798 LINUX : LayoutTests/animations/change-keyframes-name.html = FAIL PASS 2092 BUG9798 LINUX : LayoutTests/animations/change-keyframes-name.html = FAIL PASS
2097 BUG9798 LINUX : LayoutTests/animations/change-one-anim.html = FAIL PASS
2098 BUG9798 LINUX : LayoutTests/animations/combo-transform-translate+scale.html = FA IL PASS 2093 BUG9798 LINUX : LayoutTests/animations/combo-transform-translate+scale.html = FA IL PASS
2099 BUG9798 LINUX : LayoutTests/fast/backgrounds/001.html = FAIL PASS 2094 BUG9798 LINUX : LayoutTests/fast/backgrounds/001.html = FAIL PASS
2100 BUG9798 LINUX : LayoutTests/fast/dom/HTMLObjectElement/object-as-frame.html = FA IL PASS 2095 BUG9798 LINUX : LayoutTests/fast/dom/HTMLObjectElement/object-as-frame.html = FA IL PASS
2101 BUG9798 LINUX : LayoutTests/fast/dom/delete-contents.html = FAIL PASS 2096 BUG9798 LINUX : LayoutTests/fast/dom/delete-contents.html = FAIL PASS
2102 BUG9798 LINUX : LayoutTests/fast/dom/onerror-img.html = CRASH PASS 2097 BUG9798 LINUX : LayoutTests/fast/dom/onerror-img.html = CRASH PASS
2103 BUG9798 LINUX : LayoutTests/fonts/cursive.html = FAIL PASS 2098 BUG9798 LINUX : LayoutTests/fonts/cursive.html = FAIL PASS
2104 BUG9798 LINUX : LayoutTests/http/tests/misc/BOM-override-script.html = TIMEOUT P ASS 2099 BUG9798 LINUX : LayoutTests/http/tests/misc/BOM-override-script.html = TIMEOUT P ASS
2105 BUG9798 LINUX : LayoutTests/http/tests/navigation/error404-frames.html = TIMEOUT PASS 2100 BUG9798 LINUX : LayoutTests/http/tests/navigation/error404-frames.html = TIMEOUT PASS
2106 BUG9798 LINUX : LayoutTests/http/tests/security/javascriptURL/xss-ALLOWED-to-jav ascript-url-sub-frame-2-level.html = FAIL PASS 2101 BUG9798 LINUX : LayoutTests/http/tests/security/javascriptURL/xss-ALLOWED-to-jav ascript-url-sub-frame-2-level.html = FAIL PASS
2107 BUG9798 LINUX : LayoutTests/http/tests/security/originHeader/origin-header-for-p ost.html = FAIL PASS TIMEOUT 2102 BUG9798 LINUX : LayoutTests/http/tests/security/originHeader/origin-header-for-p ost.html = FAIL PASS TIMEOUT
(...skipping 950 matching lines...) Expand 10 before | Expand all | Expand 10 after
3058 3053
3059 // This test seems to crash periodically on mac. 3054 // This test seems to crash periodically on mac.
3060 BUG18206 MAC : LayoutTests/fast/xmlhttprequest/xmlhttprequest-open-after-iframe- onload-remove-self.html = CRASH PASS 3055 BUG18206 MAC : LayoutTests/fast/xmlhttprequest/xmlhttprequest-open-after-iframe- onload-remove-self.html = CRASH PASS
3061 3056
3062 // This happened when I enabled DOM Storage. Adam asked me to just exclude and 3057 // This happened when I enabled DOM Storage. Adam asked me to just exclude and
3063 // file a bug. 3058 // file a bug.
3064 BUG18412 : LayoutTests/http/tests/security/isolatedWorld/all-window-properties.h tml = FAIL 3059 BUG18412 : LayoutTests/http/tests/security/isolatedWorld/all-window-properties.h tml = FAIL
3065 BUG18412 : LayoutTests/http/tests/security/isolatedWorld/all-window-prototypes.h tml = FAIL 3060 BUG18412 : LayoutTests/http/tests/security/isolatedWorld/all-window-prototypes.h tml = FAIL
3066 3061
3067 BUG18569 MAC DEBUG : LayoutTests/fast/repaint/overflow-scroll-delete.html = PASS CRASH 3062 BUG18569 MAC DEBUG : LayoutTests/fast/repaint/overflow-scroll-delete.html = PASS CRASH
3063
3064 // Flaky. Timing?
3065 BUG18584 : LayoutTests/animations/change-one-anim.html = FAIL PASS
3066 BUG18584 WIN : LayoutTests/animations/play-state.html = FAIL PASS
3067 BUG18584 : LayoutTests/transitions/shorthand-transitions.html = FAIL PASS
OLDNEW
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698