Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(707)

Side by Side Diff: webkit/tools/layout_tests/test_expectations.txt

Issue 1093006: WebKit Roll 56272:56306.... (Closed) Base URL: svn://chrome-svn.corp.google.com/chrome/trunk/src/
Patch Set: Created 10 years, 9 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « DEPS ('k') | no next file » | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // This file consists of lines with specifications of what 1 // This file should almost always be empty. Normally Chromium test expectations
2 // to expect from layout test cases. The test cases can be directories 2 // are found in
3 // in which case the expectations apply to all test cases in that 3 // src/third_party/WebKit/LayoutTests/platform/chromium/test_expectations.txt
4 // directory and any subdirectory. The format of the file is along the
5 // lines of:
6 // 4 //
7 // fast/js/fixme.js = FAIL 5 // Only add expectations here to temporarily suppress messages on the bots
8 // fast/js/flaky.js = FAIL PASS 6 // until the changes can be landed upstream.
9 // fast/js/crash.js = CRASH TIMEOUT FAIL PASS
10 //
11 // The format of a test line is as follows:
12 // METADATA : relative/path/to/test.html = EXPECTATIONS
13 //
14 // Valid values for METADATA:
15 //
16 // BUG[0-9]+: See this bug for more information. Every test that isn't marked
17 // WONTFIX should have a BUG annotation.
18 // SKIP: Doesn't run the test.
19 // SLOW: The test takes a long time to run, but does not timeout indefinitely.
20 // DEFER: For tests we'll fix in the future.
21 // WONTFIX: For tests that we never intend to pass on a given platform.
22 // DEBUG: Expectations apply only to the debug build.
23 // RELEASE: Expectations apply only to release build.
24 // LINUX/WIN/WIN-XP/WIN-VISTA/MAC: Expectations apply only to these platforms.
25 //
26 // Valid values for EXPECTATIONS:
27 //
28 // PASS: Test should pass
29 // CRASH: Test should crash
30 // TIMEOUT: Test should timeout
31 // IMAGE: Test will produce an incorrect image dump
32 // TEXT: Test will produce incorrect text output (either full or simplified)
33 // IMAGE+TEXT: Test will produce both incorrect text and images
34 // FAIL: Test will produce either incorrect text, images, or both
35 //
36 // If a line contains multiple expectations, it is considered "flakey",
37 // because it means that we're not producing consistent, reliable results.
38 //
39 // For example,
40 // LINUX : media = PASS FAIL
41 //
42 // The above means that all the media tests are flaky, but only on Linux.
43 //
44 // Other examples:
45 //
46 // SKIP : fast/js/no-good.js = TIMEOUT PASS
47 // DEBUG : fast/js/no-good.js = TIMEOUT PASS
48 // DEBUG SKIP : fast/js/no-good.js = TIMEOUT PASS
49 // LINUX DEBUG SKIP : fast/js/no-good.js = TIMEOUT PASS
50 // BUG1234 DEBUG MAC : fast/js/no-good.js = TIMEOUT PASS
51 //
52 // Notes:
53 // -A test cannot be both SLOW and TIMEOUT
54 // -A test can be included twice, but not via the same path.
55 // -If a test is included twice, then the more precise path wins.
56 // -CRASH tests cannot be WONTFIX
57
58 // -----------------------------------------------------------------
59 // SLOW TESTS
60 // -----------------------------------------------------------------
61
62 BUG24182 SLOW : fast/js/regexp-overflow.html = PASS
63 BUG24182 SLOW RELEASE : http/tests/misc/DOMContentLoaded-event.html = PASS
64 BUG24182 SLOW LINUX DEBUG : http/tests/misc/DOMContentLoaded-event.html = PASS
65 BUG24182 SLOW LINUX MAC RELEASE : http/tests/navigation/multiple-back-forward-en tries.html = PASS
66 BUG24182 SLOW LINUX DEBUG : http/tests/navigation/multiple-back-forward-entries. html = PASS
67 BUG24182 SLOW LINUX DEBUG : svg/filters/big-sized-filter.svg = PASS
68 BUG24182 SLOW : http/tests/xmlhttprequest/simple-cross-origin-progress-events.ht ml = PASS
69 //BUG24182 SLOW WIN MAC : svg/custom/invisible-text-after-scrolling.xhtml = PASS
70 BUG24182 SLOW : tables/mozilla/other/slashlogo.html = PASS
71 BUG24182 SLOW WIN RELEASE : tables/mozilla/bugs/bug113235-1.html = PASS
72 BUG24182 SLOW DEBUG : fast/js/toString-and-valueOf-override.html = PASS
73
74 // This tests is normally <1 second, but occasionally takes >20s.
75 BUG24182 SLOW WIN RELEASE : fast/dom/Window/webkitConvertPoint.html = PASS
76
77 BUG24182 WIN RELEASE SLOW : http/tests/loading/redirect-methods.html = PASS
78 BUG24182 WIN SLOW : svg/hixie/perf/007.xml = PASS
79 BUG24182 WIN LINUX DEBUG : fast/backgrounds/size/contain-and-cover.html = PASS
80 BUG24182 SLOW MAC RELEASE : dom/html/level2/html/HTMLImageElement01.html = PASS
81 BUG24182 SLOW WIN RELEASE : http/tests/local/file-url-sent-as-referer.html = PAS S
82 BUG24182 SLOW WIN DEBUG : svg/carto.net/window.svg = PASS
83 BUG24182 SLOW LINUX DEBUG : fast/xpath/4XPath/Borrowed/cz_20030217.html = PASS
84 BUG24182 SLOW WIN MAC DEBUG : tables/mozilla/bugs/45621.html = PASS
85 //BUG24852 started failing since webkit 49583
86 //BUG24182 SLOW WIN : css1/font_properties/font.html = PASS
87 BUG24182 SLOW WIN : http/tests/security/xssAuditor/meta-tag-http-refresh-javascr ipt-url.html = PASS
88 BUG24182 SLOW WIN RELEASE : http/tests/security/cross-origin-css.html = PASS
89 BUG24182 SLOW WIN RELEASE : fast/loader/local-CSS-from-local.html = PASS
90 BUG24182 WIN RELEASE SLOW : http/tests/incremental/split-hex-entities.pl = PASS
91 BUG24182 WIN RELEASE SLOW : http/tests/xmlhttprequest/XMLHttpRequestException.ht ml = PASS
92 BUG24182 WIN RELEASE SLOW : http/tests/xmlhttprequest/connection-error-sync.html = PASS
93 BUG24182 WIN RELEASE SLOW : http/tests/loading/onload-vs-immediate-refresh.pl = PASS
94 BUG24182 WIN LINUX SLOW : editing/selection/extend-selection.html = PASS
95 BUG24182 SLOW WIN : fast/images/svg-as-background.html = PASS
96 BUG24182 SLOW WIN : fast/backgrounds/svg-as-background-5.html = PASS
97 BUG24182 WIN DEBUG SLOW: inspector/console-dirxml.html = PASS
98 BUG24182 DEBUG SLOW : fast/dom/Window/window-function-frame-getter-precedence.ht ml = PASS
99 BUG24182 SLOW DEBUG : fast/frames/frame-limit.html = PASS
100 BUG24182 SLOW : http/tests/cache/subresource-failover-to-network.html = PASS
101 BUG24182 WIN DEBUG : animations/play-state.html = PASS TEXT
102 BUG24182 SLOW WIN RELEASE : animations/play-state.html = PASS
103
104 // Usually <1s in release, ~1s in debug, but occasionally >5s in release.
105 BUG27335 WIN RELEASE : plugins/embed-attributes-setting.html = PASS TIMEOUT
106 BUG27335 WIN DEBUG SLOW : plugins/embed-attributes-setting.html = PASS
107
108 // --- collecting results for supported-xml-content-types.html ---
109 // was slow, started to timeout
110 BUG18702 WIN : http/tests/xmlhttprequest/supported-xml-content-types.html = PASS TIMEOUT
111
112 BUG34759 WIN DEBUG SLOW : inspector/console-log-before-inspector-open.html = PAS S
113
114 BUG36539 SLOW : http/tests/misc/uncacheable-script-repeated.html = PASS
115
116 // -----------------------------------------------------------------
117 // SKIPPED TESTS
118 // -----------------------------------------------------------------
119
120 // Since V8 is more interruptible than other engines, they use the standard
121 // long-running-script mechanism to handle very-long-running regexps too.
122 // See http://code.google.com/p/v8/issues/detail?id=287
123 WONTFIX SKIP : fast/js/regexp-overflow-too-big.html = TIMEOUT
124
125 // XHTML tests. These tests seem like they work, but only because the
126 // expected output expects to see JS errors. There is no point in running
127 // these tests, because they are giving us a false sense of testing that isn't
128 // really happening. Furthermore, since they appear to pass if we do try to
129 // run them, we can't even list them as permanently expected to fail.
130 BUG24185 WONTFIX SKIP : dom/xhtml = PASS
131
132 // We do not want to support Legacy mac encodings on Windows/Linux.
133 // On Mac, we can support them by building platform/text/mac, but
134 // probably we don't want there, either.
135 WONTFIX SKIP WIN LINUX : fast/encoding/char-encoding-mac.html = FAIL
136
137 // Fails due to different window.close() rules. We need to decide whether we
138 // ever expect to pass this. Now also timing out.
139 BUG24189 WONTFIX SKIP : fast/dom/open-and-close-by-DOM.html = FAIL
140
141 // Skip because of WebKit bug 18512. These bugs "poison" future tests, causing
142 // all SVG objects with fill="red" to be rendered in green.
143 WONTFIX SKIP : svg/custom/fill-SVGPaint-interface.svg = PASS
144 WONTFIX SKIP : svg/custom/getPresentationAttribute.svg = PASS
145
146 // WML is still an inprogress feature upstream. Chromium does not build
147 // with WML support, so skip its tests.
148 WONTFIX SKIP : wml = FAIL
149 WONTFIX SKIP : http/tests/wml = FAIL
150 WONTFIX SKIP : fast/wml = FAIL
151
152 // These tests are based on the JSC JavaScript profiler. The V8 JavaScript
153 // profiler is in development and will use a different approach than JSC and
154 // most likely these tests will always be JSC specific.
155 WONTFIX SKIP : fast/profiler = FAIL TIMEOUT
156
157 // This test doesn't terminate because it contains exponential
158 // regexps. It is safe to disable because we run the same tests
159 // (sans the nonterminating ones) as part of the v8 tests.
160 WONTFIX SKIP : fast/regex/test1.html = PASS
161
162 // We use worker_uitests to run workers tests. Don't run them in test_shell.
163 WONTFIX SKIP : fast/workers = PASS TIMEOUT FAIL
164 WONTFIX SKIP : http/tests/workers = PASS TIMEOUT FAIL
165 WONTFIX SKIP : http/tests/xmlhttprequest/workers = PASS TIMEOUT FAIL
166 WONTFIX SKIP : http/tests/eventsource/workers = PASS TIMEOUT FAIL
167 WONTFIX SKIP : websocket/tests/workers/ = PASS TIMEOUT FAIL
168
169 // Page Cache - based tests. Chromium disables page cache because the WebKit pag e cache keeps previously
170 // loaded pages alive in memory to be able to quickly substitute them when user clicks History buttons.
171 // Chromium wants those to be separate navigations made via browser process to b e able to make decision
172 // on which renderer process to use for each of them.
173 WONTFIX SKIP BUG19635 : fast/harness/use-page-cache.html = TIMEOUT FAIL
174 WONTFIX SKIP BUG19635 : fast/dom/Window/timer-resume-on-navigation-back.html = T IMEOUT FAIL
175 // Depends on page cache, as far as I can tell.
176 WONTFIX SKIP BUG19635 : fast/events/pageshow-pagehide-on-back-cached.html = TIME OUT FAIL
177 WONTFIX SKIP BUG19635 : fast/events/pageshow-pagehide-on-back-cached-with-frames .html = TIMEOUT
178 WONTFIX SKIP BUG19635 : media/restore-from-page-cache.html = TIMEOUT
179 WONTFIX SKIP BUG19635 : loader/go-back-to-different-window-size.html = TIMEOUT T EXT
180 WONTFIX SKIP BUG19635 : fast/loader/crash-copying-backforwardlist.html = TEXT
181 WONTFIX SKIP BUG19635 : fast/frames/frame-crash-with-page-cache.html = TEXT
182 WONTFIX SKIP BUG19635 : fast/harness/page-cache-crash-on-data-urls.html = TEXT
183
184 // Tests that rely on cross-process MessagePorts. No point in running them in
185 // test_shell, since we'd have to use a completely different implementation from
186 // what is used in the browser.
187 WONTFIX SKIP : fast/events/message-channel-gc-2.html = FAIL
188 WONTFIX SKIP : fast/events/message-channel-gc-3.html = FAIL
189 WONTFIX SKIP : fast/events/message-channel-gc-4.html = FAIL
190 WONTFIX SKIP : fast/events/message-channel-gc.html = FAIL
191 WONTFIX SKIP : fast/events/message-channel-listener-circular-ownership.html = FA IL
192 WONTFIX SKIP : fast/events/message-port-clone.html = FAIL
193 WONTFIX SKIP : fast/events/message-port-deleted-document.html = FAIL
194 WONTFIX SKIP : fast/events/message-port-deleted-frame.html = FAIL
195 WONTFIX SKIP : fast/events/message-port-inactive-document.html = FAIL
196 WONTFIX SKIP : fast/events/message-port-no-wrapper.html = FAIL
197 WONTFIX SKIP : fast/events/message-port.html = FAIL
198 WONTFIX SKIP : fast/events/message-port-multi.html = FAIL
199 WONTFIX SKIP : http/tests/security/MessagePort/event-listener-context.html = FAI L
200
201 // Chrome does not support WebArchives (just like Safari for Windows),
202 // although we might eventually want to on Mac.
203 WONTFIX SKIP : webarchive/adopt-attribute-styled-body-webarchive.html = FAIL
204 WONTFIX SKIP : webarchive/adopt-attribute-styled-node-webarchive.html = FAIL
205 WONTFIX SKIP : webarchive/adopt-inline-styled-node-webarchive.html = FAIL
206
207 // Implement java testing harness.
208 BUG36681 DEFER SKIP : java = TEXT
209 // Chrome does not support Java LiveConnect.
210 WONTFIX SKIP : java/lc3 = TEXT
211
212 // this test doesn't make sense on Win or Mac.
213 // TODO: move to platform/chromium-linux/.
214 WONTFIX SKIP MAC WIN : platform/chromium/fast/text/chromium-linux-fontconfig-ren derstyle.html = FAIL
215
216 // -----------------------------------------------------------------
217 // WONTFIX TESTS
218 // -----------------------------------------------------------------
219
220 // This test is completely timing dependent. It is testing the time
221 // between a key event and a search event. You cannot count on this
222 // always being exactly the same.
223 WONTFIX DEBUG : fast/forms/search-event-delay.html = PASS TEXT
224 WONTFIX SLOW WIN RELEASE : fast/forms/search-event-delay.html = FAIL PASS
225 WONTFIX SLOW MAC RELEASE : fast/forms/search-event-delay.html = FAIL PASS CRASH
226 WONTFIX LINUX RELEASE : fast/forms/search-event-delay.html = FAIL PASS
227
228 // Chrome uses different keyboard accelerators from those used by Safari, so
229 // these tests will always fail.
230 // TODO(pinkerton): these should probably pass on Mac since we want Emacs
231 // keybindings but they currently do not.
232 WONTFIX LINUX WIN DEBUG : editing/pasteboard/emacs-cntl-y-001.html = FAIL
233 WONTFIX LINUX RELEASE : editing/pasteboard/emacs-cntl-y-001.html = FAIL
234 WONTFIX SLOW WIN RELEASE : editing/pasteboard/emacs-cntl-y-001.html = FAIL
235 WONTFIX : editing/pasteboard/emacs-ctrl-a-k-y.html = FAIL
236 WONTFIX : editing/pasteboard/emacs-ctrl-k-y-001.html = FAIL
237 WONTFIX : editing/input/emacs-ctrl-o.html = FAIL
238
239 // Checks for very kjs-specific garbage collector behavior.
240 // Would have to be implemented much differently to work in v8.
241 WONTFIX : fast/dom/gc-10.html = FAIL
242
243 // This fails because we're missing various useless apple-specific
244 // properties on the window object.
245 // This test also timeouts in Debug mode.
246 BUG24187 WONTFIX SLOW DEBUG : fast/dom/Window/window-properties.html = FAIL
247 BUG24187 WONTFIX SLOW WIN RELEASE : fast/dom/Window/window-properties.html = FAI L
248 BUG24187 WONTFIX LINUX MAC RELEASE : fast/dom/Window/window-properties.html = FA IL
249
250 // Safari specific test to ensure that JavaScript errors aren't logged when in
251 // private browsing mode.
252 WONTFIX : http/tests/security/cross-frame-access-private-browsing.html = FAIL
253
254 // Chromium doesn't implement private browsing in the renderer.
255 WONTFIX : plugins/private-browsing-mode.html = FAIL
256 WONTFIX : plugins/private-browsing-mode-2.html = TEXT
257
258 // We don't let anyone set status in the browser.
259 WONTFIX : plugins/set-status.html = TEXT
260
261 // We don't care about dashboard compatibility mode.
262 WONTFIX SKIP : http/tests/xmlhttprequest/default-content-type-dashboard.html = F AIL
263 WONTFIX SKIP : http/tests/xmlhttprequest/svg-created-by-xhr-disallowed-in-dashbo ard.html = FAIL
264 WONTFIX : svg/custom/embedded-svg-disallowed-in-dashboard.xml = FAIL
265 WONTFIX : svg/custom/manually-parsed-embedded-svg-disallowed-in-dashboard.html = FAIL
266 WONTFIX : svg/custom/manually-parsed-svg-disallowed-in-dashboard.html = FAIL
267 WONTFIX SKIP : svg/custom/svg-disallowed-in-dashboard-object.html = FAIL
268 WONTFIX : fast/canvas/canvas-gradient-addStop-error.html = FAIL
269
270
271 // Chrome uses different keyboard accelerators from those used by Safari, so
272 // these tests will always fail.
273 // TODO(ericroman): can the following 2 tests be removed from this list, since t hey pass?
274 WONTFIX : fast/events/keydown-1.html = FAIL
275 WONTFIX LINUX WIN : fast/events/option-tab.html = FAIL
276
277 // Chrome does not support WebArchives.
278 BUG10395 WONTFIX SKIP : webarchive/loading = FAIL TIMEOUT
279 BUG10395 WONTFIX : webarchive = PASS
280 BUG10395 WONTFIX : svg/webarchive = FAIL PASS
281 BUG10395 WONTFIX : svg/custom/image-with-prefix-in-webarchive.svg = FAIL
282 BUG10395 WONTFIX : svg/webarchive/svg-feimage-subresources.svg = IMAGE+TEXT
283 BUG10395 WONTFIX SKIP : http/tests/webarchive = FAIL PASS
284 BUG10395 WONTFIX SKIP : svg/webarchive/svg-cursor-subresources.svg = FAIL
285 BUG10395 WONTFIX SKIP : webarchive/test-css-url-resources-in-stylesheets.html = FAIL
286 BUG10395 WONTFIX SKIP : webarchive/test-css-url-resources-inline-styles.html = F AIL
287
288 // We don't support ACCELERATED_COMPOSITING. Skipping because some tests in this
289 // directory don't have pixel results.
290 BUG15733 WONTFIX SKIP : compositing = FAIL PASS TIMEOUT
291
292 // Run the Mac-specific platform tests, but only to check for crashes.
293 WONTFIX : platform/gtk = FAIL PASS
294 WONTFIX : platform/mac = FAIL PASS TIMEOUT
295 WONTFIX : platform/mac-leopard = FAIL PASS
296 WONTFIX : platform/mac-tiger = FAIL PASS
297 WONTFIX : platform/qt = FAIL PASS
298 WONTFIX SKIP : plugins/qt-qwidget-plugin.html = FAIL
299 WONTFIX SKIP : platform/mac/fast/text/international/Geeza-Pro-vertical-metrics-a djustment.html = PASS
300
301 WONTFIX LINUX MAC : platform/win = FAIL PASS
302
303 // This is a Safari specific test to make WebKit behave like AppKit on the Mac.
304 // We do not support it because PLATFORM(MAC) is not defined for the mac version .
305 WONTFIX MAC : platform/mac/editing/deleting/backward-delete.html = FAIL
306
307 // Ignored because we do not have OBJC bindings
308 WONTFIX SKIP : editing/pasteboard/paste-RTFD.html = FAIL
309 WONTFIX SKIP : editing/pasteboard/paste-TIFF.html = FAIL
310 WONTFIX SKIP : plugins/jsobjc-dom-wrappers.html = FAIL
311 WONTFIX SKIP : plugins/jsobjc-simple.html = FAIL
312 WONTFIX SKIP : plugins/root-object-premature-delete-crash.html = FAIL
313 WONTFIX SKIP : plugins/throw-on-dealloc.html = FAIL
314 WONTFIX SKIP : plugins/undefined-property-crash.html = FAIL
315
316 // Uses __apple_runtime_object
317 WONTFIX SKIP : plugins/call-as-function-test.html = FAIL
318
319 // Ignore test because it tries to load .pdf files in <img> tags.
320 WONTFIX LINUX WIN : fast/images/pdf-as-image-landscape.html = FAIL
321 WONTFIX LINUX WIN : fast/images/pdf-as-image.html = FAIL
322 WONTFIX LINUX WIN : fast/replaced/pdf-as-image.html = FAIL
323
324 // These tests try to print a PDF file as the expected result. I don't think
325 // we plan on supporting this anytime soon.
326 WONTFIX SKIP : printing/media-queries-print.html = PASS
327 WONTFIX SKIP : printing/compositing-layer-printing.html = PASS
328
329 // Chrome doesn't call the willCacheResponse callback (a method
330 // of ResourceHandleClient). That function is Mac-specific.
331 WONTFIX SKIP : http/tests/misc/willCacheResponse-delegate-callback.html = FAIL
332
333 // Checks for very kjs-specific garbage collector
334 // behavior. Gc-9 is completely braindamaged; it tests that certain
335 // properties are reset by the garbage collector. It looks to pass recently.
336 WONTFIX : fast/dom/gc-9.html = FAIL
337
338 // This test checks that ((new Error()).message is undefined, which is
339 // a direct contradiction of the javascript spec 15.11.4.3 which
340 // says that it must be a string.
341 WONTFIX : fast/js/kde/evil-n.html = FAIL
342
343 // This test checks that properties of arguments arrays are non-enumerable
344 // which is incorrect according to the ES5 spec.
345 WONTFIX : fast/js/kde/function.html = FAIL
346
347 // This test is broken. The regular expression used contains an error
348 // which kjs swallows and returns false, which is the expected result,
349 // but for which we issue a syntax error.
350 WONTFIX : fast/js/code-serialize-paren.html = FAIL
351
352 // These tests check for a kjs-specific extension, that source file
353 // name and line numbers are available as properties on exception
354 // objects. We handle error positions differently.
355 WONTFIX : fast/js/exception-linenums-in-html-1.html = FAIL
356 WONTFIX : fast/js/exception-linenums-in-html-2.html = FAIL
357 WONTFIX : fast/js/exception-linenums.html = FAIL
358 WONTFIX : fast/js/exception-expression-offset.html = FAIL
359
360 // These tests rely on specific details of decompilation of
361 // functions. V8 always returns the source code as written; there's
362 // no decompilation or pretty printing involved except for
363 // certain "native" functions where the V8 output does not include
364 // newline characters. This is working as intended and we don't care
365 // if the tests pass or fail. (It should probably simply be re-baselined.)
366 WONTFIX : fast/js/function-names.html = FAIL
367
368 // This test relies on KJS specific implementation
369 // (window.GCController.getJSObjectCount), which we have no intention of
370 // supporting.
371 WONTFIX SKIP : fast/dom/Window/timeout-released-on-close.html = FAIL
372
373 // These tests expect a tiff decoder, which we don't have.
374 WONTFIX LINUX WIN : fast/images/embed-image.html = FAIL
375 WONTFIX LINUX WIN : fast/images/object-image.html = FAIL
376
377 // Safari has a unique handling of the BOM characters among browsers.
378 // There is a strong suspicion that this is a security problem, so we
379 // follow the rest of the browsers on this one.
380 WONTFIX : fast/js/removing-Cf-characters.html = FAIL
381
382 // These tests fail in all but the PST/PDT time zone.
383 // Another reason for failure is that, for compatability, we don't obey
384 // the ECMA standard on DST exactly. We use the OS's facilities to
385 // convert to local time for dates within the UNIX 32-bit epoch,
386 // and follow the ECMA rules for dates outside that range.
387 // The ECMA rules say to use current DST rules for all dates,
388 // and that all dates that are separated by an exact multiple of
389 // 28 years must behave exactly the same.
390 // OS local time services are more accurate than this ECMA rule,
391 // which is a discrepancy.
392 WONTFIX SKIP : fast/js/date-DST-time-cusps.html = PASS FAIL
393 WONTFIX SKIP : fast/js/date-big-setdate.html = PASS FAIL
394
395 // The following tests fail because of difference in how the test shell
396 // navigation controller tracks navigations as compared to how the Mac
397 // implementation does it.
398 WONTFIX : http/tests/history/redirect-200-refresh-0-seconds.pl = FAIL
399 WONTFIX : http/tests/history/redirect-js-location-replace-0-seconds.html = FAIL
400 WONTFIX DEBUG : http/tests/history/redirect-js-location-replace-2-seconds.html = FAIL
401 WONTFIX LINUX MAC RELEASE : http/tests/history/redirect-js-location-replace-2-se conds.html = FAIL
402 WONTFIX SLOW WIN RELEASE : http/tests/history/redirect-js-location-replace-2-sec onds.html = FAIL
403 WONTFIX : http/tests/history/redirect-js-location-replace-before-load.html = FAI L
404 WONTFIX : http/tests/history/redirect-meta-refresh-0-seconds.html = FAIL
405
406 // This test expects weird behavior of __defineGetter__ on the
407 // window object. It expects variables introduced with 'var x = value'
408 // to behave differently from variables introduced with 'y = value'.
409 // This just seems wrong and should have very low priority.
410 // Agreed, not required for Beta, we can debate this with WebKit post Beta
411 // (eseidel, 4/25)
412 // Ignore this until we see evidence that we need to support it.
413 WONTFIX : fast/dom/getter-on-window-object2.html = FAIL
414
415 // V8 doesn't stable sort and we currently have no intention of
416 // changing this. It is tracked by:
417 // http://code.google.com/p/v8/issues/detail?id=90
418 WONTFIX : fast/js/comparefn-sort-stability.html = FAIL
419 WONTFIX : fast/js/sort-stability.html = FAIL
420
421 // We have no indication that anyone misses this and have currently no
422 // intention of implementing it.
423 WONTFIX : fast/js/function-dot-arguments.html = FAIL
424
425 // This is a Safari specific test used to document the set of global
426 // constructors they expose and the exact way they are printed. Not
427 // important.
428 WONTFIX : fast/js/global-constructors.html = FAIL
429
430 // This test is not reliable. The behavior depends on exactly how the
431 // stack limit is reached. We're happy with our behavior on this test
432 // as long as we don't crash.
433 WONTFIX : fast/js/global-recursion-on-full-stack.html = FAIL
434
435 // Our DOM Storage implementation doesn't use WebKit's private browsing feature (even for incognito mode).
436 WONTFIX : storage/domstorage/localstorage/private-browsing-affects-storage.html = FAIL
437 WONTFIX : storage/domstorage/sessionstorage/private-browsing-affects-storage.htm l = FAIL
438
439 // These tests propagate auth credentials back to the renderer, which we
440 // don't want to do.
441 WONTFIX BUG21840 DEBUG : http/tests/loading/basic-auth-resend-wrong-credentials. html = FAIL
442 WONTFIX BUG21840 LINUX RELEASE : http/tests/loading/basic-auth-resend-wrong-cred entials.html = FAIL
443 WONTFIX BUG21840 SLOW WIN RELEASE : http/tests/loading/basic-auth-resend-wrong-c redentials.html = FAIL
444 WONTFIX BUG21840 MAC RELEASE : http/tests/loading/basic-auth-resend-wrong-creden tials.html = FAIL TIMEOUT
445
446 WONTFIX BUG21840 LINUX : http/tests/loading/basic-credentials-sent-automatically .html = FAIL CRASH
447 WONTFIX BUG21840 WIN : http/tests/loading/basic-credentials-sent-automatically.h tml = FAIL TIMEOUT
448 WONTFIX BUG21840 MAC : http/tests/loading/basic-credentials-sent-automatically.h tml = FAIL
449
450 // This checks the IDN behavior of WebKit/WebKit on Mac, not WebKit/WebCore or
451 // WebKit/JavaScriptCore. Chrome doesn't use WebKit/WebKit, and Chrome's IDN
452 // security model is different from it.
453 BUG21814 WONTFIX SKIP: fast/encoding/idn-security.html = FAIL
454
455 // Our implementation of global history is completely different, and
456 // these tests are irrelevant.
457 BUG23748 WONTFIX : http/tests/globalhistory = FAIL
458
459 // DataGrid was pulled from HTML5 spec, unlikely to re-emerge in the current for m.
460 BUG17585 WONTFIX : fast/dom/HTMLDataGridElement = FAIL
461
462 // We are not going to support submitting a form to about:* pages.
463 // For more details, see discussions at issue 20570.
464 BUG20570 WONTFIX : fast/forms/get-forms-to-about-blank.html = FAIL
465
466 // xhtml mp tests were added in http://trac.webkit.org/changeset/43865 and are
467 // skipped on all platforms upstream.
468 // We are not planning to support these.
469 BUG12254 WONTFIX SKIP : fast/xhtmlmp = FAIL
470
471 // This test requires LayoutTestController.setCacheModel, which we don't impleme nt
472 // because we can't emulate the cahcing behaviors it expects.
473 WONTFIX : fast/dom/HTMLScriptElement/nested-execution.html = FAIL
474
475 // Deletion UI is a Mail-ism. We don't need to worry about this.
476 WONTFIX SKIP : editing/deleting/deletionUI-single-instance.html = FAIL IMAGE
477 WONTFIX SKIP : fast/dom/Element/id-in-deletebutton.html = TEXT
478
479 // Tests for FAST_MOBILE_SCROLLING. We don't use it.
480 WONTFIX BUG32663 WIN LINUX : fast/fast-mobile-scrolling/fixed-position-element.h tml = IMAGE+TEXT
481 WONTFIX BUG32663 WIN LINUX : fast/fast-mobile-scrolling/no-fixed-position-elemen ts.html = IMAGE+TEXT
482 WONTFIX BUG32663 MAC : fast/fast-mobile-scrolling/fixed-position-element.html = IMAGE
483 WONTFIX BUG32663 MAC : fast/fast-mobile-scrolling/no-fixed-position-elements.htm l = IMAGE
484
485 // Tests for frameset flattening. Relevant only on mobile browsers.
486 WONTFIX SKIP : fast/frames/flattening = TIMEOUT
487
488 // This should be tested differently (see discussion on https://bugs.webkit.org/ show_bug.cgi?id=35063).
489 // No need to waste cycles implementing harness support for this variant of the test.
490 WONTFIX SKIP : fast/loader/api-test-go-to-current-back-forward-item.html = TIMEO UT
491
492 // We're not planning to support rocker-based cursor navigation.
493 WONTFIX SKIP : fast/events/spatial-navigation = FAIL
494
495 // We're not planning to relax third-party cookie rules any time soon.
496 WONTFIX BUG37684 SKIP : http/tests/cookies/third-party-cookie-relaxing.html = FA IL
497
498 // -----------------------------------------------------------------
499 // CHROME REWRITTEN TESTS
500 // -----------------------------------------------------------------
501
502 // These tests have been rewritten, with the original being ignored,
503 // because they rely on being able to shadow the 'top' variable on the
504 // global object. For security we disallow shadowing of top.
505 WONTFIX : editing/selection/click-before-and-after-table.html = FAIL
506
507 // We're taking a different approach on this test than Webkit does, related to
508 // whether we create a window via a plugin when target is _blank.
509 BUG24186 WONTFIX SKIP : plugins/get-url-with-blank-target.html = FAIL
510
511 // Dashboard-related test
512 WONTFIX SKIP : platform/mac/fast/css/dashboard-region-parser.html = FAIL
513
514 // Not a test?
515 WONTFIX SKIP : http/tests/incremental/pause-in-script-element.pl = FAIL
516
517 // This tests for an arbitrary limit set in JSCRE to terminate regular
518 // expressions with an exponential matching behavior. Since the V8
519 // regular expression engine can be preempted from the outside, we do not
520 // need to limit the execution this way. Firefox also keeps running
521 // on this one.
522 WONTFIX : fast/regex/slow.html = TIMEOUT
523
524 // Test to verify legacy MAC encodings. We don't want to support them and
525 // have to skip this test.
526 WONTFIX SKIP : fast/encoding/char-decoding-mac.html = FAIL
527
528 // WebKit QT Build-specific tests
529 WONTFIX SKIP : platform/qt/view/fixed-layout-size.html = FAIL
530
531 // These don't have pixel results and rely on ObjC bindings. Don't run until the y have pixel results.
532 WONTFIX SKIP : platform/mac/editing/pasteboard/dataTransfer-set-data-file-url.ht ml = FAIL
533 WONTFIX SKIP : http/tests/security/dataTransfer-set-data-file-url.html = FAIL
534
535 // The issue is which global object to use as the implicit
536 // receiver for cross-frame calls. Currently, IE, Firefox and Chrome
537 // agree and only Safari is doing it this way.
538 BUG5053 WONTFIX : fast/frames/cross-site-this.html = FAIL
539
540 // This tests a Safari incompatibility. This test should fail since
541 // it contains syntax errors that JSC for some reason choose not to
542 // throw. V8 follows the spec.
543 WONTFIX : fast/js/reparsing-semicolon-insertion.html = FAIL
544
545 // These tests relate to transform/3d which is a work in progress and is not
546 // even run by the WebKit folk. They should be enabled whenever WebKit begins
547 // testing them by default. The bug to re-enable is:
548 // http://code.google.com/p/chromium/issues/detail?id=8455
549 WONTFIX SKIP : transforms/3d = FAIL
550
551 // Copying with no selection is sometimes supposed to work
552 // Also skipped by Apple on Windows (rdar://problem/5015941)
553 BUG20404 : editing/execCommand/copy-without-selection.html = FAIL
554
555 // This is a faulty test and need to change so it works on Windows.
556 // onload race condition due to poorly designed test.
557 // Works fine when run stand-alone. Not needed for Beta.
558 // Also skipped by Apple on Windows, due to intermittent failure
559 // (rdar://5313536)
560 // started WIN only, since r30442 fails on all platforms
561 BUG10270 : fast/dom/frame-loading-via-document-write.html = FAIL
562
563 // -----------------------------------------------------------------
564 // LIGHTTPD
565 // -----------------------------------------------------------------
566 // This are failing for different reasons under our new lighttpd configuration
567 // TODO(deanm): Address all of these via lighttpd if possible, otherwise fork.
568 // Maybe flaky and need to be forked?
569
570 // LightTPD doesn't accept unknown HTTP methods
571 BUG30536 SKIP : http/tests/xmlhttprequest/methods-lower-case.html = TIMEOUT CRAS H
572 BUG30536 DEBUG : http/tests/xmlhttprequest/methods-async.html = TIMEOUT TEXT
573 BUG30536 LINUX MAC RELEASE : http/tests/xmlhttprequest/methods-async.html = TIME OUT TEXT
574 BUG30536 WIN RELEASE : http/tests/xmlhttprequest/methods-async.html = TIMEOUT TE XT
575 BUG30536 WIN SLOW : http/tests/xmlhttprequest/access-control-basic-allow-preflig ht-cache-invalidation-by-method.html = FAIL
576 // LightTPD doesn't accept unknown HTTP methods and passes CGIs a Content-Type
577 // even when a request didn't send the header.
578 BUG30536 WIN SLOW : http/tests/xmlhttprequest/methods.html = FAIL
579 BUG30536 LINUX : http/tests/xmlhttprequest/methods.html = FAIL
580 BUG30536 MAC : http/tests/xmlhttprequest/methods.html = FAIL TIMEOUT
581 // Webkit 50667:50696 (Lighttpd related?)
582 BUG30536 WIN : http/tests/xmlhttprequest/xmlhttprequest-setrequestheader-no-valu e.html = TEXT
583
584 // Another lighttpd quirk.
585 BUG8941 WIN SLOW : http/tests/xmlhttprequest/web-apps/013.html = FAIL
586 BUG8941 LINUX SLOW : http/tests/xmlhttprequest/web-apps/013.html = PASS
587 BUG8941 MAC DEBUG SLOW : http/tests/xmlhttprequest/web-apps/013.html = FAIL
588 BUG8941 MAC RELEASE : http/tests/xmlhttprequest/web-apps/013.html = FAIL TIMEOUT
589 BUG8941 WIN : http/tests/xmlhttprequest/web-apps/012.html = FAIL
590
591 // -----------------------------------------------------------------
592 // TEXT
593 // -----------------------------------------------------------------
594
595 // This class of test fails because of size differences in text runs.
596 // Mostly this is because of international text rendering differences.
597
598 // Incrorect results, in incorrect international font metrics.
599 BUG20521 LINUX WIN : fast/text/atsui-multiple-renderers.html = FAIL
600 BUG20521 LINUX WIN : fast/text/atsui-pointtooffset-calls-cg.html = FAIL TIMEOUT
601 BUG20521 LINUX WIN : fast/text/atsui-rtl-override-selection.html = FAIL
602
603 // This test checks that we hack around a bug in helvetica. We fail to.
604 BUG20519 LINUX WIN : fast/text/wide-zero-width-space.html = FAIL
605
606 // More missing international text overides, not needed for Beta.
607 // Capitalization results match Safari, even if "not fully correct"
608 BUG20547 LINUX WIN : fast/text/capitalize-boundaries.html = FAIL
609
610 // Different button line-heights, our behavior looks wrong.
611 BUG20551 LINUX WIN : fast/replaced/table-percent-height.html = FAIL
612 BUG20551 LINUX WIN : fast/replaced/table-percent-height-text-controls.html = FAI L
613
614
615 // -----------------------------------------------------------------
616 // URL
617 // -----------------------------------------------------------------
618
619 // Form submission (GET) on non-standard url does not append a query.
620 // Defering these tests as the expected behavior is wonky, and shouldn't affect
621 // existing apps one way or another.
622 // Implicit expectation in this test is that you can "set query" on a data URL,
623 // and it should replace the first "?" substring. This makes absolutely no
624 // sense.
625 BUG24203 : fast/events/stopPropagation-submit.html = FAIL
626
627 // -----------------------------------------------------------------
628 // PENDING TESTS (forked to pending/, need to be sent upstream)
629 // -----------------------------------------------------------------
630
631 // These tests don't work with fast timers due to setTimeout
632 // races. See https://bugs.webkit.org/show_bug.cgi?id=21536
633 BUG24195 WIN LINUX : fast/repaint/bugzilla-6473.html = IMAGE+TEXT
634 BUG24195 MAC : fast/repaint/bugzilla-6473.html = IMAGE
635
636 // -----------------------------------------------------------------
637 // Tests deferred until we provide support for a particular feature.
638 // -----------------------------------------------------------------
639
640 // -----------------------------------------------------------------
641 // Tests requiring features not currently in test_shell.
642 // -----------------------------------------------------------------
643
644 // These layout tests to see if link colors change after visiting a page. They
645 // does this by using layoutTestController.keepWebHistory() to turn on a
646 // temporary web history. layoutTestController.keepWebHistory() is not
647 // implemented in test shell.
648 // This is a test tool problem, not a Chrome problem.
649 BUG21888 : fast/history/clicked-link-is-visited.html = FAIL
650 BUG21888 : fast/history/subframe-is-visited.html = FAIL
651
652 // Implement layoutTestController.display()
653 BUG8630 WIN LINUX : fast/repaint/body-background-image.html = FAIL
654
655 // Relies on text metrics to pass. Rework to be meaningful for ports other than platform/mac.
656 BUG8630 WIN LINUX : fast/repaint/overflow-outline-repaint.html = FAIL
657 BUG8630 WIN LINUX : fast/backgrounds/solid-color-context-restore.html = FAIL
658 BUG8630 WIN LINUX : fast/dynamic/containing-block-change.html = FAIL
659 BUG8630 LINUX : fast/forms/listbox-clip.html = IMAGE+TEXT
660 BUG8630 WIN LINUX RELEASE : fast/overflow/hidden-scrollbar-resize.html = FAIL
661 BUG8630 LINUX WIN DEBUG : fast/overflow/hidden-scrollbar-resize.html = FAIL
662 BUG8630 WIN LINUX RELEASE : fast/reflections/inline-crash.html = FAIL
663 BUG8630 LINUX WIN DEBUG : fast/reflections/inline-crash.html = FAIL
664 BUG8630 WIN LINUX : fast/text/font-initial.html = FAIL
665 BUG8630 LINUX : svg/custom/use-detach.svg = FAIL PASS
666 BUG18772 LINUX : fast/backgrounds/001.html = FAIL
667
668 // Need to implement layoutTestController.addUserScript.
669 BUG21113 : userscripts/mixed-case-stylesheet.html = TEXT
670
671 // Need a setAuthorAndUserStylesEnabled method in
672 // layoutTestController. Now we have preference to enable/disable user
673 // styles(not work now), we still need to add a preference to enable/disable
674 // styles of both author and user.
675 // Deferring, we don't support user-controlled UA stylesheets (in beta)
676 // Actually, gonna SKIP because it causes an additional error message in:
677 // fast/css/display-none-inline-style-change-crash.html somehow
678 // the message is dumped after the #EOF, which causes an additional
679 // error in the header of the following test.
680 BUG24197 SKIP : fast/css/disabled-author-styles.html = FAIL
681
682 // Need to implement
683 // layoutTestController.setDomainRelaxationForbiddenForURLScheme()
684 BUG32674 WIN LINUX MAC : http/tests/security/setDomainRelaxationForbiddenForURLS cheme.html = TEXT
685
686 // -----------------------------------------------------------------
687 // Other
688 // -----------------------------------------------------------------
689
690 // Pixeltest failure: Form control metrics incorrect
691 BUG10273 LINUX : http/tests/navigation/javascriptlink-frames.html = FAIL
692
693 // Mac Safari under certain circumstances automatically places
694 // a caret in editable document even when none was requested programatically.
695 // We don't intend to copy this feature (at least not for Beta).
696 BUG20844 LINUX WIN RELEASE : editing/selection/designmode-no-caret.html = FAIL
697 BUG20844 LINUX WIN DEBUG : editing/selection/designmode-no-caret.html = FAIL
698
699 // Directionality of mixed-direction text in selected choice should
700 // match that in the <select> option lists.
701 // Low priority, unclear if test expectations are correct (see bug)
702 BUG6139 : fast/forms/select-writing-direction-natural.html = FAIL
703
704 // We don't support NPN_Enumerate, but don't know of any plugin
705 // which depends on that functionality. So we ignore this for beta.
706 BUG21901 : plugins/netscape-enumerate.html = FAIL
707
708 // Expectations for this test changed upstream. We should fix this test, but
709 // it doesn't need to block the current release
710 BUG10275 : http/tests/security/cross-frame-access-put.html = FAIL
711
712 // Due to differences in error pages. Needs re-baselining.
713 BUG24208 WIN DEBUG : http/tests/navigation/post-goback1.html = FAIL
714 BUG24208 SLOW WIN RELEASE : http/tests/navigation/post-goback1.html = FAIL
715 BUG24208 LINUX MAC : http/tests/navigation/post-goback1.html = FAIL
716
717 // Requires layoutTestController.dispatchPendingLoadRequests
718 BUG33211 : http/tests/loading/deleted-host-in-resource-load-delegate-callback.ht ml = TIMEOUT
719
720 // HTML5 DB layout tests
721 BUG27697 SKIP : storage/hash-change-with-xhr.html = PASS
722 // We do not use Safari's private browsing
723 WONTFIX SKIP : storage/private-browsing-readonly.html = PASS
724
725 // Implement HTML5 Geolocation API.
726 BUG11246 DEFER SKIP : fast/dom/Geolocation = FAIL
727 BUG11246 DEFER SKIP : fast/dom/Window/window-properties-geolocation.html = TEXT
728
729 // Implement HTML5 EventSource API. Skipping, because most of these time out and
730 // slow down the test run.
731 BUG19625 SKIP : fast/eventsource = TIMEOUT
732 BUG19625 SKIP : http/tests/eventsource = TIMEOUT
733
734 // HTML5 datalist element. We don't enable it because WebKit implementation
735 // is incomplete.
736 BUG20226 DEFER : fast/forms/datalist-nonoption-child.html = TEXT
737 BUG20226 DEFER : fast/forms/datalist.html = TEXT
738 BUG20226 DEFER : fast/forms/input-list.html = FAIL
739 BUG20226 DEFER : fast/forms/input-selectedoption.html = FAIL
740
741 // Add support for inspector layout tests.
742 BUG26734 LINUX MAC SKIP : inspector = PASS
743 BUG26734 LINUX MAC SKIP : http/tests/inspector = PASS
744 BUG26734 SKIP : inspector/console-format-collections.html = TEXT
745 BUG26734 SKIP : inspector/console-format.html = TEXT
746
747 // These tests are disabled until <audio> and <video> tags are supported.
748 // Disable <video> and <audio> tests for mac and linux until there is
749 // proper support.
750 BUG13907 : fast/layers/video-layer.html = FAIL
751 BUG4363 LINUX MAC SKIP : fast/media = PASS FAIL
752 BUG4363 LINUX MAC SKIP : http/tests/security/local-video-poster-from-remote.html = FAIL TIMEOUT
753 BUG4363 LINUX MAC SKIP : http/tests/security/local-video-src-from-remote.html = PASS FAIL
754 BUG13907 SKIP : http/tests/security/local-video-source-from-remote.html = FAIL
755 BUG13907 SKIP : http/tests/media = FAIL
756
757 // Linux debug media tests have spurious timeouts and it's annoying. We have no idea why.
758 BUG13907 BUG25094 LINUX DEBUG : media = PASS FAIL TIMEOUT
759
760 // These tests should be passing. Remove them once confirmed they're not flaky.
761 BUG9798 BUG13907 SLOW WIN LINUX : media/video-played-collapse.html = PASS FAIL
762 BUG9798 BUG13907 SLOW MAC : media/video-played-collapse.html = PASS
763
764 // We output an extra playing event and video durations are different.
765 BUG13907 SKIP : media/video-loop.html = FAIL
766
767 // This one times out occasionally.
768 BUG13907 WIN DEBUG : media/video-load-networkState.html = PASS TIMEOUT
769 BUG13907 SLOW WIN RELEASE : media/video-load-networkState.html = PASS
770
771 // We occasionally fail to perform the third seek.
772 BUG13907 LINUX DEBUG : media/video-seeking.html = PASS FAIL
773
774 // Seeking to 500s causes us to seek to 0s and continue playing (expected), but WebKit checks too fast.
775 // The test uses setTimeout() and is flaky.
776 BUG13907 : media/video-seek-past-end-playing.html = FAIL
777
778 // We sometimes emit an error from the same source element twice.
779 BUG9798 BUG13907 DEBUG : media/video-source-error.html = FAIL PASS
780 BUG9798 BUG13907 SLOW WIN RELEASE : media/video-source-error.html = FAIL PASS
781
782 // Failing because we sometimes emit additional timeupdate events.
783 // Test may need to be rewritten or only log the first timeupdate event.
784 BUG13907 LINUX WIN : media/audio-delete-while-slider-thumb-clicked.html = PASS F AIL
785 BUG13907 MAC : media/audio-delete-while-slider-thumb-clicked.html = FAIL
786
787 // Failing because we sometimes emit additional timeupdate events.
788 // Test might be WONTFIX because we don't export a step button in the first plac e.
789 BUG13907 BUG25375 SKIP : media/audio-delete-while-step-button-clicked.html = FAI L
790
791 // Will be fixed when https://bugs.webkit.org/show_bug.cgi?id=30435 lands.
792 BUG13907 SKIP : media/audio-constructor-src.html = TIMEOUT
793 BUG13907 SKIP : media/audio-play-event.html = TIMEOUT
794 BUG13907 SKIP : media/video-no-audio.html = TIMEOUT
795 BUG13907 SKIP : media/video-source-add-src.html = TIMEOUT
796
797 // Seeks to the end of file, which results in ogg packets with no timestamps.
798 BUG13907 SKIP : media/event-attributes.html = TIMEOUT
799
800 // The media time display isn't appearing.
801 BUG13907 SKIP : media/video-zoom-controls.html = FAIL
802
803 // The video appears as a white box on Windows.
804 BUG13907 SKIP WIN : media/video-zoom.html = FAIL
805
806 // Video has a green background, probably due to Mac repaint debugging code.
807 BUG13907 BUG25376 MAC DEBUG : media/video-empty-source.html = FAIL
808
809 // The media time display is getting styled when it shouldn't be.
810 BUG13907 : media/controls-styling.html = FAIL
811
812 // These tests are flaky with subtle pixel differences.
813 BUG9798 BUG13907 LINUX MAC : media/video-transformed.html = IMAGE PASS
814 BUG9798 BUG13907 LINUX MAC : media/video-layer-crash.html = IMAGE PASS
815
816 // These tests are failing because they use position-dependent mouse clicks.
817 BUG13907 BUG25375 : media/video-controls-transformed.html = FAIL
818
819 // These tests are WONTFIX because they use codecs Chromium doesn't support.
820 BUG16779 WONTFIX SKIP : media/video-can-play-type.html = FAIL TIMEOUT
821 BUG16779 WONTFIX SKIP : media/video-document-types.html = FAIL TIMEOUT
822 BUG16779 WONTFIX SKIP : media/audio-mpeg-supported.html = FAIL TIMEOUT
823 BUG16779 WONTFIX SKIP : media/audio-data-url.html = FAIL TIMEOUT
824 BUG16779 WONTFIX SKIP : media/video-size-intrinsic-scale.html = FAIL TIMEOUT
825
826 // Skipped to reduce crashiness during a test run.
827 BUG38444 SKIP : media/video-append-source.html = CRASH PASS TIMEOUT
828
829 // Function arguments object is copied for each access.
830 BUG24194 : fast/js/kde/function_arguments.html = FAIL
831
832 // We don't support dynamic fonts on Linux.
833 // Once we have the sandbox working, we should re-evaluate this.
834 BUG10278 LINUX : fast/css/font-face-implicit-local-font.html = FAIL
835 BUG10278 LINUX : fast/css/font-face-unicode-range.html = FAIL
836
837 // The v8 bindings allow shadowing of all properties on the global
838 // object. If you use 'var prop = value' you will get a new variable
839 // named prop that shadows builtin properties on the global object.
840 // This behavior is consistent and I'm reluctant to make the massive
841 // change that would be needed to implement the inconsistent handling
842 // of this that KJS has (some properties can be shadowed and others
843 // can't). This should have low priority.
844 // We currently match IE and the plan was to convince KJS to change
845 // post-beta, but the bug is here:
846 // https://bugs.webkit.org/show_bug.cgi?id=16644 , and it's unclear
847 // what the resolution was.
848 BUG10279 : fast/js/var-declarations-shadowing.html = FAIL
849
850 // Implement full JSON support in V8
851 BUG14885 SLOW : fast/js/JSON-parse.html = FAIL
852 BUG14885 SLOW : fast/js/JSON-stringify.html = FAIL
853 BUG14885 : fast/js/JSON-parse-reviver.html = FAIL
854 BUG14885 : fast/js/JSON-stringify-replacer.html = FAIL
855
856 // User stylesheets not currently supported by chrome.
857 // Webkit supports them by doing filesystem operations directly.
858 // This is disallowed in a sandboxed renderer. The test fails in
859 // test_shell.exe because the necessary filesystem stubs are notImplemented(),
860 // and would need to be proxied through the browser
861 BUG24199 : http/tests/security/local-user-CSS-from-remote.html = FAIL
862
863 // Implement CSS -webkit-font-smoothing property support.
864 BUG23270 WIN LINUX : fast/css/font-smoothing.html = FAIL
865
866 // Make canvas shadow work with drawImage.
867 BUG11153 WIN LINUX : fast/canvas/canvas-incremental-repaint-2.html = FAIL
868 BUG11153 WIN LINUX : fast/canvas/canvas-incremental-repaint.html = FAIL
869
870 // Repaint issues are revealed by these tests.
871 BUG28183 : fast/repaint/box-shadow-v.html = IMAGE
872 // The difference of positions of texts after the list markers is NOT
873 // an issue. The behavior of the expectations was wrong. The real
874 // problem is the change of the 'p' in italic "properly". Note that
875 // upstream expectation image has the same issue.
876 BUG28183 WIN LINUX : fast/repaint/list-marker.html = IMAGE
877
878 BUG20507 : http/tests/uri/resolve-encoding-relative.html = FAIL
879
880
881 // Flaky: fails about 5% of the time.
882 BUG31342 WIN RELEASE : security/block-test-no-port.html = TEXT PASS
883 BUG31342 WIN RELEASE : security/block-test.html = TEXT PASS
884
885 // Fails in debug. Windows used to be only flaky, but now fails consistently
886 // starting with the 52554->52633 merge.
887 BUG31363 DEBUG WIN LINUX : platform/chromium/fast/dom/interval.html = TEXT PASS
888
889 // -----------------------------------------------------------------
890 // SVG TESTS
891 // -----------------------------------------------------------------
892
893 // These are regressions from 1.0, but deemed DEFERable for 2.0.
894
895 BUG8763 LINUX WIN MAC : svg/custom/use-on-g-containing-foreignObject-and-image.s vg = IMAGE
896
897 // We show reduced version of the entire SVN image rather than an image
898 BUG23463 MAC : svg/W3C-SVG-1.1/struct-symbol-01-b.svg = IMAGE
899 BUG23463 MAC : svg/W3C-SVG-1.1/struct-use-01-t.svg = IMAGE
900 BUG23463 WIN LINUX : svg/W3C-SVG-1.1/struct-symbol-01-b.svg = IMAGE+TEXT
901 BUG23463 WIN LINUX : svg/W3C-SVG-1.1/struct-use-01-t.svg = IMAGE+TEXT
902 BUG23463 WIN LINUX : svg/W3C-SVG-1.1/struct-image-02-b.svg = IMAGE+TEXT
903
904 // Merge 39744:39829 - regression
905 BUG10284 MAC : svg/custom/path-bad-data.svg = FAIL
906
907 // Merge 39744:39913? - regressions
908 BUG10286 LINUX : svg/W3C-SVG-1.1/animate-elem-02-t.svg = FAIL
909
910
911 // Bug in Skia, see https://bugs.webkit.org/show_bug.cgi?id=24534 .
912
913 // Text fails very rarely, 1/200 runs or fewer.
914 BUG29737 LINUX DEBUG : svg/W3C-SVG-1.1/filters-light-01-f.svg = TEXT PASS
915 BUG29737 MAC : svg/W3C-SVG-1.1/filters-light-01-f.svg = TEXT PASS
916 BUG29737 LINUX MAC DEBUG : svg/W3C-SVG-1.1/filters-specular-01-f.svg = TEXT PASS
917
918 // -----------------------------------------------------------------
919 // End SVG Regressions
920 // -----------------------------------------------------------------
921
922 // Selection wrong.
923 BUG10292 MAC LINUX : editing/selection/5354455-1.html = FAIL
924
925 // Compact support was removed from WebKit by Hyatt and layout tests rebaselined in r40259.
926
927 BUG10295 MAC : fast/dom/prototype-chain.html = FAIL
928
929 // Font differences, requiring overriden metrics, not a real bug, not fixing for Beta
930 BUG10296 MAC : fast/text/international/bidi-menulist.html = FAIL
931 BUG10296 LINUX : fast/transforms/transform-on-inline.html = FAIL
932 BUG10296 LINUX : fast/transforms/transform-table-row.html = FAIL
933 BUG10296 LINUX : svg/batik/paints/patternPreserveAspectRatioA.svg = FAIL TIMEOUT
934 // Maybe need to be rebaselined - should be looked at in more detail.
935 BUG10296 LINUX : svg/custom/foreign-object-skew.svg = FAIL
936 BUG10296 LINUX : svg/batik/text/textLength.svg = FAIL
937
938 // No anti-aliasing on the text.
939 BUG10298 LINUX : svg/custom/use-on-disallowed-foreign-object-3.svg = FAIL
940
941 // The failures listed below have never passed in Chromium and need to be
942 // investigated, categorized, and (one hopes) fixed.
943
944 // These test fail full text diff (but not simplified diff) most likely due
945 // to differing implementations of SVG fonts. They may or may not represent
946 // real bugs which need fixin'
947
948 // There's no baseline at all for this!
949 BUG32392 SKIP : svg/batik/text/smallFonts.svg = FAIL
950
951 // The test is flaky and maybe platform-dependent.
952 BUG32401 LINUX WIN : svg/custom/marker-changes.svg = IMAGE+TEXT IMAGE
953
954 BUG32444 LINUX WIN : svg/hixie/text/003.html = FAIL
955
956 // SVG combined with font metrics.
957 BUG24198 LINUX : svg/hixie/text/001-broken.xml = FAIL
958
959 // SVG masks aren't quite working yet.
960 // Might also be related to https://bugs.webkit.org/show_bug.cgi?id=21910
961 // New tests. We should fix these, but they don't need to block the current rele ase
962 BUG3244 LINUX WIN : fast/backgrounds/svg-as-mask.html = FAIL
963 BUG3244 WIN DEBUG : fast/backgrounds/animated-svg-as-mask.html = FAIL
964 BUG3244 SLOW WIN RELEASE : fast/backgrounds/animated-svg-as-mask.html = FAIL
965 BUG3244 LINUX : fast/backgrounds/animated-svg-as-mask.html = FAIL
966 // More tests that fail because of masks not working properly.
967 // New tests. We should fix these, but they don't need to block the current rele ase
968 BUG3244 WIN LINUX : fast/backgrounds/mask-composite.html = FAIL
969 BUG3244 WIN LINUX : fast/backgrounds/repeat/mask-negative-offset-repeat.html = F AIL
970 // Marking this again as failed. This test failed even after rebaseline due to
971 // the fact that the font is not specified in the test and it seems that the
972 // test falls back on a different font locally than on the buildbot so the
973 // baseline is invalid. This might indicate a failure in our font fallback code
974 // or might be expected and that we should either go with the buildbot output
975 // or change the test upstream to specify explicitly what font to use.
976 // The mask part of this test is totally wrong.
977 BUG3244 LINUX WIN : fast/backgrounds/svg-as-background-6.html = FAIL
978
979 BUG10302 LINUX : svg/W3C-SVG-1.1/pservers-grad-10-b.svg = FAIL
980
981 BUG10303 LINUX : svg/custom/pattern-rotate.svg = FAIL
982
983 // I find it hard to care too much about SVG failures.
984 BUG10304 LINUX : svg/W3C-SVG-1.1/animate-elem-04-t.svg = FAIL
985 BUG10304 LINUX : svg/W3C-SVG-1.1/animate-elem-05-t.svg = FAIL
986 BUG10304 LINUX : svg/W3C-SVG-1.1/animate-elem-06-t.svg = FAIL
987 BUG10304 LINUX : svg/W3C-SVG-1.1/animate-elem-07-t.svg = FAIL
988 BUG10304 LINUX RELEASE: svg/W3C-SVG-1.1/animate-elem-30-t.svg = IMAGE
989 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-desc-02-t.svg = FAIL
990 BUG10304 LINUX : svg/W3C-SVG-1.1/interact-zoom-01-t.svg = FAIL
991 BUG10304 LINUX : svg/W3C-SVG-1.1/text-spacing-01-b.svg = FAIL
992 BUG10304 LINUX : svg/W3C-SVG-1.1/text-text-01-b.svg = FAIL
993 BUG10304 LINUX : svg/carto.net/slider.svg = FAIL
994 BUG10304 LINUX : svg/carto.net/textbox.svg = FAIL
995 BUG10304 LINUX : svg/carto.net/window.svg = FAIL
996 BUG10304 LINUX : svg/custom/coords-relative-units-transforms.svg = FAIL
997 BUG10304 LINUX : svg/custom/use-referencing-nonexisting-symbol.svg = FAIL
998 BUG10304 LINUX RELEASE : svg/hixie/perf/003.xml = FAIL
999 BUG10304 LINUX DEBUG : svg/hixie/perf/003.xml = FAIL
1000 BUG10304 LINUX : svg/hixie/perf/004.xml = FAIL
1001 BUG10304 LINUX : svg/hixie/perf/005.xml = FAIL
1002 BUG10304 LINUX RELEASE : svg/hixie/perf/006.xml = FAIL
1003 BUG10304 LINUX DEBUG : svg/hixie/perf/006.xml = FAIL
1004 BUG10304 LINUX : svg/hixie/text/003b.xml = FAIL
1005 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-01-t.svg = FAIL
1006 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-02-t.svg = FAIL
1007 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-03-b.svg = FAIL
1008 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-04-b.svg = FAIL
1009 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-05-t.svg = FAIL
1010 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-06-t.svg = FAIL
1011 BUG10304 LINUX : svg/W3C-SVG-1.1/fonts-elem-07-b.svg = FAIL
1012 // Our gradients are wrong here.
1013 BUG19559 WIN LINUX : svg/W3C-SVG-1.1/pservers-grad-08-b.svg = FAIL
1014 BUG10304 LINUX : svg/carto.net/button.svg = FAIL
1015
1016 // Probably need to change the test upstream to describe it better and use no
1017 // hard coded numbers.
1018 BUG19897 WIN LINUX : svg/custom/getscreenctm-in-mixed-content2.xhtml = FAIL
1019
1020 BUG10306 LINUX : svg/carto.net/combobox.svg = FAIL
1021
1022 // Linux pixeltest failure: slightly different shade of composited
1023 // alpha in bottom group.
1024 BUG10310 LINUX : svg/W3C-SVG-1.1/masking-opacity-01-b.svg = FAIL
1025
1026 // Image mismatch since WebKit r49757.
1027 // The difference is hard to tell, but our gradation is slightly different
1028 // (blue is too strong on the gradation).
1029 // Pixel dump was updated on upstream but our rendering did not change.
1030 BUG25175 MAC : svg/custom/grayscale-gradient-mask.svg = IMAGE
1031
1032 // -----------------------------------------------------------------
1033 // Accessibility layout tests
1034 //
1035 // In addition to WebCore, these are meant to exercise platform APIs
1036 // (MSAA, NSAccessibility, ATK). Since we don't have access to these in the
1037 // sandbox, making these tests pass involves faking interactions with these APIs
1038 // and doesn't seem like a good use of our time.
1039 // We DEFER or WONTFIX these, because we need to first identify a good
1040 // testing strategy for Chromium accessibility. It is possible we won't use
1041 // these at all.
1042
1043 BUG10322 DEFER SKIP : accessibility = PASS FAIL
1044 BUG10322 DEFER SKIP : platform/mac/accessibility = PASS FAIL
1045 BUG10322 DEFER SKIP : platform/win/accessibility = PASS FAIL
1046
1047 // -----------------------------------------------------------------
1048 // Other failures
1049 // -----------------------------------------------------------------
1050
1051 // These fail the pixel tests in debug mode because they have
1052 // unpainted space (filled red in Debug but not in Release).
1053 // https://bugs.webkit.org/show_bug.cgi?id=8423
1054 BUG24204 WIN LINUX : tables/mozilla_expected_failures/bugs/bug178855.xml = IMAGE +TEXT
1055
1056 // Fails on webkit windows as well.
1057 BUG24207 : fast/events/attempt-scroll-with-no-scrollbars.html = FAIL
1058
1059 // The test may require a proper version of Java 6 RC 10 plugin
1060 // installed to run.
1061 BUG10313 : plugins/bindings-test.html = FAIL
1062
1063 // No glyph for U+FFFD (Replacement Character : black diamond with
1064 // question mark) in them
1065 BUG10315 WIN : fast/encoding/invalid-UTF-8.html = FAIL
1066
1067 // V8 failures as a result of the WebKit merge.
1068 // http://code.google.com/p/v8/issues/detail?id=92
1069
1070 // v8: A setter that is added to a prototype after the inline cache is
1071 // recorded will not be called.
1072 BUG24209 : fast/js/pic/cached-prototype-setter.html = FAIL
1073
1074 // We have the wrong shadow for "This".
1075 // It appears we're not obeying the "transparent" fill color.
1076 BUG10317 LINUX : fast/css/shadow-multiple.html = FAIL
1077
1078 // Problems with getImageData and toDataURL.
1079 // This test requires us to do alpha blending exactly the way CG does it,
1080 // which Skia may never do (see bug).
1081 BUG22700 LINUX WIN : fast/canvas/canvas-getImageData.html = FAIL
1082
1083 // We're much closer now. To fully pass this we need encoders for jpg
1084 // and gif, which is a low priority.
1085 BUG10318 WIN LINUX : fast/canvas/toDataURL-supportedTypes.html = FAIL
1086
1087 // This test finishes while in the middle of a CSS animation. This is
1088 // intentional, but it makes pixel results unreliable.
1089 // http://bugs.webkit.org/show_bug.cgi?id=21491
1090 // CSS animations should not block our next release.
1091 BUG10320 WIN LINUX : transitions/opacity-transition-zindex.html = PASS FAIL
1092
1093 // Issue 3273: TextInputController::firstRectForCharacterRange not implemented.
1094 BUG3273 : editing/selection/move-left-right.html = FAIL
1095 BUG3273 MAC : platform/mac/editing/input/caret-primary-bidi.html = FAIL
1096 BUG3273 MAC : platform/mac/editing/input/firstrectforcharacterrange-plain.html = FAIL
1097 BUG3273 MAC : platform/mac/editing/input/range-for-empty-document.html = FAIL
1098 // WebKit 50358:50395
1099 BUG3273 : fast/text/international/thai-cursor-position.html = TEXT
1100 // WebKit roll 51512:51524
1101 BUG3273 : editing/selection/5825350-1.html = FAIL
1102 BUG3273 : editing/selection/5825350-2.html = FAIL
1103 BUG3273 : editing/selection/mixed-editability-10.html = FAIL
1104
1105 // Regression from the 41362:41402 merge.
1106 BUG8402 MAC : fast/forms/drag-out-of-textarea.html = FAIL
1107
1108 // GURL doesn't handle switching from standard URL to path URL correctly
1109 BUG27914 : fast/dom/HTMLAnchorElement/set-href-attribute-protocol.html = TEXT
1110
1111 // ----------------------------------------------------------------------------
1112 // NEW FOR THE MERGE
1113 //
1114 // These tests need to have their output inspected to make sure it's reasonable
1115 // and then baselined if necessary.
1116 // ----------------------------------------------------------------------------
1117
1118 // This test isn't hanging, it just takes 12-13 seconds to run.
1119 BUG30536 SLOW WIN LINUX : http/tests/misc/acid3.html = FAIL
1120 BUG30536 : http/tests/misc/favicon-as-image.html = FAIL
1121
1122 // Has failed for Chromium since it was first checked in. (Lighttpd related?)
1123 BUG10323 WIN : http/tests/xmlhttprequest/xmlhttprequest-no-content-length-onProg ress.html = FAIL
1124
1125 // Times out because this uses dom storage which we don't implement.
1126 BUG4360 : security/autocomplete-cleared-on-back.html = TIMEOUT
1127
1128 // Post-MERGE failures: these will all need to be fixed one day
1129
1130 // Linux pixeltest failure: caret is in the wrong place
1131 // Upstream WebKit also skips this test and Safari with latest WebKit shows
1132 // same behavior as Chromium. Not required for beta so marking as deferred.
1133 BUG10324 : editing/selection/caret-rtl-2.html = IMAGE
1134
1135 // This test assumes we're using unix paths and looks for a file:///test
1136 // path. We correctly return file:///C:/test on Windows. We should fix
1137 // upstream
1138 // Expectations for this test changed upstream. We should fix this test, but
1139 // it doesn't need to block the current release
1140 BUG10325 WIN : fast/dom/resource-locations-in-created-html-document.html = FAIL
1141
1142 // GURL/KURL difference in handling of "http:".
1143 // New test. We should fix it, but it doesn't need to block the current release
1144 BUG7386 : http/tests/security/postMessage/invalid-origin-throws-exception.html = FAIL
1145
1146 // Linux pixeltest failure: Font mismatch
1147 BUG10327 LINUX : tables/mozilla_expected_failures/bugs/bug14007-2.html = FAIL
1148
1149 // On Linux, we don't seem to be getting Helvetica Bold for all cases.
1150 BUG10328 LINUX : fast/css/font-face-multiple-faces.html = FAIL
1151
1152 // Got flakey (both debug and release) around r3581 (ananta).
1153 // New test. We should fix it, but it doesn't need to block the current release
1154 BUG10329 WIN : http/tests/plugins/geturlnotify-from-npp-destroystream.html = FAI L
1155
1156 // Uses ahem font and expects line heights to match some pixel value.
1157 // We should be able to pass this -- not sure what's wrong.
1158 BUG10331 LINUX : css2.1/t1008-c44-ln-box-02-d-ag.html = FAIL
1159
1160 // Looks like we're failing the test -- there are red boogers in the box that sh ould be all green.
1161 BUG10332 LINUX : css2.1/t1605-c545-txttrans-00-b-ag.html = FAIL
1162
1163 // Asks for "system" fonts, which we don't support at all.
1164 BUG10335 LINUX : fast/css/css2-system-fonts.html = FAIL
1165
1166 // Large fonts have different metrics.
1167 BUG10336 LINUX : fast/css/font-face-descriptor-multiple-values.html = FAIL
1168
1169 // Wants Helvetica, Monaco. It's still testing something useful, but we may
1170 // need to check in a wrong-looking baseline. Windows looks wrong too.
1171 BUG10337 LINUX : fast/css/font-face-locally-installed.html = FAIL
1172
1173 // Font metrics wrong, despite using Lucida Grande?
1174 BUG10338 LINUX : fast/events/updateLayoutForHitTest.html = FAIL
1175
1176 // Layout totally different -- wrong font selected?
1177 BUG10340 LINUX : fast/frames/viewsource-attribute.html = FAIL
1178
1179 // Linux flaky: sometimes I get scrollbars and sometimes not.
1180 BUG10341 LINUX : fast/lists/001.html = FAIL
1181
1182 // We fail to load a file URL with a port number -- how does this work on
1183 // Windows?
1184 BUG10342 LINUX MAC : fast/loader/file-URL-with-port-number.html = TIMEOUT
1185
1186 // Text doesn't display at all -- maybe we don't have the slow font
1187 // code enabled?
1188 BUG10343 LINUX : fast/text/atsui-kerning-and-ligatures.html = FAIL
1189 BUG10343 LINUX RELEASE : fast/text/atsui-partial-selection.html = FAIL
1190 BUG10343 LINUX : fast/text/atsui-small-caps-punctuation-size.html = FAIL
1191
1192 // Started timing out with agl's complext text change. Page is verrry slow.
1193 BUG10343 SKIP LINUX : fast/text/large-text-composed-char.html = TIMEOUT FAIL
1194
1195 // Missing text -- slow font path unimplemented?
1196 BUG10344 LINUX : fast/text/should-use-atsui.html = FAIL
1197
1198 // We print to stderr when a failure happens while importing XSL;
1199 // should disable this in libxml.
1200 BUG10347 MAC : fast/xsl/transform-xhr-doc.xhtml = FAIL
1201
1202 // Linux pixeltest failure: Failing to apply style
1203 BUG10349 LINUX : fast/forms/select-style.html = FAIL
1204
1205 // Linux pixeltest failure: The text suggests that the radios should not
1206 // overlap, but it's very close and quite different from the Windows version
1207 BUG10350 LINUX : fast/replaced/width100percent-radio.html = FAIL
1208
1209 // These tests are marked as failing on Linux because they depend on QuickTime.
1210 // See the bug for more discussion.
1211 BUG15797 LINUX : fast/dom/object-embed-plugin-scripting.html = FAIL
1212 BUG15797 LINUX : plugins/embed-attributes-setting.html = FAIL CRASH
1213
1214 // Skip because we throw an exception before we get to dumpAsText.
1215 BUG10351 SKIP MAC : http/tests/plugins/geturlnotify-from-npp-destroystream.html = FAIL
1216 BUG10351 MAC : plugins/inner-html-display-none.html = FAIL
1217 BUG10351 MAC : plugins/mouse-events.html = FAIL
1218 // BUG10667 SLOW MAC RELEASE : plugins/iframe-shims.html = FAIL
1219
1220 // NEW FOR MERGE 36102:37604
1221
1222 BUG32184 : fast/js/arguments.html = FAIL
1223 // See bug http://code.google.com/p/chromium/issues/detail?id=7868,
1224 // not urgent for current release.
1225 BUG24227 : http/tests/plugins/local-geturl-from-remote.html = FAIL
1226
1227 // This test sometimes fails indefinitely, other times it takes 1-2 seconds.
1228 BUG14009 WIN : http/tests/misc/dns-prefetch-control.html = TIMEOUT PASS
1229
1230 // NEW FOR MERGE 37604:38097
1231 // This is a Safari specific test used to document the set of global
1232 // constructors they expose and the exact way they are printed. Not
1233 // important - we might even want to ignore it.
1234 // New tests. We should fix these, but they doesn't need to block the current
1235 // release
1236 BUG10354 WIN LINUX : fast/layers/opacity-transforms.html = FAIL
1237
1238 // MERGE 38389:38450
1239 // Form submit causes invalid page reload/navigation when action is a named
1240 // anchor
1241 BUG10357 : fast/dom/cssTarget-crash.html = TIMEOUT PASS
1242
1243 // MERGE 38500:39550: New tests
1244 // Missing expected results
1245 BUG10358 SKIP MAC LINUX : animations/animation-drt-api.html = PASS
1246
1247 // New test. We should fix it, but it doesn't need to block the current release
1248 BUG10361 WIN : http/tests/misc/single-character-pi-stylesheet.xhtml = FAIL
1249
1250 // Windows is missing the green box. Started to pass in roll to WebKit r50313
1251 BUG8729 WIN DEBUG : http/tests/multipart/invalid-image-data.html = FAIL
1252 BUG8729 SLOW WIN RELEASE : http/tests/multipart/invalid-image-data.html = FAIL
1253
1254 // This test got considerably more flaky for DEBUG when we switched from
1255 // lighttpd to apache on the linux bots. For RELEASE, this was not flaky until
1256 // we sharded the http.
1257 BUG9798 LINUX : http/tests/multipart/invalid-image-data.html = PASS IMAGE
1258
1259 // -----------------------------------------------------------------
1260 // MAC PORT TESTS
1261 // -----------------------------------------------------------------
1262
1263 //
1264 // *** TESTS TO WORK ON FIRST ***
1265 // These tests fail because of work that needs to be done in Mac TestShell to
1266 // bring it up to par with Win TestShell. These tests pass on Win and should
1267 // pass on Mac once we fix the bugs.
1268 //
1269
1270 // We've bucketed tests into groupings for why they're failing. Please try
1271 // to add new failures in the appropriate bucket.
1272
1273 // text fields wrong width
1274 BUG10363 MAC : tables/mozilla/bugs/bug53690-1.html = FAIL
1275 BUG10363 MAC : tables/mozilla/bugs/bug9024.html = FAIL
1276
1277 // we're waiting on upstreaming a change to how textarea padding works. rather
1278 // than rebasing, we'll wait for the upstream (which ojan said should happen
1279 // early in Jan 09).
1280 BUG10364 MAC : fast/css/resize-corner-tracking.html = FAIL
1281 BUG10364 MAC : http/tests/navigation/reload-subframe-object.html = FAIL
1282
1283 // bad key event handling
1284 BUG10366 MAC : fast/events/option-tab.html = FAIL
1285
1286 // selection
1287 BUG10369 MAC : editing/selection/5109817.html = FAIL
1288 BUG10369 LINUX : editing/selection/5354455-2.html = FAIL
1289
1290 // incorrect layout
1291 BUG10370 MAC : fast/css/font-weight-1.html = FAIL
1292
1293 // Not really sure why these are failing at the moment
1294 BUG10376 MAC : fast/dom/isindex-002.html = FAIL
1295
1296 // These two have a different object type in the dom dump. Plugin-related.
1297 // Ignored on Win/Linux because they rely on QT to provide a TIFF decoder.
1298 BUG10378 MAC : fast/images/embed-image.html = FAIL
1299 BUG10378 MAC : fast/images/object-image.html = FAIL
1300
1301 BUG10381 LINUX RELEASE : svg/W3C-SVG-1.1/animate-elem-03-t.svg = FAIL
1302 BUG10381 LINUX DEBUG : svg/W3C-SVG-1.1/animate-elem-03-t.svg = FAIL
1303
1304 // The following are flaky in that some times the timeout or crash, but we think
1305 // it is because of bugs in other parts of the code and not specific to what
1306 // these tests are doing. The are being noted here so we can get the buildbots
1307 // green so new mac regressions are caught much quicker.
1308 // (there are a few others marked w/ multiple status like this in other parts of
1309 // the file, but they were left there as the comments in those areas are valid.)
1310 BUG10384 MAC SLOW : fast/dom/Window/new-window-opener.html = FAIL
1311 BUG10384 MAC : fast/forms/focus2.html = FAIL
1312
1313 BUG10399 MAC : fast/encoding/char-encoding-mac.html = FAIL
1314
1315 // Broken pixel tests
1316
1317 // Rebaselining needed because of scrollbars
1318 BUG23498 MAC : css1/cascade/cascade_order.html = IMAGE
1319 BUG23498 MAC : css1/classification/display.html = IMAGE
1320 BUG23498 MAC : css1/classification/list_style_type.html = IMAGE
1321 BUG23498 MAC : css1/classification/white_space.html = IMAGE
1322 BUG23498 MAC : css1/color_and_background/background.html = IMAGE
1323 BUG23498 MAC : css1/color_and_background/background_attachment.html = IMAGE
1324 BUG23498 MAC : css1/color_and_background/background_position.html = IMAGE
1325 BUG23498 MAC : css1/color_and_background/background_repeat.html = IMAGE
1326 BUG23498 MAC : css1/conformance/forward_compatible_parsing.html = IMAGE
1327 BUG23498 MAC : css1/font_properties/font.html = IMAGE
1328 // BUG23498 MAC : css1/font_properties/font_family.html = IMAGE
1329 BUG23498 MAC : css1/font_properties/font_size.html = IMAGE
1330 BUG23498 MAC : css1/font_properties/font_weight.html = IMAGE
1331 BUG23498 MAC : css1/formatting_model/floating_elements.html = IMAGE
1332 BUG23498 MAC : css1/formatting_model/height_of_lines.html = IMAGE
1333 BUG23498 MAC : css1/formatting_model/horizontal_formatting.html = IMAGE
1334 BUG23498 MAC : css1/formatting_model/inline_elements.html = IMAGE
1335 BUG23498 MAC : css1/formatting_model/replaced_elements.html = IMAGE
1336 BUG23498 MAC : css1/formatting_model/vertical_formatting.html = IMAGE
1337 BUG23498 MAC : css1/pseudo/anchor.html = IMAGE
1338 BUG23498 MAC : css1/pseudo/firstletter.html = IMAGE
1339 BUG23498 MAC : css1/pseudo/firstline.html = IMAGE
1340 BUG23498 MAC : css1/pseudo/multiple_pseudo_elements.html = IMAGE
1341 BUG23498 MAC : css1/text_properties/letter_spacing.html = IMAGE
1342 BUG23498 MAC : css1/text_properties/line_height.html = IMAGE
1343 BUG23498 MAC : css1/text_properties/text_decoration.html = IMAGE
1344 BUG23498 MAC : css1/text_properties/text_indent.html = IMAGE
1345 BUG23498 MAC : css1/text_properties/text_transform.html = IMAGE
1346 BUG23498 MAC : css1/text_properties/vertical_align.html = IMAGE
1347 BUG23498 MAC : css1/text_properties/word_spacing.html = IMAGE
1348 BUG23498 MAC : css1/units/color_units.html = IMAGE
1349 BUG23498 MAC : css1/units/length_units.html = IMAGE
1350 BUG23498 MAC : css2.1/t0803-c5502-mrgn-r-02-c.html = IMAGE
1351 BUG23498 MAC : css2.1/t0803-c5505-mrgn-02-c.html = IMAGE
1352 BUG23498 MAC : css2.1/t080301-c411-vt-mrgn-00-b.html = IMAGE
1353 BUG23498 MAC : css2.1/t0905-c5525-fltclr-00-c-ag.html = IMAGE
1354 BUG23498 MAC : css2.1/t0905-c5525-fltmrgn-00-c-ag.html = IMAGE
1355 BUG23498 MAC : css2.1/t0905-c5525-fltwidth-00-c-g.html = IMAGE
1356 BUG23498 MAC : css2.1/t0905-c5526-fltclr-00-c-ag.html = IMAGE
1357 BUG23498 MAC : css2.1/t1002-c5523-width-02-b-g.html = IMAGE
1358 BUG23498 MAC : css2.1/t1202-counters-08-b.html = IMAGE
1359 BUG23498 MAC : css2.1/t1202-counters-09-b.html = IMAGE
1360 BUG23498 MAC : css2.1/t140201-c535-bg-fixd-00-b-g.html = IMAGE
1361 BUG23498 MAC : css2.1/t140201-c537-bgfxps-00-c-ag.html = IMAGE
1362 BUG23498 MAC : css2.1/t1508-c527-font-07-b.html = IMAGE
1363 BUG23498 MAC : editing/deleting/delete-after-span-ws-001.html = IMAGE
1364 BUG23498 MAC : editing/deleting/delete-after-span-ws-002.html = IMAGE
1365 BUG23498 MAC : editing/deleting/delete-after-span-ws-003.html = IMAGE
1366 BUG23498 MAC : editing/deleting/delete-line-end-ws-001.html = IMAGE
1367 BUG23498 MAC : editing/deleting/delete-line-end-ws-002.html = IMAGE
1368 BUG23498 MAC : editing/inserting/insert-div-023.html = IMAGE
1369 BUG23498 MAC : editing/selection/focus_editable_html.html = IMAGE
1370 BUG23498 MAC : editing/selection/iframe.html = IMAGE
1371 BUG23498 MAC : editing/selection/select-all-001.html = IMAGE
1372 BUG23498 MAC : editing/selection/select-all-002.html = IMAGE
1373 BUG23498 MAC : editing/selection/select-all-003.html = IMAGE
1374 BUG23498 MAC : editing/selection/select-all-004.html = IMAGE
1375 BUG23498 MAC : editing/selection/unrendered-001.html = IMAGE
1376 // BUG23498 MAC : editing/selection/unrendered-002.html = IMAGE
1377 BUG23498 MAC : editing/selection/unrendered-003.html = IMAGE
1378 BUG23498 MAC : editing/selection/unrendered-004.html = IMAGE
1379 BUG23498 MAC : editing/selection/unrendered-005.html = IMAGE
1380 BUG23498 MAC : fast/backgrounds/background-inherit-color-bug.html = IMAGE
1381 BUG23498 MAC : fast/backgrounds/repeat/negative-offset-repeat-transformed.html = IMAGE
1382 BUG23498 MAC : fast/block/basic/016.html = IMAGE
1383 BUG23498 MAC : fast/block/basic/fieldset-stretch-to-legend.html = IMAGE
1384 BUG23498 MAC : fast/block/float/008.html = IMAGE
1385 BUG23498 MAC : fast/block/float/013.html = IMAGE
1386 BUG23498 MAC : fast/block/float/019.html = IMAGE
1387 BUG23498 MAC : fast/block/float/021.html = IMAGE
1388 BUG23498 MAC : fast/block/float/025.html = IMAGE
1389 BUG23498 MAC : fast/block/float/026.html = IMAGE
1390 BUG23498 MAC : fast/block/float/027.html = IMAGE
1391 BUG23498 MAC : fast/block/float/028.html = IMAGE
1392 BUG23498 MAC : fast/block/float/032.html = IMAGE
1393 BUG23498 MAC : fast/block/float/033.html = IMAGE
1394 BUG23498 MAC : fast/block/float/035.html = IMAGE
1395 // BUG23498 MAC : fast/block/float/avoidance-percent-width-strict.html = IMAGE
1396 BUG23498 MAC : fast/block/float/br-with-clear-2.html = IMAGE
1397 // BUG23498 MAC : fast/block/float/float-avoidance.html = IMAGE
1398 BUG23498 MAC : fast/block/float/nested-clearance.html = IMAGE
1399 BUG23498 MAC : fast/block/float/relative-painted-twice.html = IMAGE
1400 BUG23498 MAC : fast/block/margin-collapse/103.html = IMAGE
1401 BUG23498 MAC : fast/block/margin-collapse/104.html = IMAGE
1402 BUG23498 MAC : fast/block/margin-collapse/empty-clear-blocks.html = IMAGE
1403 BUG23498 MAC : fast/block/positioning/047.html = IMAGE
1404 BUG23498 MAC : fast/block/positioning/051.html = IMAGE
1405 BUG23498 MAC : fast/block/positioning/055.html = IMAGE
1406 BUG23498 MAC : fast/block/positioning/auto/007.html = IMAGE
1407 BUG23498 MAC : fast/block/positioning/fixed-positioning-scrollbar-bug.html = IMA GE
1408 BUG23498 MAC : fast/block/positioning/negative-rel-position.html = IMAGE
1409 BUG23498 MAC : fast/block/positioning/relative-overflow-block.html = IMAGE
1410 BUG23498 MAC : fast/block/positioning/relative-overflow-replaced-float.html = IM AGE
1411 BUG23498 MAC : fast/block/positioning/relative-overflow-replaced.html = IMAGE
1412 BUG23498 MAC : fast/body-propagation/overflow/001-xhtml.xhtml = IMAGE
1413 BUG23498 MAC : fast/body-propagation/overflow/001.html = IMAGE
1414 BUG23498 MAC : fast/body-propagation/overflow/005-declarative.xhtml = IMAGE
1415 BUG23498 MAC : fast/body-propagation/overflow/005-xhtml.xhtml = IMAGE
1416 BUG23498 MAC : fast/body-propagation/overflow/005.html = IMAGE
1417 // BUG23498 MAC : fast/borders/inline-mask-overlay-image.html = IMAGE
1418 // BUG23498 MAC : fast/box-shadow/basic-shadows.html = IMAGE
1419 BUG23498 MAC : fast/box-sizing/box-sizing.html = IMAGE
1420 BUG23498 MAC : fast/canvas/canvas-bg.html = IMAGE
1421 BUG23498 MAC : fast/canvas/canvas-text-alignment.html = IMAGE
1422 BUG23498 MAC : fast/canvas/image-object-in-canvas.html = IMAGE
1423 BUG23498 MAC : fast/css/005.html = IMAGE
1424 BUG23498 MAC : fast/css/MarqueeLayoutTest.html = IMAGE
1425 BUG23498 MAC : fast/css/border-height.html = IMAGE
1426 BUG23498 MAC : fast/css/empty-pseudo-class.html = IMAGE
1427 BUG23498 MAC : fast/css/first-child-pseudo-class.html = IMAGE
1428 BUG23498 MAC : fast/css/first-of-type-pseudo-class.html = IMAGE
1429 BUG23498 MAC : fast/css/hsl-color.html = IMAGE
1430 BUG9798 BUG23498 MAC : fast/css/last-child-pseudo-class.html = IMAGE FAIL
1431 BUG23498 MAC : fast/css/line-height-overflow.html = IMAGE
1432 BUG23498 MAC : fast/css/nested-floating-relative-position-percentages.html = IMA GE
1433 BUG23498 MAC : fast/css/only-child-pseudo-class.html = IMAGE
1434 BUG23498 MAC : fast/css/only-of-type-pseudo-class.html = IMAGE
1435 BUG23498 MAC : fast/css/percentage-non-integer.html = IMAGE
1436 // BUG23498 MAC : fast/css/shadow-multiple.html = IMAGE
1437 BUG23498 MAC : fast/css/text-overflow-ellipsis-strict.html = IMAGE
1438 BUG23498 MAC : fast/css/text-overflow-ellipsis.html = IMAGE
1439 BUG23498 MAC : fast/css/word-space-extra.html = IMAGE
1440 BUG23498 MAC : fast/css-generated-content/014.html = IMAGE
1441 BUG23498 MAC : fast/dom/focus-contenteditable.html = IMAGE
1442 BUG23498 MAC : fast/dom/stripNullFromTextNodes.html = IMAGE
1443 BUG23498 MAC : fast/dynamic/008.html = IMAGE
1444 BUG23498 MAC : fast/dynamic/anchor-lock.html = IMAGE
1445 BUG23498 MAC : fast/dynamic/insert-before-table-part-in-continuation.html = IMAG E
1446 BUG23498 MAC : fast/encoding/utf-16-big-endian.html = IMAGE
1447 BUG23498 MAC : fast/encoding/utf-16-little-endian.html = IMAGE
1448 BUG23498 MAC : fast/events/autoscroll.html = IMAGE
1449 BUG23498 MAC : fast/events/pointer-events-2.html = IMAGE
1450 BUG23498 MAC : fast/events/reveal-link-when-focused.html = IMAGE
1451 BUG23498 MAC : fast/flexbox/016.html = IMAGE
1452 BUG23498 MAC : fast/flexbox/flex-hang.html = IMAGE
1453 BUG23498 MAC : fast/forms/fieldset-align.html = IMAGE
1454 BUG23498 MAC : fast/forms/form-hides-table.html = IMAGE
1455 BUG23498 MAC : fast/forms/input-table.html = IMAGE
1456 BUG23498 MAC : fast/forms/textAreaLineHeight.html = IMAGE
1457
1458 BUG23498 MAC : fast/frames/frame-scrolling-attribute.html = IMAGE
1459
1460 BUG23498 MAC : fast/frames/iframe-scrolling-attribute.html = IMAGE
1461 BUG23498 BUG26044 MAC RELEASE : fast/frames/invalid.html = IMAGE CRASH
1462 BUG23498 BUG26044 SLOW MAC DEBUG : fast/frames/invalid.html = IMAGE
1463 // BUG23498 MAC : fast/frames/onlyCommentInIFrame.html = IMAGE
1464 BUG23498 MAC DEBUG : fast/frames/valid.html = IMAGE
1465 BUG23498 MAC RELEASE : fast/frames/valid.html = IMAGE CRASH
1466 BUG23498 MAC : fast/gradients/background-clipped.html = IMAGE
1467 BUG23498 MAC : fast/images/pdf-as-image-landscape.html = IMAGE
1468 BUG23498 MAC : fast/inline/inline-borders-with-bidi-override.html = IMAGE
1469 BUG23498 MAC : fast/inline/inline-continuation-borders.html = IMAGE
1470 BUG23498 MAC : fast/inline/long-wrapped-line.html = IMAGE
1471 BUG23498 MAC : fast/inline-block/inline-block-vertical-align.html = IMAGE
1472 BUG23498 MAC : fast/layers/scroll-rect-to-visible.html = IMAGE
1473 BUG23498 MAC : fast/lists/001.html = IMAGE
1474 BUG23498 MAC : fast/lists/008.html = IMAGE
1475 BUG23498 MAC : fast/lists/alpha-list-wrap.html = IMAGE
1476 BUG23498 MAC : fast/lists/li-br.html = IMAGE
1477 // BUG23498 MAC : fast/lists/ol-start-parsing.html = IMAGE
1478 BUG23498 MAC : fast/lists/olstart.html = IMAGE
1479 BUG23498 MAC : fast/lists/w3-list-styles.html = IMAGE
1480 BUG23498 MAC : fast/multicol/column-rules-stacking.html = IMAGE
1481 BUG23498 MAC : fast/multicol/columns-shorthand-parsing.html = IMAGE
1482 BUG23498 MAC : fast/multicol/float-multicol.html = IMAGE
1483 // BUG23498 MAC : fast/multicol/positioned-with-constrained-height.html = IMAGE
1484 // BUG23498 MAC : fast/overflow/004.html = IMAGE
1485 BUG23498 MAC : fast/overflow/006.html = IMAGE
1486 BUG23498 MAC : fast/overflow/clip-rects-fixed-ancestor.html = IMAGE
1487 BUG23498 MAC : fast/overflow/overflow-auto-table.html = IMAGE
1488 BUG23498 MAC : fast/overflow/overflow-stacking.html = IMAGE
1489 BUG23498 MAC : fast/overflow/overflow-x-y.html = IMAGE
1490 // BUG23498 MAC : fast/overflow/position-fixed-transform-clipping.html = IMAGE
1491 BUG23498 MAC : fast/overflow/scrollRevealButton.html = IMAGE
1492 BUG23498 MAC : fast/reflections/reflection-direction.html = IMAGE
1493 BUG23498 MAC : fast/replaced/005.html = IMAGE
1494 BUG23498 MAC : fast/replaced/width100percent-image.html = IMAGE
1495 BUG23498 MAC : fast/selectors/166.html = IMAGE
1496 BUG23498 MAC : fast/table/023.html = IMAGE
1497 BUG23498 MAC : fast/table/034.html = IMAGE
1498 BUG23498 MAC : fast/table/040.html = IMAGE
1499 BUG23498 MAC : fast/table/border-collapsing/004.html = IMAGE
1500 BUG23498 MAC : fast/table/empty-cells.html = IMAGE
1501 BUG23498 MAC : fast/table/frame-and-rules.html = IMAGE
1502 BUG23498 MAC : fast/table/height-percent-test.html = IMAGE
1503 BUG23498 MAC : fast/table/overflowHidden.html = IMAGE
1504 BUG23498 MAC : fast/table/prepend-in-anonymous-table.html = IMAGE
1505 BUG23498 MAC : fast/table/wide-colspan.html = IMAGE
1506 BUG23498 MAC : fast/table/wide-column.html = IMAGE
1507 BUG23498 MAC : fast/text/capitalize-boundaries.html = IMAGE
1508 BUG23498 MAC : fast/text/international/bidi-neutral-run.html = IMAGE
1509 BUG23498 MAC : fast/text/international/thai-line-breaks.html = IMAGE
1510 BUG23498 MAC : fast/text/large-text-composed-char.html = IMAGE
1511 BUG23498 MAC : fast/text/softHyphen.html = IMAGE
1512 BUG23498 MAC : fast/text/wbr.html = IMAGE
1513 BUG23498 MAC : fast/text/whitespace/024.html = IMAGE
1514 BUG23498 MAC : fast/text/whitespace/pre-wrap-spaces-after-newline.html = IMAGE
1515 BUG23498 MAC : fast/text/word-break.html = IMAGE
1516 BUG23498 MAC DEBUG : fonts/cursive.html = IMAGE IMAGE+TEXT
1517 BUG23498 MAC RELEASE : fonts/cursive.html = IMAGE
1518 BUG23498 MAC : fonts/default.html = IMAGE
1519 BUG23498 MAC : fonts/fantasy.html = IMAGE
1520 BUG23498 MAC : fonts/monospace.html = IMAGE
1521 BUG23498 MAC : fonts/sans-serif.html = IMAGE
1522 BUG23498 MAC : fonts/serif.html = IMAGE
1523 BUG23498 MAC : http/tests/navigation/anchor-frames.html = IMAGE
1524 BUG9798 BUG23498 MAC DEBUG : http/tests/navigation/error404-frames.html = TIMEOU T IMAGE
1525 BUG9798 BUG23498 MAC RELEASE : http/tests/navigation/error404-frames.html = IMAG E
1526 BUG23498 MAC : http/tests/navigation/error404-subframeload.html = IMAGE
1527 // BUG23498 MAC : http/tests/navigation/javascriptlink-frames.html = IMAGE
1528 BUG23498 MAC DEBUG : http/tests/navigation/post-frames.html = IMAGE TIMEOUT
1529 BUG23498 MAC RELEASE : http/tests/navigation/post-frames.html = IMAGE
1530 BUG23498 MAC : http/tests/navigation/postredirect-frames.html = IMAGE
1531 BUG23498 MAC : svg/custom/altglyph.svg = IMAGE
1532 BUG23498 MAC : svg/custom/scrolling-embedded-svg-file-image-repaint-problem.html = IMAGE
1533 BUG23498 MAC : svg/hixie/links/003-broken.xml = IMAGE
1534 BUG23498 MAC : svg/text/kerning.svg = IMAGE
1535 BUG23498 MAC : svg/text/multichar-glyph.svg = IMAGE
1536 BUG23498 MAC : tables/mozilla/bugs/bug101674.html = IMAGE
1537 BUG23498 MAC : tables/mozilla/bugs/bug10269-2.html = IMAGE
1538 BUG23498 MAC : tables/mozilla/bugs/bug10296-1.html = IMAGE
1539 BUG23498 MAC : tables/mozilla/bugs/bug1055-1.html = IMAGE
1540 BUG23498 MAC : tables/mozilla/bugs/bug113235-1.html = IMAGE
1541 BUG23498 MAC : tables/mozilla/bugs/bug113235-3.html = IMAGE
1542 BUG23498 MAC : tables/mozilla/bugs/bug11944.html = IMAGE
1543 BUG23498 MAC : tables/mozilla/bugs/bug120364.html = IMAGE
1544 BUG23498 MAC : tables/mozilla/bugs/bug1302.html = IMAGE
1545 BUG23498 MAC : tables/mozilla/bugs/bug131020.html = IMAGE
1546 BUG23498 MAC : tables/mozilla/bugs/bug131020_iframe.html = IMAGE
1547 BUG23498 MAC : tables/mozilla/bugs/bug137388-2.html = IMAGE
1548 BUG23498 MAC : tables/mozilla/bugs/bug22019.html = IMAGE
1549 BUG23498 MAC : tables/mozilla/bugs/bug23151.html = IMAGE
1550 BUG23498 MAC : tables/mozilla/bugs/bug2479-1.html = IMAGE
1551 BUG23498 MAC : tables/mozilla/bugs/bug2479-3.html = IMAGE
1552 BUG23498 MAC : tables/mozilla/bugs/bug2479-4.html = IMAGE
1553 BUG23498 MAC : tables/mozilla/bugs/bug27038-2.html = IMAGE
1554 BUG23498 MAC : tables/mozilla/bugs/bug29314.html = IMAGE
1555 BUG23498 MAC : tables/mozilla/bugs/bug2947.html = IMAGE
1556 BUG23498 MAC : tables/mozilla/bugs/bug32205-2.html = IMAGE
1557 BUG23498 MAC : tables/mozilla/bugs/bug38916.html = IMAGE
1558 BUG23498 MAC : tables/mozilla/bugs/bug3977.html = IMAGE
1559 BUG23498 MAC : tables/mozilla/bugs/bug43039.html = IMAGE
1560 BUG23498 MAC : tables/mozilla/bugs/bug43854-1.html = IMAGE
1561 BUG23498 MAC : tables/mozilla/bugs/bug44505.html = IMAGE
1562 BUG23498 MAC : tables/mozilla/bugs/bug46480-1.html = IMAGE
1563 BUG23498 MAC : tables/mozilla/bugs/bug46480-2.html = IMAGE
1564 BUG23498 MAC : tables/mozilla/bugs/bug50695-1.html = IMAGE
1565 BUG23498 MAC : tables/mozilla/bugs/bug56405.html = IMAGE
1566 BUG23498 MAC : tables/mozilla/bugs/bug5797.html = IMAGE
1567 BUG23498 MAC : tables/mozilla/bugs/bug5835.html = IMAGE
1568 BUG23498 MAC : tables/mozilla/bugs/bug625.html = IMAGE
1569 BUG23498 MAC : tables/mozilla/bugs/bug650.html = IMAGE
1570 BUG23498 MAC : tables/mozilla/bugs/bug67915-1.html = IMAGE
1571 BUG23498 MAC : tables/mozilla/bugs/bug7112-1.html = IMAGE
1572 BUG23498 MAC : tables/mozilla/bugs/bug7112-2.html = IMAGE
1573 BUG23498 MAC : tables/mozilla/bugs/bug73321.html = IMAGE
1574 BUG23498 MAC : tables/mozilla/bugs/bug92143.html = IMAGE
1575 BUG23498 MAC : tables/mozilla/bugs/bug96334.html = IMAGE
1576 BUG23498 MAC : tables/mozilla/bugs/bug96343.html = IMAGE
1577 BUG23498 MAC : tables/mozilla/collapsing_borders/bug41262-3.html = IMAGE
1578 BUG23498 MAC : tables/mozilla/core/bloomberg.html = IMAGE
1579 BUG23498 MAC : tables/mozilla/core/captions.html = IMAGE
1580 BUG23498 MAC : tables/mozilla/core/cell_heights.html = IMAGE
1581 BUG23498 MAC : tables/mozilla/core/col_widths_auto_fix.html = IMAGE
1582 BUG23498 MAC : tables/mozilla/core/col_widths_fix_fixPer.html = IMAGE
1583 BUG23498 MAC : tables/mozilla/core/nested1.html = IMAGE
1584 BUG23498 MAC : tables/mozilla/core/one_row.html = IMAGE
1585 BUG23498 MAC : tables/mozilla/core/row_span.html = IMAGE
1586 BUG23498 MAC : tables/mozilla/marvin/backgr_index.html = IMAGE
1587 BUG23498 MAC : tables/mozilla/marvin/backgr_layers-opacity.html = IMAGE
1588 BUG23498 MAC : tables/mozilla/marvin/backgr_position-table.html = IMAGE
1589 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table-cell.html = IMAGE
1590 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table-column-group.html = IMA GE
1591 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table-column.html = IMAGE
1592 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table-row-group.html = IMAGE
1593 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table-row.html = IMAGE
1594 BUG23498 MAC : tables/mozilla/marvin/backgr_simple-table.html = IMAGE
1595 BUG23498 MAC : tables/mozilla/marvin/x_table_bgcolor_name.xml = IMAGE
1596 BUG23498 MAC : tables/mozilla/marvin/x_table_bgcolor_rgb.xml = IMAGE
1597 BUG23498 MAC : tables/mozilla/marvin/x_td_bgcolor_name.xml = IMAGE
1598 BUG23498 MAC : tables/mozilla/marvin/x_td_bgcolor_rgb.xml = IMAGE
1599 BUG23498 MAC : tables/mozilla/marvin/x_td_height.xml = IMAGE
1600 BUG23498 MAC : tables/mozilla/marvin/x_td_nowrap.xml = IMAGE
1601 BUG23498 MAC : tables/mozilla/marvin/x_th_bgcolor_name.xml = IMAGE
1602 BUG23498 MAC : tables/mozilla/marvin/x_th_bgcolor_rgb.xml = IMAGE
1603 BUG23498 MAC : tables/mozilla/marvin/x_th_height.xml = IMAGE
1604 BUG23498 MAC : tables/mozilla/marvin/x_th_nowrap.xml = IMAGE
1605 BUG23498 MAC : tables/mozilla/marvin/x_tr_bgcolor_name.xml = IMAGE
1606 BUG23498 MAC : tables/mozilla/marvin/x_tr_bgcolor_rgb.xml = IMAGE
1607 BUG23498 MAC : tables/mozilla/other/cell_widths.html = IMAGE
1608 BUG23498 MAC : tables/mozilla/other/nestedTables.html = IMAGE
1609 BUG23498 MAC : tables/mozilla/other/test3.html = IMAGE
1610 BUG23498 MAC : tables/mozilla/other/test6.html = IMAGE
1611 BUG23498 MAC : tables/mozilla/other/wa_table_thtd_rowspan.html = IMAGE
1612 BUG23498 MAC : tables/mozilla/other/wa_table_tr_align.html = IMAGE
1613 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug10140.html = IMAGE
1614 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug101759.html = IMAGE
1615 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug10216.html = IMAGE
1616 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug1055-2.html = IMAGE
1617 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug106966.html = IMAGE
1618 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug131020-3.html = IMAGE
1619 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug14007-1.html = IMAGE
1620 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug14007-2.html = IMAGE
1621 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug19526.html = IMAGE
1622 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug220653.html = IMAGE
1623 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug22122.html = IMAGE
1624 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug2479-5.html = IMAGE
1625 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug32205-1.html = IMAGE
1626 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug67915-2.html = IMAGE
1627 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug80762-2.html = IMAGE
1628 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug85016.html = IMAGE
1629 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug89315.html = IMAGE
1630 BUG23498 MAC : tables/mozilla_expected_failures/bugs/bug91057.html = IMAGE
1631 BUG23498 BUG32193 MAC : tables/mozilla_expected_failures/core/backgrounds.html = IMAGE IMAGE+TEXT
1632 // BUG23498 MAC : tables/mozilla_expected_failures/core/captions1.html = IMAGE
1633 // BUG23498 MAC : tables/mozilla_expected_failures/core/captions2.html = IMAGE
1634 BUG23498 MAC : tables/mozilla_expected_failures/core/captions3.html = IMAGE
1635 BUG23498 MAC : tables/mozilla_expected_failures/core/col_span2.html = IMAGE
1636 BUG23498 MAC : tables/mozilla_expected_failures/core/columns.html = IMAGE
1637 BUG23498 MAC : tables/mozilla_expected_failures/core/conflicts.html = IMAGE
1638 BUG23498 MAC : tables/mozilla_expected_failures/core/standards1.html = IMAGE
1639 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-cell. html = IMAGE
1640 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-colum n-group.html = IMAGE
1641 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-colum n.html = IMAGE
1642 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-quirk s.html = IMAGE
1643 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-row-g roup.html = IMAGE
1644 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table-row.h tml = IMAGE
1645 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_border-table.html = IMAGE
1646 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_fixed-bg.html = IM AGE
1647 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_layers-hide.html = IMAGE
1648 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_layers-show.html = IMAGE
1649 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_position-table-cel l.html = IMAGE
1650 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_position-table-col umn-group.html = IMAGE
1651 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_position-table-col umn.html = IMAGE
1652 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_position-table-row -group.html = IMAGE
1653 BUG23498 MAC : tables/mozilla_expected_failures/marvin/backgr_position-table-row .html = IMAGE
1654 BUG23498 MAC : tables/mozilla_expected_failures/marvin/table_overflow_dirty_refl ow_row.html = IMAGE
1655 BUG23498 MAC : tables/mozilla_expected_failures/marvin/table_overflow_dirty_refl ow_tbody.html = IMAGE
1656 BUG23498 MAC : tables/mozilla_expected_failures/marvin/table_overflow_style_refl ow_row_sibling.html = IMAGE
1657 BUG23498 MAC : tables/mozilla_expected_failures/marvin/table_overflow_style_refl ow_tbody_sibling.html = IMAGE
1658 BUG23498 MAC : tables/mozilla_expected_failures/other/empty_cells.html = IMAGE
1659 BUG23498 MAC : tables/mozilla_expected_failures/other/test4.html = IMAGE+TEXT IM AGE
1660 BUG23498 MAC : webarchive/test-duplicate-resources.html = IMAGE
1661
1662 // Missing "misspelled-word" dotted underline
1663 BUG23497 MAC : editing/deleting/delete-to-select-table.html = IMAGE
1664 BUG23497 MAC : editing/selection/unrendered-002.html = IMAGE
1665 BUG23497 MAC : editing/spelling/spellcheck-attribute.html = IMAGE
1666
1667 // Widget location is just slightly off
1668 BUG23496 MAC : css1/box_properties/acid_test.html = IMAGE
1669 BUG23496 MAC : css2.1/t09-c5526c-display-00-e.html = IMAGE
1670 BUG23496 MAC : fast/block/basic/011.html = IMAGE
1671 BUG23496 MAC : fast/forms/001.html = IMAGE
1672 BUG23496 MAC : fast/forms/basic-inputs.html = IMAGE
1673 // BUG23496 MAC : fast/forms/box-shadow-override.html = IMAGE
1674 BUG23496 MAC : fast/forms/checkbox-radio-onchange.html = IMAGE
1675 BUG23496 MAC : fast/forms/file-input-disabled.html = IMAGE+TEXT
1676 BUG23496 MAC : fast/forms/form-element-geometry.html = IMAGE+TEXT
1677 BUG23496 MAC : fast/forms/formmove.html = IMAGE
1678 // Recently became crashy. See http://crbug.com/24721
1679 BUG23496 MAC : fast/forms/formmove2.html = IMAGE
1680 BUG23496 MAC : fast/forms/indeterminate.html = IMAGE
1681 BUG23496 MAC : fast/forms/input-appearance-height.html = IMAGE+TEXT
1682 BUG23496 MAC : fast/forms/input-value.html = IMAGE+TEXT
1683 // BUG23496 MAC : fast/forms/menulist-narrow-width.html = IMAGE
1684 BUG23496 MAC : fast/forms/menulist-no-overflow.html = IMAGE
1685 BUG23496 MAC : fast/forms/radio-attr-order.html = IMAGE
1686 BUG23496 MAC : fast/forms/radio-nested-labels.html = IMAGE
1687 BUG23496 MAC : fast/forms/radio_checked.html = IMAGE
1688 BUG23496 MAC : fast/forms/radio_checked_dynamic.html = IMAGE
1689 // BUG23496 MAC : fast/forms/search-vertical-alignment.html = IMAGE
1690 BUG23496 MAC : fast/inline/positionedLifetime.html = IMAGE
1691 BUG23496 MAC : fast/parser/bad-xml-slash.html = IMAGE
1692 BUG23496 MAC : fast/replaced/replaced-breaking.html = IMAGE
1693 BUG23496 MAC : fast/replaced/width100percent-checkbox.html = IMAGE
1694 BUG23496 MAC : fast/replaced/width100percent-radio.html = IMAGE
1695 BUG23496 MAC DEBUG : fast/text/textIteratorNilRenderer.html = IMAGE
1696 BUG23496 SLOW MAC RELEASE : fast/text/textIteratorNilRenderer.html = IMAGE
1697 BUG23496 MAC : fast/text/whitespace/normal-after-nowrap-breaking.html = IMAGE
1698 BUG23496 MAC : http/tests/navigation/javascriptlink-frames.html = IMAGE
1699 BUG23496 MAC : tables/mozilla/bugs/bug1318.html = IMAGE
1700 BUG23496 MAC : tables/mozilla/bugs/bug4527.html = IMAGE
1701 BUG23496 MAC : tables/mozilla_expected_failures/core/captions1.html = IMAGE
1702 BUG23496 MAC : tables/mozilla_expected_failures/core/captions2.html = IMAGE
1703
1704 // Big button widgets are broken
1705 BUG23495 MAC : fast/forms/basic-buttons.html = IMAGE
1706 BUG23495 MAC : fast/forms/box-shadow-override.html = IMAGE+TEXT
1707 BUG23495 MAC : fast/forms/button-sizes.html = IMAGE
1708
1709 // Text declared as "monospace" with no size is bigger in Chromium
1710 BUG23494 MAC : css1/font_properties/font_family.html = IMAGE
1711 BUG23494 MAC : css2.1/t1503-c522-font-family-00-b.html = IMAGE
1712 BUG23494 MAC : fast/text/monospace-width-cache.html = IMAGE
1713
1714 // Broken upstream? Layout test should write a "PASS" or "FAIL" line; upstream h as neither (ours is "PASS")
1715 BUG23492 MAC : fast/frames/frame-src-attribute.html = IMAGE
1716
1717 // Font glyph issues?
1718 BUG23491 MAC : css2.1/t0905-c5525-flthw-00-c-g.html = IMAGE
1719 BUG23491 MAC : css2.1/t0905-c5526-flthw-00-c-g.html = IMAGE
1720
1721 // Actual is just slightly off in color than expected
1722 BUG23488 MAC : editing/deleting/type-delete-after-quote.html = IMAGE
1723 BUG23488 MAC : editing/inserting/5418891.html = IMAGE
1724 BUG23488 MAC : editing/selection/extend-by-word-002.html = IMAGE
1725 BUG23488 MAC : fast/backgrounds/background-clip-text.html = IMAGE
1726 BUG23488 MAC : fast/backgrounds/repeat/mask-negative-offset-repeat.html = IMAGE
1727 BUG23488 MAC RELEASE : fast/backgrounds/size/backgroundSize15.html = IMAGE
1728 BUG23488 MAC DEBUG SLOW : fast/backgrounds/size/backgroundSize15.html = IMAGE
1729 BUG23488 MAC RELEASE : fast/backgrounds/size/contain-and-cover.html = IMAGE
1730 BUG23488 MAC DEBUG SLOW : fast/backgrounds/size/contain-and-cover.html = IMAGE
1731 BUG23488 MAC : fast/backgrounds/svg-as-background-3.html = IMAGE
1732 BUG23488 MAC : fast/block/float/avoidance-percent-width-compat.html = IMAGE
1733 BUG23488 MAC : fast/block/float/avoidance-percent-width-strict.html = IMAGE
1734 BUG23488 MAC : fast/block/float/float-avoidance.html = IMAGE
1735 BUG23488 MAC : fast/borders/border-image-rotate-transform.html = IMAGE
1736 BUG23488 MAC : fast/borders/inline-mask-overlay-image.html = IMAGE
1737 BUG23488 MAC : fast/box-shadow/basic-shadows.html = IMAGE
1738 BUG23488 MAC : fast/box-shadow/inset.html = IMAGE
1739 BUG23488 MAC : fast/box-shadow/transform-fringing.html = IMAGE
1740 BUG23488 MAC : fast/canvas/canvas-incremental-repaint-2.html = IMAGE
1741 BUG23488 MAC : fast/css/shadow-multiple.html = IMAGE
1742 BUG23488 MAC : fast/forms/search-vertical-alignment.html = IMAGE
1743 BUG23488 MAC : fast/frames/content-opacity-1.html = IMAGE
1744 BUG23488 MAC : fast/frames/content-opacity-2.html = IMAGE
1745 BUG23488 MAC : fast/frames/viewsource-attribute.html = IMAGE
1746 BUG23488 MAC : fast/layers/add-layer-with-nested-stacking.html = IMAGE
1747 BUG23488 MAC : fast/layers/inline-dirty-z-order-lists.html = IMAGE
1748 BUG23488 MAC : fast/layers/layer-content-visibility-change.html = IMAGE
1749 BUG23488 MAC : fast/layers/remove-layer-with-nested-stacking.html = IMAGE
1750 BUG23488 MAC : fast/lists/ol-start-parsing.html = IMAGE
1751 BUG23488 MAC : fast/multicol/positioned-with-constrained-height.html = IMAGE
1752 BUG23488 MAC : fast/overflow/position-fixed-transform-clipping.html = IMAGE
1753 BUG23488 MAC : fast/reflections/abs-position-in-reflection.html = IMAGE
1754 BUG23488 MAC : fast/table/fixed-table-with-percent-inside-percent-table.html = I MAGE
1755 BUG23488 MAC : fast/table/fixed-table-with-percent-width-inside-auto-table.html = IMAGE
1756 BUG23488 MAC : fast/table/fixed-table-with-percent-width-inside-div.html = IMAGE
1757 BUG23488 MAC : fast/table/fixed-table-with-percent-width-inside-extra-large-div. html = IMAGE
1758 BUG23488 MAC : fast/table/fixed-table-with-percent-width-inside-fixed-width-tabl e.html = IMAGE
1759 BUG23488 MAC : fast/table/fixed-table-with-small-percent-width.html = IMAGE
1760 BUG23488 MAC : fast/text/shadow-no-blur.html = IMAGE
1761 BUG23488 MAC : fast/text/shadow-translucent-fill.html = IMAGE
1762 BUG23488 MAC : svg/transforms/animated-path-inside-transformed-html.xhtml = IMAG E
1763 BUG23488 MAC : tables/mozilla/bugs/bug106158-1.html = IMAGE
1764 BUG23488 MAC : tables/mozilla/bugs/bug106158-2.html = IMAGE
1765 BUG23488 MAC : tables/mozilla/bugs/bug34176.html = IMAGE
1766 BUG23488 MAC : tables/mozilla_expected_failures/bugs/bug178855.xml = IMAGE
1767
1768 // Looks the same to me... huh. Variation of above?
1769 BUG23489 MAC : fast/forms/menulist-clip.html = IMAGE
1770 BUG23489 MAC : fast/forms/menulist-narrow-width.html = IMAGE
1771 BUG23489 MAC : fast/forms/menulist-option-wrap.html = IMAGE
1772 BUG23489 MAC : fast/forms/menulist-restrict-line-height.html = IMAGE
1773 BUG23489 MAC : fast/forms/select-baseline.html = IMAGE
1774 BUG23489 MAC : fast/table/empty-section-crash.html = IMAGE
1775
1776 // Various drawing tests that are broken
1777 BUG23477 MAC : fast/backgrounds/bgCompositeCopy.html = IMAGE
1778 BUG23477 MAC : fast/canvas/canvas-as-image-incremental-repaint.html = IMAGE
1779 BUG23477 MAC : fast/canvas/canvas-incremental-repaint.html = IMAGE
1780 BUG23477 MAC : fast/canvas/fill-stroke-clip-reset-path.html = IMAGE
1781 BUG23477 MAC : fast/dynamic/containing-block-change.html = IMAGE
1782
1783 // Unexpected gray
1784 BUG23476 MAC : fast/forms/hidden-listbox.html = IMAGE
1785 BUG23476 MAC : fast/forms/listbox-clip.html = IMAGE
1786 BUG23476 MAC : fast/frames/inline-object-inside-frameset.html = IMAGE
1787 BUG23476 MAC : fast/overflow/hidden-scrollbar-resize.html = IMAGE
1788 BUG23476 MAC : fast/text/font-initial.html = IMAGE
1789
1790 // Missing corner resize image
1791 BUG22777 MAC : fast/css/resize-corner-tracking-transformed.html = IMAGE+TEXT
1792 BUG22777 MAC : fast/overflow/hit-test-overflow-controls.html = IMAGE+TEXT
1793
1794 // Disagreeing XML parsing error messages
1795 BUG23475 MAC : fast/invalid/missing-end-tag.xhtml = IMAGE
1796 BUG23475 MAC : fast/parser/xhtml-alternate-entities.xml = IMAGE
1797 BUG23475 MAC : fast/xsl/xslt-extra-content-at-end.xml = IMAGE
1798 BUG23475 MAC : svg/custom/junk-data.svg = IMAGE
1799
1800 // 116/136 of the repaint tests fail due to invalidation that doesn't match; fur ther triage necessary
1801 BUG23473 MAC : fast/repaint = IMAGE
1802 BUG23473 MAC : fast/repaint/block-no-inflow-children.html = PASS
1803 BUG23473 MAC : fast/repaint/block-selection-gap-stale-cache.html = PASS
1804 BUG23473 MAC : fast/repaint/block-selection-gap-stale-cache-2.html = PASS
1805 BUG23473 MAC : fast/repaint/fixed.html = PASS
1806 BUG23473 MAC : fast/repaint/flexible-box-overflow.html = PASS
1807 BUG23473 MAC : fast/repaint/flexible-box-overflow-horizontal.html = PASS
1808 BUG23473 MAC : fast/repaint/float-new-in-block.html = PASS
1809 BUG23473 MAC : fast/repaint/focus-layers.html = PASS
1810 BUG23473 MAC : fast/repaint/focus-ring.html = PASS
1811 BUG23473 MAC : fast/repaint/inline-block-overflow.html = PASS
1812 BUG23473 MAC : fast/repaint/layer-child-outline.html = PASS
1813 BUG23473 MAC : fast/repaint/layer-outline.html = PASS
1814 BUG23473 MAC : fast/repaint/layer-outline-horizontal.html = PASS
1815 BUG23473 MAC : fast/repaint/line-flow-with-floats-1.html = PASS
1816 BUG23473 MAC : fast/repaint/line-flow-with-floats-6.html = PASS
1817 BUG23473 MAC : fast/repaint/list-marker.html = PASS
1818 BUG23473 MAC : fast/repaint/repaint-during-scroll.html = PASS
1819 BUG23473 MAC : fast/repaint/selection-gap-overflow-scroll-2.html = PASS
1820 BUG23473 MAC : fast/repaint/shadow-multiple-horizontal.html = PASS
1821 BUG23473 MAC : fast/repaint/shadow-multiple-strict-horizontal.html = PASS
1822 BUG23473 MAC : fast/repaint/shadow-multiple-strict-vertical.html = PASS
1823 BUG23473 MAC : fast/repaint/shadow-multiple-vertical.html = PASS
1824 BUG23473 MAC : fast/repaint/table-cell-vertical-overflow.html = PASS
1825 BUG23473 MAC : fast/repaint/text-shadow.html = PASS
1826 BUG23473 MAC : fast/repaint/text-shadow-horizontal.html = PASS
1827
1828 // Thicker shadow than expected
1829 BUG23471 MAC : fast/text/stroking.html = IMAGE
1830
1831 // Thin lines not drawing right
1832 BUG23470 MAC : fast/transforms/shadows.html = IMAGE
1833
1834 // SVG foreign object skew off by a lot
1835 BUG23466 MAC : svg/custom/foreign-object-skew.svg = IMAGE
1836
1837 // Missing baselines
1838 // BUG23557 MAC : fast/text/text-letter-spacing.html = IMAGE
1839
1840 // Failing on the bots but not locally; need investigation
1841 BUG23560 MAC : fast/images/animated-svg-as-image.html = IMAGE PASS
1842 BUG23560 MAC : svg/W3C-SVG-1.1/filters-conv-01-f.svg = FAIL
1843
1844 // -----------------------------------------------------------------
1845 // END MAC PORT TESTS
1846 // -----------------------------------------------------------------
1847
1848 // Linux pixeltest failure: alpha=0.5 red (1,0,0) atop yellow (1,1,0) is
1849 // coming out with with a slightly-less-than-100% red channel. This test fails
1850 // because we enforce non-transparent color in Font::drawGlyphs.
1851 BUG24191 LINUX : fast/css/hsla-color.html = FAIL
1852
1853 // Linux checksum computation produces results, different from Windows or upstre am.
1854 BUG21386 LINUX : fast/repaint/erase-overflow.html = FAIL
1855 BUG21386 LINUX : fast/repaint/inline-block-resize.html = FAIL
1856 BUG21386 LINUX : fast/repaint/inline-overflow.html = FAIL
1857 BUG21386 LINUX : fast/repaint/invisible-objects.html = FAIL
1858 BUG21386 LINUX : fast/repaint/layer-full-repaint.html = FAIL
1859 BUG21386 LINUX : fast/repaint/layer-hide-when-needs-layout.html = FAIL
1860 BUG21386 LINUX : fast/repaint/layer-visibility.html = FAIL
1861 BUG21386 LINUX : fast/repaint/overflow-clip-subtree-layout.html = FAIL
1862 BUG21386 LINUX : fast/repaint/subtree-root-clip-2.html = FAIL
1863 BUG21386 LINUX : fast/repaint/subtree-root-clip-3.html = FAIL
1864 BUG21386 LINUX : fast/repaint/subtree-root-clip.html = FAIL
1865 BUG21386 LINUX : fast/repaint/table-col-background.html = FAIL
1866 BUG21386 LINUX : fast/repaint/table-row.html = FAIL
1867 BUG21386 LINUX : fast/repaint/table-section-overflow.html = FAIL
1868 BUG21386 LINUX : fast/layers/layer-content-visibility-change.html = FAIL
1869 BUG21386 LINUX : fast/repaint/table-cell-overflow.html = FAIL
1870
1871 // TODO(tc): flaky.
1872 BUG10391 LINUX : fast/events/5056619.html = FAIL
1873
1874 // Failed with r6844 (dglazkov)
1875 BUG10392 LINUX MAC : http/tests/navigation/error404-goback.html = FAIL
1876
1877 // Skipped as this tests window.sessionStorage, which we don't
1878 // support. Enable once we turn on DOM_STORAGE.
1879 BUG4360 SKIP : http/tests/navigation/post-goback-repost-policy.html = TIMEOUT
1880
1881 // Merge 39309:39335 Regressions (RenderButton::setupInnerStyle regression).
1882 BUG5737 LINUX : fast/forms/001.html = FAIL
1883 BUG5737 LINUX : fast/forms/input-first-letter.html = FAIL
1884
1885 // The (x) in type=search inputs appears to be slightly broken. This test will also need a rebaseline.
1886 BUG20439 WIN LINUX : fast/forms/search-transformed.html = FAIL
1887
1888 // Linux's rotated text output looks terrible.
1889 BUG10397 LINUX : fast/transforms/transformed-document-element.html = FAIL
1890
1891 // Merge 39744:39913? - regressions
1892 BUG10403 LINUX : svg/custom/animate-path-morphing.svg = FAIL
1893
1894 // might need to be rebaselined in win, 'DRAFT' rendering incorrect before
1895 BUG10405 WIN : svg/custom/struct-use-09-b.svg = FAIL
1896
1897 // New tests added in http://trac.webkit.org/changeset/40424
1898 // Renders the width of "600" off by 3. Looks OK but could still be a bug
1899 // that we shouldn't rebaseline.
1900 BUG10417 LINUX : svg/W3C-SVG-1.1/text-fonts-02-t.svg = FAIL
1901
1902 // New test. We should fix it, but it doesn't need to block the current release
1903 BUG10418 SLOW MAC RELEASE : fast/events/click-count.html = PASS
1904 BUG10418 WIN DEBUG : animations/change-keyframes-name.html = FAIL PASS
1905
1906 // TODO(dsh): These started to fail after r9202.
1907 BUG10419 LINUX : svg/W3C-SVG-1.1/text-path-01-b.svg = FAIL
1908
1909 // We could fix this test for us and upstream it if the test shell user agent
1910 // would let us differentiate test_shell and WebKit DumpTreeNode.
1911 BUG7482 LINUX MAC : http/tests/misc/timer-vs-loading.html = TIMEOUT
1912 BUG7482 WIN : http/tests/misc/timer-vs-loading.html = PASS TIMEOUT
1913
1914 // Regressions from WebKit merge 40722:40785
1915 // Misc failures:
1916 // New test. We should fix it, but it doesn't need to block the current release
1917 BUG10420 LINUX : svg/W3C-SVG-1.1/types-basicDOM-01-b.svg = FAIL
1918 BUG10420 LINUX : svg/custom/use-transform.svg = FAIL
1919
1920 // Regressions from WebKit merge to 40864
1921 // Likely just needs a rebaseline.
1922 BUG10421 LINUX : fast/block/positioning/001.html = FAIL
1923
1924 // Selection highlight colors are wrong.
1925 BUG10426 LINUX : fast/lists/drag-into-marker.html = FAIL
1926
1927 // It's not clear that the test isn't wrong here. It believes that middle
1928 // aligning 15px Ahem should end up in a certain spot. But we have the
1929 // x-height correct and we're still one px off.
1930 BUG10429 LINUX : css2.1/t100801-c544-valgn-01-d-ag.html = FAIL
1931
1932 // New failures from Merge 41078:41149
1933 BUG10430 LINUX : svg/W3C-SVG-1.1/text-intro-05-t.svg = FAIL
1934
1935 // Regression from merge 41268:41286
1936 // See above comment about this test on linux/win.
1937 BUG10435 MAC : editing/selection/designmode-no-caret.html = FAIL
1938
1939 // Flakey. Not clear when it started, but it was before 3/9/09.
1940 // This test also started failing with the merge of March 25th 2009
1941 BUG10441 WIN DEBUG : transitions/transition-end-event-transform.html = FAIL PASS
1942 BUG10441 MAC WIN RELEASE : transitions/transition-end-event-transform.html = FAI L PASS
1943
1944 // This test hits a stack-overflow exception earlier in debug mode than in
1945 // release mode on Windows.
1946 //
1947 // Hits the stack overflow earlier than before the new compiler in both
1948 // release and debug mode on Linux and Mac.
1949 //
1950 // http://code.google.com/p/v8/issues/detail?id=277
1951 BUG10457 MAC : fast/js/large-expressions.html = FAIL
1952 BUG10457 DEBUG WIN SLOW : fast/js/large-expressions.html = FAIL
1953
1954
1955 // Merge 41768:41807
1956 // Perhaps just needs new baseline?
1957 // These tests were rebaselined with failure long ago. We shouldn't do this, and
1958 // instead work upstream to improve tests so that they don't fail.
1959 // Linux-only failures
1960 BUG10458 LINUX : editing/inserting/6633727.html = FAIL
1961 // Just need rebaseline
1962 BUG10458 LINUX : fast/forms/textarea-width.html = FAIL
1963
1964
1965 // New failures from merge
1966 BUG27486 WIN : fast/forms/listbox-hit-test-zoomed.html = FAIL
1967 BUG27486 RELEASE LINUX : fast/forms/listbox-hit-test-zoomed.html = FAIL
1968 BUG27486 LINUX DEBUG : fast/forms/listbox-hit-test-zoomed.html = FAIL
1969 BUG27486 WIN LINUX : fast/forms/slider-zoomed.html = FAIL
1970
1971 // See WebKit 41948
1972 BUG10468 MAC : fast/replaced/border-radius-clip.html = IMAGE
1973
1974 // Mac flaky failures.
1975 BUG10472 MAC DEBUG : svg/css/glyph-orientation-rounding-test.xhtml = FAIL PASS
1976
1977 // <input type="search">; various failures, some tests may simply need new
1978 // baselines, others have more problems.
1979 BUG10473 LINUX : fast/forms/placeholder-pseudo-style.html = FAIL
1980 BUG10473 LINUX : fast/forms/placeholder-set-value.html = FAIL
1981 BUG10473 LINUX : fast/forms/search-display-none-cancel-button.html = FAIL
1982 BUG10473 LINUX : fast/forms/search-placeholder-value-changed.html = FAIL
1983 BUG10473 LINUX : fast/forms/searchfield-heights.html = FAIL
1984 BUG10473 LINUX : fast/replaced/width100percent-searchfield.html = FAIL
1985
1986 // This test isn't just slow -- sometimes it times out indefinitely.
1987 // r37311:r37313 started making the test fail with a text diff.
1988 BUG27569 BUG33316 LINUX MAC WIN : http/tests/xmlhttprequest/redirect-cross-origi n-tripmine.html = TIMEOUT FAIL PASS
1989
1990 BUG9613 WIN LINUX : fast/dom/clientWidthAfterDocumentIsRemoved.html = IMAGE+TEXT
1991 BUG9613 MAC : fast/dom/clientWidthAfterDocumentIsRemoved.html = TEXT
1992
1993 // Merge WebKit 42133:42199 regressions
1994 BUG20570 LINUX : fast/events/context-no-deselect.html = FAIL
1995
1996 // These tests were affected by rolling out WebKit i8n patches.
1997 // Was only WIN, also fail on LINUX since merge 43346:43361
1998 BUG9768 LINUX WIN : fast/forms/select-initial-position.html = FAIL
1999 // Was only WIN, also fail on LINUX since merge 43346:43361
2000 BUG9768 LINUX WIN : fast/forms/select-visual-hebrew.html = FAIL
2001 // Was only WIN, also fail on LINUX since merge 43346:43361
2002 BUG9768 LINUX WIN : fast/forms/visual-hebrew-text-field.html = FAIL
2003 // Linux looks ok, rebaselined.
2004 BUG9768 WIN : fast/text/cg-fallback-bolding.html = FAIL
2005 BUG9768 WIN : fast/text/international/001.html = FAIL
2006 BUG9768 WIN : fast/text/international/002.html = FAIL
2007 BUG9768 WIN : fast/text/international/003.html = FAIL
2008 BUG9768 WIN : fast/text/international/wrap-CJK-001.html = FAIL
2009
2010 // Merge WebKit 42200:42244 regressions
2011 BUG9786 : fast/dom/Window/dom-access-from-closure-iframe.html = FAIL
2012 BUG9786 : fast/dom/Window/dom-access-from-closure-window.html = FAIL
2013 BUG9786 WIN DEBUG : http/tests/security/cross-frame-access-history-prototype.htm l = FAIL
2014 BUG9786 SLOW WIN RELEASE : http/tests/security/cross-frame-access-history-protot ype.html = FAIL
2015 BUG9786 LINUX MAC : http/tests/security/cross-frame-access-history-prototype.htm l = FAIL
2016 BUG9786 : http/tests/security/cross-frame-access-location-prototype.html = FAIL
2017 BUG9786 : http/tests/security/cross-frame-access-document-direct.html = TIMEOUT
2018 BUG10479 MAC : svg/hixie/perf/001.xml = FAIL
2019 BUG10479 MAC : svg/hixie/perf/002.xml = FAIL
2020
2021 BUG9798 SLOW WIN DEBUG : fast/dom/Window/slow-unload-handler.html = PASS
2022
2023 // Was flaky. Became a consistent failure.
2024 BUG9798 WIN : http/tests/loading/preload-img-test.html = TIMEOUT PASS
2025 BUG9798 WIN DEBUG : http/tests/local/style-access-before-stylesheet-loaded.html = FAIL PASS
2026 BUG9798 WIN DEBUG : http/tests/misc/redirect-with-quotes.php = TIMEOUT PASS
2027 BUG9798 WIN SLOW : http/tests/misc/refresh-headers.php = PASS
2028 BUG9798 WIN : http/tests/security/cross-frame-access-protocol-explicit-domain.ht ml = FAIL PASS
2029 BUG9798 WIN DEBUG : http/tests/security/cross-frame-access-protocol.html = FAIL PASS
2030 BUG9798 RELEASE : http/tests/security/dataURL/xss-DENIED-from-data-url-in-foreig n-domain-subframe.html = TIMEOUT PASS
2031 BUG9798 WIN : http/tests/xmlhttprequest/access-control-basic-allow-preflight-cac he-timeout.html = PASS TIMEOUT
2032 BUG9798 WIN : http/tests/xmlhttprequest/basic-auth.html = TIMEOUT PASS
2033 BUG9798 WIN DEBUG : http/tests/xmlhttprequest/encode-request-url-2.html = TIMEOU T PASS
2034 BUG9797 BUG9798 WIN RELEASE SLOW : http/tests/xmlhttprequest/state-after-network -error.html = PASS
2035 BUG9797 LINUX DEBUG : svg/carto.net/colourpicker.svg = FAIL
2036 BUG9798 LINUX RELEASE : svg/carto.net/colourpicker.svg = FAIL
2037 BUG9798 SLOW LINUX : svg/custom/invisible-text-after-scrolling.xhtml = FAIL
2038 BUG9798 LINUX RELEASE : tables/mozilla/bugs/45621.html = FAIL
2039 BUG9798 LINUX DEBUG SLOW : tables/mozilla/bugs/45621.html = FAIL
2040 //also BUG24868 (crash)
2041 BUG9798 LINUX DEBUG : transitions/mask-transitions.html = FAIL PASS
2042 BUG9798 SLOW LINUX RELEASE : transitions/transition-timing-function.html = PASS
2043 // This test definitely times out (i.e. is not just slow).
2044 BUG9798 WIN RELEASE : http/tests/xmlhttprequest/small-chunks-response-text.html = PASS TIMEOUT
2045 BUG9798 LINUX DEBUG : fast/multicol/float-multicol.html = IMAGE PASS
2046 BUG9798 MAC RELEASE : editing/selection/drag-in-iframe.html = FAIL PASS
2047 BUG9798 LINUX : svg/custom/use-property-changes-through-svg-dom.svg = FAIL
2048 BUG9798 LINUX : svg/custom/js-update-transform-changes.svg = FAIL
2049 // Occasionally times out. Not just slow.
2050 BUG9798 WIN DEBUG : http/tests/loading/redirect-methods.html = TIMEOUT PASS
2051
2052 // New tests or failures from WebKit merge 42324:42364. Re-baselined on
2053 // Windows. Probably just need the same on other platforms.
2054 BUG9962 MAC : fast/js/function-apply-aliased.html = FAIL
2055
2056 // Regressions from WebKit merge 43264:42403, unknown cause(s)
2057 BUG10055 MAC : fast/events/updateLayoutForHitTest.html = FAIL
2058
2059 // New tests from WebKit Merge 42609:42671
2060 BUG10760 LINUX : fast/forms/input-text-scroll-left-on-blur.html = FAIL
2061 BUG10760 LINUX : fast/inline/25277-2.html = FAIL
2062 BUG10760 LINUX : fast/inline/25277.html = FAIL
2063 BUG10760 LINUX : svg/custom/marker-child-changes.svg = PASS FAIL
2064 BUG10760 LINUX : svg/custom/marker-viewBox-changes.svg = FAIL
2065
2066 // New failures from WebKit merge 42725:42805
2067 // WebKit change http://trac.webkit.org/changeset/42785
2068 // added a test which submits a form and then uses history.back()
2069 // to go back. in test_shell history.back() does not go back,
2070 // so the test timeouts.
2071 BUG11001 LINUX MAC WIN : http/tests/history/back-to-post.php = TIMEOUT
2072
2073 // Regressions from WebKit Merge 42932:42994 due to text metric changes.
2074 BUG11251 WIN DEBUG : fast/forms/textarea-width.html = FAIL
2075 BUG11251 SLOW WIN RELEASE : fast/forms/textarea-width.html = FAIL
2076 BUG11251 WIN LINUX RELEASE : fast/forms/text-control-intrinsic-widths.html = FAI L
2077 BUG11251 LINUX WIN DEBUG : fast/forms/text-control-intrinsic-widths.html = FAIL
2078 BUG11251 WIN LINUX : svg/custom/svg-fonts-in-text-controls.html = FAIL
2079 BUG11251 WIN LINUX : fast/forms/textarea-metrics.html = FAIL
2080
2081 // Unimplemented test shell features causing editing tests to fail
2082
2083 // We don't draw the spelling markers at all in test shell.
2084 BUG11577 WIN LINUX : editing/spelling/inline_spelling_markers.html = FAIL
2085 BUG11577 LINUX : editing/spelling/spellcheck-attribute.html = FAIL
2086 BUG11577 WIN LINUX : editing/spelling/spelling-linebreak.html = FAIL
2087
2088 // Regresssions from WebKit Merge 43114:43242 that just need to be re-baselined.
2089 BUG11483 LINUX : fast/forms/input-text-double-click.html = FAIL
2090 BUG11483 LINUX : svg/text/foreignObject-repaint.xml = FAIL
2091
2092 // Regressions from WebKit merge 43242:43321. These just need to re-baselining:
2093 BUG24229 LINUX : fast/forms/select-dirty-parent-pref-widths.html = FAIL
2094 BUG24229 LINUX : svg/transforms/animated-path-inside-transformed-html.xhtml = FA IL
2095 BUG24229 LINUX : svg/transforms/text-with-pattern-inside-transformed-html.xhtml = FAIL
2096 BUG24229 LINUX : svg/transforms/text-with-pattern-with-svg-transform.svg = FAIL
2097
2098 // TODO(erg): Attempted to rebaseline these tests as part of the above
2099 // 43346:43361 rebaseling from http://trac.webkit.org/changeset/43355. Turned
2100 // tree red. May be more involved then just rebaselining.
2101 BUG11613 LINUX : editing/deleting/5168598.html = FAIL
2102 BUG11613 LINUX : editing/inserting/5607069-2.html = FAIL
2103
2104 // Already baselined for chromium-win, may need to be done for mac/linux as well .
2105 BUG11796 LINUX : fast/forms/search-styled.html = FAIL
2106
2107 // Details for all of these are in the bugs.
2108 BUG12361 WIN SLOW : http/tests/cookies/double-quoted-value-with-semi-colon.html = FAIL
2109 BUG12361 LINUX MAC DEBUG : http/tests/cookies/double-quoted-value-with-semi-colo n.html = FAIL
2110 BUG12361 LINUX RELEASE : http/tests/cookies/double-quoted-value-with-semi-colon. html = FAIL
2111 BUG12361 SLOW MAC RELEASE : http/tests/cookies/double-quoted-value-with-semi-col on.html = FAIL
2112
2113 // WebKit 44438:44544
2114 BUG13721 LINUX : fast/dynamic/positioned-movement-with-positioned-children.html = FAIL
2115
2116 BUG14207 LINUX : tables/mozilla/bugs/bug28341.html = FAIL
2117 BUG32231 WIN DEBUG : tables/mozilla/bugs/bug28341.html = IMAGE PASS
2118
2119 // Newly added test http://trac.webkit.org/changeset/44816
2120 BUG18733 WIN SLOW : http/tests/xmlhttprequest/cross-origin-no-authorization.html = FAIL
2121 BUG18733 MAC DEBUG : http/tests/xmlhttprequest/cross-origin-no-authorization.htm l = FAIL TIMEOUT
2122 BUG18733 LINUX MAC RELEASE : http/tests/xmlhttprequest/cross-origin-no-authoriza tion.html = FAIL
2123 BUG18733 LINUX DEBUG : http/tests/xmlhttprequest/cross-origin-no-authorization.h tml = FAIL
2124
2125 BUG14832 : editing/selection/user-drag-element-and-user-select-none.html = FAIL
2126
2127 // WebKit 45017:45086
2128 BUG15217 : fast/js/dictionary-no-cache.html = FAIL
2129 BUG15217 MAC : fast/js/switch-behaviour.html = FAIL
2130
2131 // WebKit 45086:45111
2132 BUG15270 MAC LINUX RELEASE : fast/js/excessive-comma-usage.html = TEXT
2133 BUG15270 MAC LINUX DEBUG SLOW : fast/js/excessive-comma-usage.html = FAIL
2134 BUG15270 WIN : fast/js/excessive-comma-usage.html = CRASH FAIL
2135
2136
2137 // Flaky for a while; also related to BUG17974
2138 BUG15267 WIN LINUX : transitions/cancel-transition.html = PASS FAIL
2139
2140 // WebKit 45431:45444
2141 BUG10384 MAC : fast/events/frame-tab-focus.html = FAIL
2142 BUG11613 LINUX : fast/forms/tabbing-input-iframe.html = FAIL
2143 BUG11613 LINUX RELEASE : fast/overflow/scrollRevealButton.html = FAIL
2144 BUG11613 LINUX DEBUG : fast/overflow/scrollRevealButton.html = FAIL
2145
2146 // WebKit tests regressions 20529:20532
2147 BUG16675 MAC : fast/dynamic/flash-replacement-test.html = FAIL
2148
2149 // WebKit merge 42738:45840
2150 // New test, needs baseline.
2151 BUG16690 SKIP MAC : fast/text/international/khmer-selection.html = FAIL
2152
2153 // WebKit merge 42738:45840
2154 // New tests, need baseline.
2155 BUG16240 WIN DEBUG : http/tests/cache/subresource-expiration.html = TIMEOUT
2156 BUG16240 MAC WIN RELEASE : http/tests/cache/subresource-expiration.html = TIMEOU T
2157 BUG14752 LINUX SLOW : http/tests/cache/subresource-expiration.html = PASS
2158
2159 // New tests with WebKit merge 46288:46363
2160 BUG18116 : fast/dom/constructed-objects-prototypes.html = TEXT
2161 BUG18116 : fast/dom/prototype-inheritance-2.html = TEXT
2162 // New in WebKit r52559
2163 BUG18116 : svg/custom/global-constructors.html = TEXT
2164
2165 // Flaky. Timing?
2166 BUG18584 WIN DEBUG : animations/combo-transform-translate+scale.html = FAIL PASS
2167 BUG18584 WIN DEBUG : animations/change-one-anim.html = PASS TEXT
2168
2169 // Flaky crashes
2170 BUG18656 MAC RELEASE : fast/dom/Window/window-lookup-precedence.html = FAIL
2171 BUG18656 MAC DEBUG : fast/dom/Window/window-lookup-precedence.html = FAIL
2172
2173 // Test failures caused by re-enabling skia asserts.
2174 BUG18896 LINUX WIN DEBUG : svg/batik/paints/gradientLimit.svg = TIMEOUT FAIL
2175
2176 // Test failures from WebKit merge 46894 to 46977
2177 BUG26737 : fast/js/prototypes.html = FAIL
2178
2179 // WebKit roll r47417:47528
2180 BUG19766 LINUX : fast/replaced/width100percent-menulist.html = FAIL
2181
2182 // Fails due to textInputController.setInputMethod not implemented for Mac.
2183 BUG19665 MAC : platform/mac/editing/input/hangul-enter-confirms-and-sends-keypre ss.html = FAIL
2184 BUG19665 MAC : platform/mac/editing/input/kotoeri-enter-to-confirm-and-newline.h tml = FAIL
2185
2186 // WebKit 47777:47790 - getOwnPropertyDescriptor
2187 BUG20345 : fast/js/getOwnPropertyDescriptor.html = FAIL
2188 BUG20345 : fast/dom/Window/window-property-descriptors.html = TEXT
2189 // Failures from Webkit merger 51724 -> 51772
2190 BUG20345 : http/tests/security/cross-frame-access-getOwnPropertyDescriptor.html = TEXT
2191
2192 BUG10480 LINUX : editing/selection/move-by-line-001.html = FAIL
2193
2194 // The linux layout result in build bot shows the changed method does not
2195 // executed.
2196 BUG21141 LINUX : fast/forms/select-double-onchange.html = FAIL
2197 BUG21141 LINUX RELEASE : fast/forms/select-script-onchange.html = FAIL
2198 BUG21141 LINUX DEBUG : fast/forms/select-script-onchange.html = FAIL
2199
2200 // Flaky, not clear as of when.
2201 BUG21411 WIN LINUX DEBUG : svg/dom/SVGScriptElement/script-load-and-error-events .svg = TEXT PASS
2202
2203 // WebKit 48217:48239
2204 // Fails because we don't support layoutTestController.addUserStyleSheet().
2205 BUG21439 : userscripts/simple-stylesheet.html = FAIL
2206
2207 // WK roll to 48371
2208 BUG21841 MAC DEBUG : plugins/destroy-during-npp-new.html = CRASH PASS
2209 BUG21841 WIN DEBUG : plugins/destroy-during-npp-new.html = CRASH PASS
2210
2211 BUG25616 WIN : fast/overflow/overflow-float-stacking.html = FAIL
2212
2213 // Flaky. The width of containing RenderBlocks sometimes becomes larger
2214 BUG21958 MAC : svg/hixie/error/012.xml = FAIL
2215
2216 // WebKit merge 48500:48585, newly implemented Object.defineProperty.
2217 BUG22526 : fast/js/Object-create.html = FAIL
2218 BUG22526 : fast/js/Object-defineProperties.html = FAIL
2219 BUG22526 : fast/js/Object-defineProperty.html = FAIL
2220 BUG22526 : http/tests/security/xss-DENIED-defineProperty.html = FAIL
2221
2222 // WebKit merge 48500:48585, due to newly added support for MathML.
2223 BUG22554 SKIP : mathml = FAIL
2224
2225 // WebKit update 48796:48820
2226 BUG23956 WIN LINUX : fast/dom/Element/getBoundingClientRect.html = FAIL
2227 BUG23956 WIN LINUX : fast/dom/Range/getBoundingClientRect.html = FAIL
2228 BUG23956 WIN LINUX : fast/dom/Range/getClientRects.html = FAIL
2229 BUG24126 : fast/dom/HTMLInputElement/size-attribute.html = FAIL
2230
2231 // Started happening somewhere around http://trac.webkit.org/changeset/48989.
2232 BUG23955 LINUX MAC : fast/css/last-of-type-pseudo-class.html = FAIL
2233
2234 // WebKit update: 49190:49206
2235 BUG_JPARENT LINUX DEBUG SLOW : fast/frames/calculate-fixed.html = PASS
2236
2237 // Started failing for no apparent reason at r28124, and IMAGE+TEXT diffs starte d at r51875
2238
2239 // Flaky timeouts first appearing at r27764 (webkit 48947)
2240 BUG9798 WIN : http/tests/cookies/multiple-cookies.html = TIMEOUT PASS
2241
2242 // WebKit update: 49213:49221
2243 BUG24063 : fast/dom/Window/window-postmessage-clone.html = FAIL
2244
2245 // Got slow with V8 update to 1.3.15. Debug logging perhaps?
2246 BUG24182 DEBUG SLOW : fast/forms/input-implicit-length-limit.html = PASS
2247 BUG24182 DEBUG SLOW : fast/forms/input-maxlength.html = PASS
2248
2249 // Failing at WebKit Linux (dbg)(3) build 7795
2250 BUG24119 LINUX DEBUG : tables/mozilla/bugs/bug1220.html = PASS FAIL
2251
2252 // WebKit roll 49405:49413
2253 BUG28409 : http/tests/xmlhttprequest/logout.html = FAIL
2254
2255 // WebKit Roll 49597:49640
2256 BUG24966 SLOW MAC DEBUG : fast/frames/calculate-fixed.html = PASS
2257
2258 // WebKit Roll 49640:49684
2259 BUG26253 SLOW WIN RELEASE : http/tests/navigation/reload-subframe-object.html = PASS
2260 BUG25202 LINUX WIN : svg/W3C-SVG-1.1/masking-path-02-b.svg = FAIL
2261 BUG25208 LINUX WIN : svg/W3C-SVG-1.1/masking-path-05-f.svg = FAIL
2262 BUG_JEREMY MAC : fast/frames/onlyCommentInIFrame.html = FAIL
2263
2264 // WebKit Roll 49684:49761
2265 BUG26042 DEBUG : http/tests/security/mixedContent/insecure-plugin-in-iframe.html = PASS TEXT
2266 BUG26042 LINUX RELEASE : http/tests/security/mixedContent/insecure-plugin-in-ifr ame.html = PASS TEXT
2267
2268 // Incorrect baseline removed.
2269 BUG25433 WIN LINUX : css2.1/t040103-ident-03-c.html = IMAGE
2270
2271 // WebKit roll 49961:49992
2272 // Added in http://trac.webkit.org/changeset/49990
2273 BUG25884 WIN LINUX : fast/dom/Document/CaretRangeFromPoint/caretRangeFromPoint-i n-zoom-and-scroll.html = FAIL
2274
2275 BUG26344 LINUX DEBUG : fast/text/atsui-partial-selection.html = CRASH
2276 BUG26344 LINUX DEBUG : platform/mac/editing/deleting/backward-delete.html = CRAS H
2277
2278 // More fallout from the above roll.
2279 BUG_JORLOW LINUX : fast/multicol/column-rules-stacking.html = FAIL
2280
2281 // ==== WebKit roll 50258:50313 ====
2282 BUG26291 MAC : fast/text/atsui-multiple-renderers.html = IMAGE
2283 BUG26291 MAC : fast/text/drawBidiText.html = IMAGE
2284 BUG26291 MAC : transforms/2d/hindi-rotated.html = IMAGE
2285
2286 // Flaky since at least WebKit 50258.
2287 BUG9798 WIN DEBUG : media/video-empty-source.html = IMAGE PASS
2288 BUG32098 : fast/dom/defaultView.html = MISSING PASS
2289 BUG9798 WIN RELEASE : http/tests/navigation/no-referrer-reset.html = TIMEOUT PAS S
2290
2291 // more test flakiness
2292 BUG27334 MAC : http/tests/security/xssAuditor/object-embed-tag.html = PASS
2293
2294 // more test flakiness
2295 BUG27418 SLOW WIN RELEASE : http/tests/cookies/simple-cookies-max-age.html = PAS S
2296 BUG27418 SLOW WIN RELEASE : http/tests/misc/url-in-utf16le.html = PASS
2297 BUG27418 MAC DEBUG : http/tests/plugins/interrupted-get-url.html = PASS TEXT
2298 BUG27418 MAC RELEASE SLOW : http/tests/plugins/interrupted-get-url.html = PASS
2299
2300 // The following upstream patches add -Webkit-color-correction support:
2301 // http://trac.webkit.org/changeset/50760
2302 // http://trac.webkit.org/changeset/50852
2303 // The ColorSpace was only implemented for CG, more port implementation
2304 // required in order for Chromium to support color correction.
2305 BUG28005 : fast/css/color-correction-backgrounds-and-text.html = FAIL
2306 BUG28005 : fast/css/color-correction-on-backgrounds.html = FAIL
2307 BUG28005 : fast/css/color-correction-on-text.html = FAIL
2308 BUG28005 : fast/css/color-correction.html = FAIL
2309 BUG28005 MAC : fast/css/color-correction-on-box-shadow.html = IMAGE
2310 BUG28005 WIN LINUX : fast/css/color-correction-on-box-shadow.html = IMAGE+TEXT
2311 BUG28005 MAC : fast/css/color-correction-on-text-shadow.html = IMAGE
2312 BUG28005 WIN LINUX : fast/css/color-correction-on-text-shadow.html = IMAGE+TEXT
2313 BUG28005 : fast/css/color-correction-on-background-image.html = FAIL
2314 BUG28005 : fast/css/color-correction-untagged-images.html = FAIL
2315
2316 // May also be related to r50760, but not as confident.
2317 BUG27551 WIN : fast/css/shadow-multiple.html = IMAGE
2318
2319 // WebKit merge 50756:50820, possibly due to WebKit r50808/r50786 and Chromium r 31715
2320 BUG27553 WIN MAC : fast/text/atsui-partial-selection.html = IMAGE
2321
2322 // WebKit merge 50840:50929
2323 BUG27555 : media/media-fullscreen-inline.html = TIMEOUT
2324 BUG27555 : media/media-fullscreen-not-in-document.html = TIMEOUT
2325
2326 BUG22700 WIN LINUX : fast/canvas/canvas-shadow.html = TEXT
2327
2328
2329 // Failures from merge 50972:51042
2330 // The test requires DRT/Test Shell to support error page handling.
2331 BUG27850 : fast/history/back-forward-reset-after-error-handling.html = TEXT
2332 // Need to update chromium so the web frame delegate is informed when window obj ects
2333 // in isolated worlds are cleared.
2334 BUG27849 : http/tests/security/isolatedWorld/didClearWindowObject.html = TEXT
2335
2336 BUG28040 WIN : fast/body-propagation/overflow/004.html = PASS IMAGE+TEXT
2337 BUG28040 MAC DEBUG : fast/body-propagation/overflow/004.html = PASS IMAGE+TEXT
2338
2339 BUG28040 WIN MAC DEBUG : fast/body-propagation/overflow/003-xhtml.xhtml = PASS I MAGE+TEXT
2340
2341 BUG28092 WIN : http/tests/xmlhttprequest/redirect-cross-origin-post.html = PASS FAIL
2342
2343 // Need to add Chromium localized strings for the feature. Upstream r51172
2344 BUG28264 : fast/forms/validationMessage.html = FAIL
2345
2346 // Video Captions are added upsteram (r51191), need to implement.
2347 BUG28301 : media/media-captions.html = TIMEOUT
2348
2349 // Started failing with move from Lighttpd to Apache.
2350 // Since we have some bots on Lighttpd and some on Apache, mark it as flaky for
2351 // now. Once we decide on one or the other, then we can address these tests.
2352 BUG_OJAN MAC LINUX : http/tests/loading/text-content-type-with-binary-extension. html = TEXT
2353 BUG_OJAN MAC : http/tests/xmlhttprequest/web-apps/012.html = TEXT
2354 BUG_OJAN LINUX : http/tests/xmlhttprequest/cache-override.html = TEXT
2355
2356 // These tests time out *and* are slow. The test should be fixed to not timeout,
2357 // then should be marked as SLOW/PASS.
2358 BUG2844 WIN : http/tests/appcache/cyrillic-uri.html = TIMEOUT PASS CRASH
2359 BUG2844 WIN : http/tests/appcache/fail-on-update.html = TIMEOUT PASS TEXT CRASH
2360 BUG2844 WIN : http/tests/appcache/offline-access.html = TIMEOUT PASS
2361 BUG2844 WIN LINUX DEBUG : http/tests/appcache/update-cache.html = TIMEOUT PASS
2362 BUG2844 WIN RELEASE : http/tests/appcache/update-cache.html = TIMEOUT PASS
2363
2364 // These tests sometimes pass and sometimes have a text difference due
2365 // to chromium's appcache being async.
2366 BUG2844 WIN RELEASE : http/tests/appcache/top-frame-3.html = TEXT PASS
2367 BUG2844 MAC LINUX : http/tests/appcache/top-frame-3.html = TEXT PASS
2368 BUG2844 WIN RELEASE : http/tests/appcache/top-frame-4.html = TEXT PASS
2369 BUG2844 MAC LINUX : http/tests/appcache/top-frame-4.html = TEXT PASS
2370
2371 // These fail because chromium's appcache is async but webkit's is not.
2372 BUG2844 SKIP : http/tests/appcache/idempotent-update.html = FAIL
2373 BUG2844 SKIP : http/tests/appcache/top-frame-2.html = FAIL
2374
2375 // This test fails because there is no setAppCacheMaximumSize API yet.
2376 BUG2844 SKIP : http/tests/appcache/max-size.html = FAIL
2377
2378 // Flakiness documented around Webkit Roll 51681:51711
2379 BUG2844 SKIP : http/tests/appcache/404-manifest.html = TIMEOUT PASS
2380 BUG2844 SKIP : http/tests/appcache/404-resource.html = TIMEOUT PASS
2381 BUG2844 SKIP : http/tests/appcache/foreign-iframe-main.html = TIMEOUT PASS
2382 BUG2844 SKIP : http/tests/appcache/non-html.xhtml = TIMEOUT PASS
2383
2384 // New tests. Failures from merge 51253:51310.
2385 // Needs to implement NPN_reloadPlugins and add reloadPluginNoPages & reloadPlug inAndPages
2386 // to plugin object.
2387 BUG29018 : plugins/reloadplugins-no-pages.html = TEXT
2388 BUG29018 : plugins/reloadplugins-and-pages.html = TIMEOUT
2389
2390 // New tests. Failures from merge 51210:51325.
2391 BUG28646 : editing/selection/transformed-selection-rects.html = FAIL
2392
2393 // New failures from merge 51412:51455.
2394 BUG28916 MAC : editing/pasteboard/paste-xml.xhtml = TEXT
2395
2396 // New failures from WebKit r51534:r51576
2397 BUG29157 WIN LINUX MAC : svg/animations/animVal-basics.html = TIMEOUT
2398
2399 // New failures from WebKit r51577
2400 BUG29164 WIN LINUX MAC : fast/frames/sandboxed-iframe-plugins.html = TEXT
2401
2402 // New failures from WebKit merge 51581:51584
2403 BUG29167 MAC DEBUG : fast/dom/replaceChild.html = IMAGE PASS
2404
2405 // Failure from WebKit merge 51607:51613 (51608 is the cause)
2406 BUG29239 : fast/css/variables/misplaced-import-test.html = FAIL
2407
2408 // Failures from WebKit merge 51642:51681
2409 BUG29393 : fast/loader/stateobjects/pushstate-object-types.html = TEXT
2410 BUG29393 : fast/loader/stateobjects/state-api-on-detached-frame-crash.html = TEX T
2411
2412 BUG29944 WIN : websocket/tests/unicode.html = TEXT PASS
2413
2414 // Failures introduced by USE_NEW_BUILDER in Skia.
2415 BUG33287 WIN LINUX : fast/canvas/set-colors.html = TEXT
2416
2417 // Failures from WebKit merge 51711:51724
2418 BUG32003 : fast/js/string-property-deletion.html = TEXT
2419 BUG31998 LINUX : svg/carto.net/selectionlist.svg = IMAGE PASS
2420 BUG31997 DEBUG WIN : fast/body-propagation/overflow/004-xhtml.xhtml = IMAGE+TEXT PASS
2421 BUG29943 WIN : websocket/tests/send.html = TEXT PASS
2422
2423 // Regression from Webkit merge 51772 -> 51784
2424 BUG35329 WIN : http/tests/appcache/resource-redirect-2.html = TIMEOUT PASS
2425
2426 // Webkit Roll to r51875
2427 BUG29748 LINUX : css1/basic/containment.html = IMAGE
2428 BUG29748 LINUX : css1/box_properties/padding_right.html = IMAGE
2429 BUG29748 LINUX : css1/font_properties/font_size.html = IMAGE
2430 BUG29748 LINUX : fast/block/float/nested-clearance.html = IMAGE
2431 BUG29748 LINUX : fast/block/positioning/051.html = IMAGE
2432 BUG29748 LINUX : fast/block/positioning/055.html = IMAGE
2433 BUG29748 LINUX : fast/forms/select-change-listbox-size.html = IMAGE
2434 BUG29748 LINUX : fast/frames/iframe-scrolling-attribute.html = IMAGE
2435 BUG29748 LINUX : fast/frames/onlyCommentInIFrame.html = IMAGE
2436 BUG29748 LINUX : fast/multicol/positioned-with-constrained-height.html = IMAGE
2437 BUG29748 LINUX : fast/repaint/overflow-scroll-delete.html = IMAGE
2438 BUG29748 LINUX : http/tests/navigation/error404-frames.html = IMAGE
2439 BUG29748 LINUX : http/tests/navigation/post-frames.html = IMAGE
2440 BUG29748 LINUX : http/tests/navigation/postredirect-frames.html = IMAGE
2441 BUG29748 LINUX : media/video-controls-rendering.html = IMAGE
2442 BUG29748 LINUX : tables/mozilla/bugs/bug137388-2.html = IMAGE
2443 BUG29748 LINUX : tables/mozilla/bugs/bug2479-1.html = IMAGE
2444 BUG29748 LINUX : tables/mozilla/bugs/bug2479-4.html = IMAGE
2445 BUG29748 LINUX : tables/mozilla/bugs/bug29314.html = IMAGE
2446 BUG29748 LINUX : tables/mozilla/bugs/bug2997.html = IMAGE
2447 BUG29748 LINUX : tables/mozilla/bugs/bug32205-2.html = IMAGE
2448 BUG29748 LINUX : tables/mozilla/bugs/bug3977.html = IMAGE
2449 BUG29748 LINUX : tables/mozilla/bugs/bug43854-1.html = IMAGE
2450 BUG29748 LINUX : tables/mozilla/bugs/bug44505.html = IMAGE
2451 BUG29748 LINUX : tables/mozilla/bugs/bug650.html = IMAGE
2452 BUG29748 LINUX : tables/mozilla/bugs/bug73321.html = IMAGE
2453 BUG29748 LINUX : tables/mozilla/bugs/bug96334.html = IMAGE
2454 BUG29748 LINUX : tables/mozilla/bugs/bug96343.html = IMAGE
2455 BUG29748 LINUX : tables/mozilla/core/captions.html = IMAGE
2456 BUG29748 LINUX : tables/mozilla/core/cell_heights.html = IMAGE
2457 BUG29748 LINUX : tables/mozilla/marvin/backgr_simple-table-column.html = IMAGE
2458 BUG29748 LINUX : tables/mozilla/marvin/backgr_simple-table-row.html = IMAGE
2459 BUG29748 LINUX : tables/mozilla/marvin/x_table_bgcolor_rgb.xml = IMAGE
2460 BUG29748 LINUX : tables/mozilla/other/nestedTables.html = IMAGE
2461 BUG29748 LINUX : tables/mozilla/other/test3.html = IMAGE
2462 BUG29748 LINUX : tables/mozilla/other/wa_table_thtd_rowspan.html = IMAGE
2463 BUG29748 LINUX : tables/mozilla/other/wa_table_tr_align.html = IMAGE
2464 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug10140.html = IMAGE
2465 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug1055-2.html = IMAGE
2466 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug106966.html = IMAGE
2467 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug22122.html = IMAGE
2468 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug2479-5.html = IMAGE
2469 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug80762-2.html = IMAGE
2470 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug89315.html = IMAGE
2471 BUG29748 LINUX : tables/mozilla_expected_failures/bugs/bug91057.html = IMAGE
2472 BUG29748 LINUX : tables/mozilla_expected_failures/core/backgrounds.html = IMAGE
2473 BUG29748 LINUX : tables/mozilla_expected_failures/core/captions1.html = IMAGE
2474 BUG29748 LINUX : tables/mozilla_expected_failures/core/col_span2.html = IMAGE
2475 BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_border-table-row -group.html = IMAGE
2476 BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-c ell.html = IMAGE
2477 BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-c olumn-group.html = IMAGE
2478 BUG29748 LINUX : tables/mozilla_expected_failures/marvin/backgr_position-table-r ow.html = IMAGE
2479 BUG29748 LINUX : tables/mozilla_expected_failures/marvin/table_overflow_dirty_re flow_row.html = IMAGE
2480 BUG29748 LINUX : tables/mozilla_expected_failures/other/empty_cells.html = IMAGE
2481 BUG29748 LINUX : tables/mozilla_expected_failures/other/test4.html = IMAGE
2482 BUG29748 WIN DEBUG : fast/forms/input-align-image.html = IMAGE+TEXT PASS
2483
2484 // More Webkit Roll to r51875
2485 BUG29737 MAC : svg/W3C-SVG-1.1/filters-blend-01-b.svg = IMAGE+TEXT
2486 BUG29737 MAC : svg/W3C-SVG-1.1/filters-color-01-b.svg = IMAGE+TEXT
2487 BUG29737 MAC : svg/W3C-SVG-1.1/filters-comptran-01-b.svg = IMAGE+TEXT
2488 BUG29737 MAC : svg/W3C-SVG-1.1/filters-gauss-01-b.svg = IMAGE+TEXT CRASH
2489 BUG29737 MAC : svg/W3C-SVG-1.1/filters-morph-01-f.svg = IMAGE+TEXT CRASH
2490 BUG29737 MAC : svg/W3C-SVG-1.1/filters-offset-01-b.svg = IMAGE+TEXT
2491 BUG29737 MAC : svg/batik/filters/feTile.svg = IMAGE+TEXT
2492 BUG29737 MAC : svg/custom/empty-merge.svg = IMAGE+TEXT IMAGE
2493 BUG29737 MAC : svg/custom/feComponentTransfer-Discrete.svg = IMAGE+TEXT IMAGE
2494 BUG29737 MAC : svg/custom/feComponentTransfer-Gamma.svg = IMAGE+TEXT
2495 BUG29737 MAC : svg/custom/feComponentTransfer-Linear.svg = IMAGE+TEXT IMAGE
2496 BUG29737 MAC : svg/custom/feComponentTransfer-Table.svg = IMAGE+TEXT
2497 BUG29737 MAC : svg/custom/text-filter.svg = IMAGE+TEXT
2498 BUG29737 MAC : svg/filters/feComposite.svg = IMAGE+TEXT
2499 BUG29737 MAC : svg/filters/feDisplacementMap.svg = IMAGE+TEXT TEXT PASS
2500 BUG29737 MAC : svg/filters/feGaussianBlur.svg = IMAGE+TEXT
2501 BUG29737 MAC : svg/filters/feTile.svg = IMAGE+TEXT
2502 BUG29737 MAC : svg/filters/shadow-on-filter.svg = IMAGE+TEXT
2503 BUG29737 MAC : svg/filters/feMerge-wrong-input.svg = TEXT
2504 BUG29737 MAC : svg/custom/use-elementInstance-event-target.svg = IMAGE
2505 BUG29737 MAC : svg/filters/big-sized-filter.svg = IMAGE+TEXT
2506 BUG29737 MAC : svg/filters/filterRes.svg = IMAGE+TEXT
2507 BUG29737 LINUX DEBUG : svg/filters/filterRes.svg = PASS TEXT
2508 BUG29737 MAC : svg/W3C-SVG-1.1/struct-image-02-b.svg = IMAGE
2509 BUG29737 MAC : svg/filters/sourceAlpha.svg = IMAGE+TEXT
2510
2511 // More Webkit Roll to r51875
2512 BUG32432 LINUX DEBUG : svg/filters/feComposite.svg = TIMEOUT PASS
2513
2514 // WebKit Roll to r51915
2515 BUG29930 : fast/loader/input-element-page-cache-crash.html = TIMEOUT PASS CRASH
2516
2517 // Was first marked as (WIN: TEXT, LINUX: TEXT, MAC: IMAGE+TEXT) by
2518 // roll r51875, and then after http://trac.webkit.org/changeset/51936 the
2519 // shadows broke so IMAGE failure was added to WIN/LINUX.
2520 BUG30048 BUG29737 : svg/filters/shadow-on-rect-with-filter.svg = IMAGE+TEXT
2521
2522 // New tests courtesy of: http://trac.webkit.org/changeset/51936:
2523 BUG30048 : svg/css/composite-shadow-example.html = IMAGE
2524 BUG30048 : svg/css/composite-shadow-with-opacity.html = IMAGE
2525
2526 // Broke with http://trac.webkit.org/changeset/51939
2527 BUG30049 : platform/win/editing/selection/doubleclick-should-not-expand-across-l ines.html = TEXT MISSING
2528
2529 // evan's fix rolled out in http://trac.webkit.org/changeset/52071 due to compat issues.
2530 BUG30343 LINUX : fast/css/large-number-round-trip.html = TEXT
2531
2532 // These tests got very flaky (failing 8/10 runs!) after
2533 // http://src.chromium.org/viewvc/chrome?view=rev&revision=34610
2534 // The only relevant change there is that we now sort tests purely
2535 // lexicographically instead of putting the http tests first. This is a good
2536 // thing because it matches upstream. The regressions are likely due to timing
2537 // issues because the http tests moved from one debug shard to another.
2538 // Likely, moving Windows to using Apache2 will fix this as the Linux/Mac builds
2539 // did not get flaky here and moving to Apache made the appcache tests less
2540 // flaky on those platforms.
2541 BUG25977 WIN DEBUG : http/tests/appcache/access-via-redirect.php = TIMEOUT PASS
2542 BUG25977 WIN DEBUG : http/tests/appcache/auth.html = TIMEOUT PASS
2543 BUG25977 WIN DEBUG : http/tests/appcache/crash-when-navigating-away-then-back.ht ml = TIMEOUT PASS
2544 BUG25977 WIN DEBUG : http/tests/appcache/empty-manifest.html = TIMEOUT PASS
2545 // This test is slow on windows, but sometimes times out indefinitely.
2546 // See if this improves when we move to apache.
2547 BUG25977 WIN : http/tests/appcache/fallback.html = TIMEOUT PASS
2548 BUG25977 WIN DEBUG : http/tests/appcache/local-content.html = TIMEOUT PASS
2549 BUG25977 WIN DEBUG : http/tests/appcache/main-resource-hash.html = TIMEOUT PASS
2550 BUG25977 WIN DEBUG : http/tests/appcache/manifest-containing-itself.html = TIMEO UT PASS
2551 BUG25977 WIN DEBUG : http/tests/appcache/manifest-redirect-2.html = TIMEOUT PASS
2552 BUG25977 WIN DEBUG : http/tests/appcache/manifest-redirect.html = TIMEOUT PASS
2553 BUG25977 WIN DEBUG : http/tests/appcache/manifest-with-empty-file.html = TIMEOUT PASS
2554 BUG25977 WIN DEBUG : http/tests/appcache/wrong-content-type.html = TIMEOUT PASS
2555 BUG25977 WIN DEBUG : http/tests/appcache/online-whitelist.html = TIMEOUT PASS
2556 BUG25977 WIN DEBUG : http/tests/appcache/top-frame-1.html = TIMEOUT PASS
2557 BUG25977 WIN DEBUG : http/tests/appcache/whitelist-wildcard.html = TIMEOUT PASS
2558 BUG25977 WIN DEBUG : http/tests/appcache/resource-redirect.html = TIMEOUT PASS
2559 BUG25977 WIN : http/tests/appcache/xhr-foreign-resource.html = TIMEOUT PASS
2560 BUG25977 WIN DEBUG : http/tests/appcache/simple.html = TIMEOUT PASS
2561 BUG25977 WIN DEBUG : http/tests/appcache/reload.html = TIMEOUT PASS
2562 BUG25977 WIN DEBUG : http/tests/appcache/wrong-signature-2.html = TIMEOUT PASS
2563 BUG25977 WIN DEBUG : http/tests/appcache/top-frame-4.html = TIMEOUT TEXT PASS
2564 BUG25977 WIN DEBUG : http/tests/appcache/top-frame-3.html = TIMEOUT TEXT PASS
2565
2566 // Flaky.
2567 BUG9798 WIN LINUX : fast/loader/javascript-url-encoding-2.html = TIMEOUT PASS
2568 BUG9798 WIN RELEASE : fast/loading/subframe-removes-itself.html = TEXT PASS
2569 BUG9798 LINUX MAC : fast/loader/invalid-charset-on-script-crashes-loader.html = TIMEOUT PASS
2570
2571 // Flaky since SVG filters turned on
2572 BUG29737 LINUX DEBUG : svg/filters/feDisplacementMap.svg = TEXT PASS
2573
2574 // WebKit update 52293->52323
2575 BUG31253 : http/tests/security/xss-DENIED-assign-location-href-javascript.html = TEXT
2576
2577 // WebKit update 52323->52366
2578 BUG30826 WIN : platform/win/fast/events/panScroll-imageMap-noHref-scroll.html = TEXT
2579 BUG30826 WIN DEBUG : platform/win/fast/events/panScroll-event-fired.html = PASS TEXT TIMEOUT
2580
2581 // Flaky
2582 BUG30930 LINUX DEBUG : tables/mozilla/bugs/bug15933.html = IMAGE PASS
2583
2584 // WebKit update 52372->52454
2585 BUG30938 MAC : fast/backgrounds/svg-as-background-6.html = IMAGE
2586 BUG30939 : svg/filters/filter-clip.svg = IMAGE+TEXT
2587 // Webkit roll 52198->52205
2588 // Newly added test in r52202
2589 BUG30939 MAC WIN : svg/filters/filter-source-position.svg = IMAGE+TEXT
2590 BUG30939 LINUX RELEASE : svg/filters/filter-source-position.svg = IMAGE+TEXT
2591 BUG30939 LINUX DEBUG : svg/filters/filter-source-position.svg = IMAGE+TEXT IMAGE
2592
2593 // WebKit roll 52468->52535
2594 BUG31991 WIN LINUX : fast/text/international/bidi-layout-across-linebreak.html = TEXT
2595 BUG31252 : http/tests/security/listener/xss-inactive-closure.html = TEXT
2596
2597 // WebKit roll 52633 -> 52667
2598 // On Linux, sometimes the text dump matches. Not sure why.
2599 BUG_DIMICH LINUX : svg/custom/resource-invalidate-on-target-update.svg = IMAGE+T EXT IMAGE
2600
2601 BUG31623 WIN: http/tests/appcache/remove-cache.html = PASS TEXT TIMEOUT
2602
2603 // WebKit roll 52769 -> 52793
2604 BUG31642 LINUX DEBUG: svg/W3C-SVG-1.1/animate-elem-30-t.svg = IMAGE CRASH
2605
2606 // WebKit roll 52852 -> 52867
2607 BUG32018 : websocket/tests/frame-lengths.html = PASS TIMEOUT
2608 BUG32018 DEBUG : websocket/tests/simple-stress.html = PASS TEXT
2609
2610 // Flaky
2611 BUG31803 MAC LINUX : editing/inserting/12882.html = IMAGE PASS
2612
2613 // from http://trac.webkit.org/changeset/53078
2614 BUG32154 LINUX DEBUG : fast/text/find-kana.html = CRASH
2615
2616 // from http://trac.webkit.org/changeset/53086
2617 BUG32153 : svg/dynamic-updates/SVGTextElement-svgdom-rotate-prop.html = TEXT
2618
2619 // a bunch of tests broken before the flakiness fix, i will deal with these
2620 // after the major flakiness goes away
2621 BUG32155 : fast/js/Object-getOwnPropertyNames.html = TEXT
2622
2623 // New flakiness?
2624 BUG32144 WIN RELEASE : svg/webarchive/svg-script-subresouces.svg = CRASH TEXT PA SS
2625 BUG32145 WIN : animations/3d/transform-origin-vs-functions.html = TEXT PASS
2626 BUG32149 WIN RELEASE : fast/dom/Document/early-document-access.html = TIMEOUT PA SS
2627
2628 BUG32195 : fast/repaint/renderer-destruction-by-invalidateSelection-crash.html = IMAGE+TEXT PASS
2629
2630 // Expectations from roll to 53171:53194
2631 BUG32235 LINUX DEBUG : svg/W3C-SVG-1.1/filters-diffuse-01-f.svg = PASS TEXT
2632
2633 // Errors from roll from 53207:53246
2634 BUG32398 RELEASE MAC : svg/custom/resource-invalidate-on-target-update.svg = IMA GE PASS
2635
2636 BUG32308 DEBUG : fast/frames/cached-frame-counter.html = TIMEOUT
2637
2638 // WebKit roll 53341:53451
2639 BUG32670 LINUX : fast/css/zoom-body-scroll.html = TEXT
2640 BUG32673 WIN LINUX : fast/forms/textarea-scrollbar-height.html = TEXT
2641 BUG32675 LINUX : fast/repaint/trailing-floats-root-line-box-overflow.html = IMAG E
2642
2643 // Flaky tests found during the roll.
2644 BUG32679 LINUX DEBUG : http/tests/navigation/lockedhistory-iframe.html = TEXT PA SS
2645 BUG32680 WIN DEBUG : svg/filters/big-sized-filter.svg = TIMEOUT PASS
2646 BUG32682 LINUX : svg/W3C-SVG-1.1/filters-conv-01-f.svg = TEXT PASS
2647 BUG32684 WIN : inspector/timeline-layout.html = TEXT PASS
2648 BUG35519 WIN SKIP : http/tests/inspector/inspect-iframe-from-different-domain.ht ml = PASS
2649 BUG32688 MAC DEBUG : fast/lists/inlineBoxWrapperNullCheck.html = TEXT PASS
2650 BUG32689 MAC LINUX DEBUG : http/tests/security/mixedContent/about-blank-iframe-i n-main-frame.html = TEXT PASS
2651 BUG32692 MAC DEBUG : svg/custom/visibility-override-filter.svg = TEXT PASS
2652 BUG32693 MAC DEBUG : svg/dom/SVGRectElement/rect-modify-rx.svg = TEXT PASS
2653 BUG35773 WIN LINUX : inspector/console-dir.html = CRASH TEXT PASS
2654
2655 BUG33293 SKIP : fast/media/lifetime.html = TIMEOUT
2656
2657 // WebKit roll 53585 -> 53655
2658 BUG32864 WIN LINUX MAC : plugins/mouse-events-fixedpos.html = TEXT
2659
2660 // WebKit roll 53655 -> 53704
2661 BUG32900 WIN LINUX : http/tests/misc/slow-loading-mask.html = IMAGE+TEXT
2662
2663 // WebKit roll 53704 -> 53747
2664 BUG32949 WIN LINUX MAC : fast/dom/Window/invalid-protocol.html = TEXT
2665
2666 // WebKit roll 53704:53787. Not going to fix for now.
2667 BUG33099 : media/video-reverse-play-duration.html = TIMEOUT
2668 BUG33099 : media/video-timeupdate-reverse-play.html = TIMEOUT
2669
2670 BUG21852 DEFER SKIP LINUX WIN : fast/canvas/webgl = CRASH
2671
2672 // Disabled until we get history.{back,forward,go} changed to always be
2673 // asynchronously again.
2674 BUG33350 : fast/dom/location-hash.html = TEXT
2675
2676 // WebKit roll 53941 -> 54015
2677 BUG33358 : fast/dom/Window/window-postmessage-clone-frames.html = TEXT
2678
2679 // WebKit roll 54016 -> 54045
2680 BUG33486 WIN LINUX : fast/text/international/hebrew-vowels.html = IMAGE+TEXT
2681 BUG33486 LINUX : fast/text/international/thai-baht-space.html = IMAGE
2682 BUG33486 LINUX : fast/text/international/thai-line-breaks.html = IMAGE
2683
2684 // WebKit roll 54059 -> 54075
2685 BUG33538 : fast/dom/Window/anonymous-slot-with-changes.html = TEXT
2686
2687 // Flaky test
2688 BUG35064 WIN DEBUG : fast/forms/restore-selection-after-layout.html = TEXT PASS
2689
2690 // WebKit roll 54482 to 54493.
2691 BUG35242 WIN : svg/W3C-SVG-1.1/filters-conv-01-f.svg = TEXT
2692 BUG35242 WIN : svg/W3C-SVG-1.1/text-intro-05-t.svg = TEXT
2693 BUG35242 WIN : svg/batik/text/textFeatures.svg = TEXT
2694 BUG35240 MAC : svg/custom/use-clipped-hit.svg = IMAGE
2695
2696 // WebKit roll 54493 to 54530: new tests.
2697 BUG35114 : fast/js/parser-syntax-check.html = TEXT
2698
2699 // WebKit roll 54530 to 54550
2700 BUG35238 MAC : fast/dom/clone-node-dynamic-style.html = IMAGE
2701
2702 // WebKit roll 54550 to 54559
2703 BUG35238 MAC : svg/overflow/overflow-on-outermost-svg-element-defaults.svg = IMA GE
2704 BUG35238 MAC : svg/overflow/overflow-on-outermost-svg-element-ignore-attribute-1 .svg = IMAGE
2705 BUG35238 MAC : svg/overflow/overflow-on-outermost-svg-element-ignore-attribute-2 .svg = IMAGE
2706 BUG35238 MAC : svg/overflow/overflow-on-outermost-svg-element-ignore-attribute-3 .svg = IMAGE
2707 BUG35238 MAC : svg/overflow/overflow-on-outermost-svg-element-in-xhtml-defaults. xhtml = IMAGE
2708
2709 // WebKit roll 54559 to 54585
2710 BUG35237 : fast/events/multiline-link-arrow-navigation.html = TEXT
2711
2712 // WebKit roll 54596:54648
2713 BUG35387 : platform/win/plugins/plugin-delayed-destroy.html = TIMEOUT
2714
2715 // FFmpeg roll breaks these
2716 BUG35492 MAC LINUX : media/video-played-ranges-1.html = FAIL PASS
2717 BUG35492 : media/video-played-reset.html = FAIL
2718 BUG35492 : media/video-display-toggle.html = CRASH FAIL PASS
2719 BUG35492 : media/controls-drag-timebar.html = FAIL TIMEOUT
2720 BUG35492 : media/video-currentTime-set.html = FAIL TIMEOUT
2721 // Previous to FFmpeg roll expectations
2722 //BUG9798 BUG13907 SLOW LINUX MAC RELEASE : media/video-played-ranges-1.html = F AIL
2723 //BUG9798 BUG13907 SLOW WIN RELEASE : media/video-played-ranges-1.html = FAIL
2724 //BUG9798 BUG13907 WIN DEBUG : media/controls-drag-timebar.html = TEXT TIMEOUT
2725 //BUG9798 BUG13907 RELEASE : media/controls-drag-timebar.html = TEXT
2726 //BUG9798 BUG13907 LINUX MAC DEBUG : media/controls-drag-timebar.html = TEXT
2727 //BUG9798 BUG13907 SLOW WIN RELEASE : media/video-played-ranges-1.html = PASS FA IL
2728 //BUG9798 BUG13907 SLOW MAC WIN RELEASE : media/video-played-reset.html = PASS
2729 //BUG9798 BUG13907 SLOW LINUX DEBUG : media/video-played-reset.html = PASS
2730 //BUG9798 BUG13907 : media/video-currentTime-set.html = PASS FAIL
2731 // The test was added in WebKit r54766 and timeouts in Chromium
2732 BUG13907 : media/video-display-aspect-ratio.html = TIMEOUT PASS
2733
2734 // New test added in WebKit r54783
2735 BUG35822 : plugins/netscape-browser-object-identity.html = TEXT
2736
2737 // Not known when these started failing.
2738 BUG35858 MAC LINUX DEBUG : media/remove-from-document.html = CRASH PASS
2739 BUG35858 MAC RELEASE : media/remove-from-document.html = CRASH PASS TIMEOUT
2740 BUG35858 MAC : media/video-source.html = CRASH PASS
2741 BUG35858 LINUX DEBUG : media/video-source.html = CRASH PASS
2742 BUG35858 MAC LINUX : media/video-source-type.html = CRASH PASS
2743 BUG35858 MAC : media/video-src.html = CRASH PASS
2744 BUG35858 MAC : media/video-src-source.html = CRASH PASS
2745 BUG35858 MAC : media/video-timeupdate-during-playback.html = CRASH PASS
2746
2747 // Newly added in r54826.
2748 BUG35922 : media/video-replaces-poster.html = IMAGE
2749
2750 // Started failing during roll from 54848 -> 54898
2751 // Started failing with 54865. No rebaselines upstream but they don't run pixel tests.
2752 BUG36019 : fast/borders/svg-as-border-image-2.html = IMAGE
2753 BUG36019 : fast/borders/svg-as-border-image.html = IMAGE
2754 BUG36019 : fast/images/svg-as-tiled-background.html = IMAGE
2755
2756 // WebKit roll 55250 to 55339
2757 BUG36966 : fast/loader/about-blank-hash-kept.html = FAIL
2758
2759 BUG37248 LINUX : svg/W3C-SVG-1.1/filters-displace-01-f.svg = IMAGE+TEXT PASS TEX T
2760 BUG37463 MAC DEBUG : svg/custom/transform-ignore-after-invalid.svg = PASS CRASH
2761
2762 // WebKit roll 55512:55584
2763 BUG37540 MAC SKIP : inspector/console-dir.html = CRASH TEXT PASS
2764
2765 BUG37710 MAC SKIP : media/video-src-change.html = CRASH PASS
2766
2767 // WebKit roll 55654 -> 55670
2768 BUG_JIANLI : http/tests/local/send-sliced-dragged-file.html = FAIL
2769
2770 // Bugs that went unreported when we upstreamed run_webkit_tests
2771 BUG37896 MAC LINUX : fast/backgrounds/animated-svg-as-background.html = IMAGE
2772 // New test, added http://trac.webkit.org/changeset/55737
2773 BUG37896 : fast/events/remove-child-onscroll.html = TIMEOUT
2774 // This one may be an actual regression! Started being flaky after
2775 // http://trac.webkit.org/log/?verbose=on&rev=55742&stop_rev=55710
2776 BUG37896 : fast/events/standalone-image-drag-to-editable.html = IMAGE+TEXT
2777 // Caused by http://trac.webkit.org/changeset/55549/
2778 BUG37896 : fast/loader/document-with-fragment-url-4.html = TIMEOUT
2779 // New test, added http://trac.webkit.org/changeset/55546
2780 BUG37896 WIN LINUX : fast/multicol/hit-test-above-or-below.html = TEXT
2781 // Added in http://trac.webkit.org/changeset/55669
2782 BUG37896 : fast/repaint/no-caret-repaint-in-non-content-editable-element.html = IMAGE+TEXT
2783 BUG37896 WIN DEBUG : fast/text/firstline/001.html = PASS CRASH
2784 BUG37896 LINUX MAC DEBUG : fast/text/firstline/001.html = PASS CRASH TIMEOUT
2785 // Added in http://trac.webkit.org/changeset/55587
2786 BUG37896 : media/video-preload.html = TEXT
2787 BUG37896 LINUX DEBUG : fast/images/svg-as-background.html = TIMEOUT
2788 BUG37869 LINUX : fast/images/animated-svg-as-image.html = IMAGE
2789 BUG37869 MAC LINUX SKIP : inspector/timeline-network-resource.html = CRASH
2790 // Three flaky tests noticed during a sheriff rotation.
2791 BUG37962 MAC LINUX DEBUG : fast/dom/HTMLElement/bdo.html = CRASH PASS
2792 BUG37962 LINUX DEBUG : fast/forms/multiple-form-submission-protection-mouse.html = CRASH PASS
2793 BUG37962 MAC : plugins/iframe-shims.html = TEXT PASS
2794
2795 // WebKit roll r55853 -> 55940
2796 // Flaky test
2797 BUG_JIANLI MAC : fast/forms/select-style.html = IMAGE PASS
2798
2799 BUG38375 : plugins/round-trip-npobject.html = TEXT
2800 BUG38376 WIN : editing/deleting/5390681-2.html = IMAGE+TEXT
2801
2802 // WebKit roll 55940 -> 56004
2803 BUG38228 : fast/events/drag-and-drop.html = TEXT
2804
2805 // HTMLProgressElement related tests deferred due to r55980.
2806 BUG38227 DEFER : fast/dom/HTMLProgressElement/progress-element.html = MISSING
2807 BUG38227 DEFER : fast/dom/HTMLProgressElement/set-progress-properties.html = MIS SING
2808
2809 // WebKit roll 56004 -> 56026
2810 BUG38278 : fast/events/continuous-platform-wheelevent-in-scrolling-div.html = TI MEOUT
2811 BUG38278 : fast/events/platform-wheelevent-in-scrolling-div.html = TIMEOUT
2812
2813 // The touch targeting logic was recently changed.
2814 BUG36415 : fast/events/touch/touch-target.html = TEXT
2815
2816 // Need to implement NPP_HandleEvent in the layout_test_plugin
2817 BUG38353 MAC LINUX : plugins/keyboard-events.html = TEXT
2818 BUG38353 MAC LINUX : http/tests/plugins/plugin-document-has-focus.html = TIMEOUT
2819
2820 BUG38392 : plugins/resize-from-plugin.html = TEXT
2821
2822 // Chromium r41818 makes these flaky.
2823 BUG38397 : websocket/tests/url-with-credential.html = TEXT PASS
2824 BUG38397 : websocket/tests/url-with-empty-query.html = TEXT PASS
2825 BUG38397 : websocket/tests/url-with-query-for-no-query.html = TEXT PASS
2826 BUG38397 : websocket/tests/url-with-query.html = TEXT PASS
2827 BUG38397 : websocket/tests/websocket-pending-activity.html = TIMEOUT PASS
2828
2829 // One pixel changes from gray 0x83 to gray 0x81. Valgrind is clean.
2830 BUG38534 LINUX : tables/mozilla/bugs/bug20804.html = IMAGE PASS
2831
2832 // This runs correctly on the builder, using the builder's working directory.
2833 // I can only assume that the Gods are Making Merriment at my expense. --agl
2834 BUG_AGL LINUX : platform/chromium/fast/text/chromium-linux-fontconfig-renderstyl e.html = IMAGE
2835
2836 // WebKit roll 56165:56197.
2837 // New test (http://trac.webkit.org/changeset/56198), requires changes to Plugin Object
2838 BUG38578 : plugins/override-node-method.html = TEXT
2839
2840 // WebKit roll 56197:56239.
2841 // Needs layoutTestController.setMediaType() (implemented on Qt only)
2842 BUG38653 MAC : editing/selection/find-yensign-and-backslash.html = TEXT
2843 BUG38656 : fast/media/print-restores-previous-mediatype.html = TEXT
2844
2845 // Unknown flakiness.
2846 BUG38694 MAC LINUX DEBUG : svg/custom/feDisplacementMap-01.svg = IMAGE+TEXT PASS
2847 BUG38704 WIN RELEASE: svg/text/text-text-06-t.svg = CRASH PASS
2848 BUG38706 : svg/custom/deep-dynamic-updates.svg = IMAGE+TEXT PASS
2849 // Update these upstream.
2850 BUG_DGLAZKOV MAC : editing/style/apply-through-end-of-document.html = TEXT
OLDNEW
« no previous file with comments | « DEPS ('k') | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698