Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(1600)

Side by Side Diff: third_party/WebKit/LayoutTests/SlowTests

Issue 2656813002: run-webkit-tests: Extract slowness information from MANIFEST.json. (Closed)
Patch Set: Improve regex matching, add _get_extras_from_manifest_item() Created 3 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « no previous file | third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # See //docs/testing/layout_test_expectations.md 1 # See //docs/testing/layout_test_expectations.md
2 # for more information on this file. 2 # for more information on this file.
3 3
4 # This file should only mark tests as Slow. If they are failing in some other wa y, that listing should be in TestExpectations. 4 # This file should only mark tests as Slow. If they are failing in some other wa y, that listing should be in TestExpectations.
5 # Lines listed in both files will have the *union* of the expectations. 5 # Lines listed in both files will have the *union* of the expectations.
6 6
7 # In general, we should list tests in this file if they are slower than ~30% of the default timeout time, as we 7 # In general, we should list tests in this file if they are slower than ~30% of the default timeout time, as we
8 # can see a 3x variance or more in test times on the bots. In practice, this mea ns that any test that takes longer 8 # can see a 3x variance or more in test times on the bots. In practice, this mea ns that any test that takes longer
9 # than 2 seconds in Release mode or 6 seconds in Debug mode should be listed her e. 9 # than 2 seconds in Release mode or 6 seconds in Debug mode should be listed her e.
10 10
(...skipping 189 matching lines...) Expand 10 before | Expand all | Expand 10 after
200 crbug.com/453312 html5lib/generated/run-tests6-data.html [ Slow ] 200 crbug.com/453312 html5lib/generated/run-tests6-data.html [ Slow ]
201 crbug.com/453312 html5lib/generated/run-tests7-data.html [ Slow ] 201 crbug.com/453312 html5lib/generated/run-tests7-data.html [ Slow ]
202 crbug.com/453312 html5lib/generated/run-tests9-data.html [ Slow ] 202 crbug.com/453312 html5lib/generated/run-tests9-data.html [ Slow ]
203 crbug.com/453312 html5lib/generated/run-tests10-data.html [ Slow ] 203 crbug.com/453312 html5lib/generated/run-tests10-data.html [ Slow ]
204 crbug.com/453312 html5lib/generated/run-tests16-data.html [ Slow ] 204 crbug.com/453312 html5lib/generated/run-tests16-data.html [ Slow ]
205 crbug.com/453312 html5lib/generated/run-tests19-data.html [ Slow ] 205 crbug.com/453312 html5lib/generated/run-tests19-data.html [ Slow ]
206 crbug.com/453312 html5lib/generated/run-tests20-data.html [ Slow ] 206 crbug.com/453312 html5lib/generated/run-tests20-data.html [ Slow ]
207 crbug.com/453312 html5lib/generated/run-webkit01-data.html [ Slow ] 207 crbug.com/453312 html5lib/generated/run-webkit01-data.html [ Slow ]
208 crbug.com/453312 html5lib/webkit-resumer.html [ Slow ] 208 crbug.com/453312 html5lib/webkit-resumer.html [ Slow ]
209 209
210 crbug.com/577381 external/wpt/encoding/api-invalid-label.html [ Slow ]
211 crbug.com/577381 external/wpt/html/syntax/parsing/html5lib_tests10.html [ Slow ]
212 crbug.com/577381 external/wpt/html/syntax/parsing/html5lib_tests21.html [ Slow ]
213 crbug.com/577381 external/wpt/html/syntax/parsing/html5lib_webkit01.html [ Slow ]
214 crbug.com/577381 external/wpt/html/syntax/parsing/html5lib_domjs-unsafe.html [ S low ]
215
216 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_entities01.html [ Slo w ]
217 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_template.html [ Slow ]
218 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_tests1.html [ Slow ]
219 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_tests16.html [ Slow ]
220 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_tests19.html [ Slow ]
221 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_tests2.html [ Slow ]
222 crbug.com/490511 external/wpt/html/syntax/parsing/html5lib_tests20.html [ Slow ]
223
224 crbug.com/490939 external/wpt/dom/ranges/Range-cloneContents.html [ Slow ]
225 crbug.com/490939 external/wpt/dom/ranges/Range-compareBoundaryPoints.html [ Slow ]
226 crbug.com/490939 external/wpt/dom/ranges/Range-comparePoint.html [ Slow ]
227 crbug.com/490939 external/wpt/dom/ranges/Range-deleteContents.html [ Slow ]
228 crbug.com/490939 external/wpt/dom/ranges/Range-extractContents.html [ Slow ]
229 crbug.com/490939 external/wpt/dom/ranges/Range-insertNode.html [ Slow ]
230 crbug.com/490939 external/wpt/dom/ranges/Range-isPointInRange.html [ Slow ]
231 crbug.com/490939 external/wpt/dom/ranges/Range-mutations-dataChange.html [ Slow ]
232 crbug.com/490939 external/wpt/dom/ranges/Range-set.html [ Slow ]
233 crbug.com/490939 external/wpt/dom/ranges/Range-surroundContents.html [ Slow ]
234 crbug.com/490939 external/wpt/html/dom/reflection-embedded.html [ Slow ]
235 crbug.com/490939 external/wpt/html/dom/reflection-forms.html [ Slow ]
236 crbug.com/490939 external/wpt/html/dom/reflection-grouping.html [ Slow ]
237 crbug.com/490939 external/wpt/html/dom/reflection-metadata.html [ Slow ]
238 crbug.com/490939 external/wpt/html/dom/reflection-obsolete.html [ Slow ]
239 crbug.com/490939 external/wpt/html/dom/reflection-sections.html [ Slow ]
240 crbug.com/490939 external/wpt/html/dom/reflection-tabular.html [ Slow ]
241 crbug.com/490939 external/wpt/html/dom/reflection-text.html [ Slow ]
242 crbug.com/490939 external/wpt/selection/addRange-00.html [ Slow ]
243 crbug.com/490939 external/wpt/selection/addRange-04.html [ Slow ]
244 crbug.com/490939 external/wpt/selection/addRange-08.html [ Slow ]
245 crbug.com/490939 external/wpt/selection/addRange-12.html [ Slow ]
246 crbug.com/490939 external/wpt/selection/addRange-16.html [ Slow ]
247 crbug.com/490939 external/wpt/selection/addRange-20.html [ Slow ]
248 crbug.com/490939 external/wpt/selection/addRange-24.html [ Slow ]
249 crbug.com/490939 external/wpt/selection/addRange-28.html [ Slow ]
250 crbug.com/490939 external/wpt/selection/addRange-32.html [ Slow ]
251 crbug.com/490939 external/wpt/selection/addRange-36.html [ Slow ]
252 crbug.com/490939 external/wpt/selection/addRange-40.html [ Slow ]
253 crbug.com/490939 external/wpt/selection/addRange-44.html [ Slow ]
254 crbug.com/490939 external/wpt/selection/addRange-48.html [ Slow ]
255 crbug.com/490939 external/wpt/selection/addRange-52.html [ Slow ]
256 crbug.com/490939 external/wpt/selection/addRange-56.html [ Slow ]
257 crbug.com/490939 external/wpt/selection/collapse-00.html [ Slow ]
258 crbug.com/490939 external/wpt/selection/collapse-30.html [ Slow ]
259 crbug.com/490939 external/wpt/selection/extend-00.html [ Slow ]
260 crbug.com/490939 external/wpt/selection/extend-20.html [ Slow ]
261 crbug.com/490939 external/wpt/selection/extend-40.html [ Slow ]
262 crbug.com/490939 external/wpt/selection/selectAllChildren.html [ Slow ]
263 crbug.com/490939 external/wpt/svg/interfaces.html [ Slow ]
264
265 # FIXME: These tests might still be buggy and time out. They were marked as Slow on 9/20/2013. 210 # FIXME: These tests might still be buggy and time out. They were marked as Slow on 9/20/2013.
266 # Double-check the data after they've been running another week or so. 211 # Double-check the data after they've been running another week or so.
267 webkit.org/b/58193 [ Win7 ] http/tests/local/fileapi/send-sliced-dragged-file.ht ml [ Slow ] 212 webkit.org/b/58193 [ Win7 ] http/tests/local/fileapi/send-sliced-dragged-file.ht ml [ Slow ]
268 webkit.org/b/58193 [ Win7 ] virtual/mojo-loading/http/tests/local/fileapi/send-s liced-dragged-file.html [ Slow ] 213 webkit.org/b/58193 [ Win7 ] virtual/mojo-loading/http/tests/local/fileapi/send-s liced-dragged-file.html [ Slow ]
269 crbug.com/9798 [ Win Release ] http/tests/navigation/no-referrer-reset.html [ Sl ow ] 214 crbug.com/9798 [ Win Release ] http/tests/navigation/no-referrer-reset.html [ Sl ow ]
270 crbug.com/9798 [ Win Release ] virtual/mojo-loading/http/tests/navigation/no-ref errer-reset.html [ Slow ] 215 crbug.com/9798 [ Win Release ] virtual/mojo-loading/http/tests/navigation/no-ref errer-reset.html [ Slow ]
271 crbug.com/9798 [ Win ] http/tests/cookies/multiple-cookies.html [ Slow ] 216 crbug.com/9798 [ Win ] http/tests/cookies/multiple-cookies.html [ Slow ]
272 crbug.com/9798 [ Win ] virtual/mojo-loading/http/tests/cookies/multiple-cookies. html [ Slow ] 217 crbug.com/9798 [ Win ] virtual/mojo-loading/http/tests/cookies/multiple-cookies. html [ Slow ]
273 crbug.com/9798 http/tests/xmlhttprequest/access-control-basic-allow-preflight-ca che-timeout.html [ Slow ] 218 crbug.com/9798 http/tests/xmlhttprequest/access-control-basic-allow-preflight-ca che-timeout.html [ Slow ]
274 crbug.com/9798 virtual/mojo-loading/http/tests/xmlhttprequest/access-control-bas ic-allow-preflight-cache-timeout.html [ Slow ] 219 crbug.com/9798 virtual/mojo-loading/http/tests/xmlhttprequest/access-control-bas ic-allow-preflight-cache-timeout.html [ Slow ]
(...skipping 21 matching lines...) Expand all
296 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001h.html [ Slow ] 241 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001h.html [ Slow ]
297 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001i.html [ Slow ] 242 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001i.html [ Slow ]
298 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001j.html [ Slow ] 243 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001j.html [ Slow ]
299 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001k.html [ Slow ] 244 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001k.html [ Slow ]
300 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001l.html [ Slow ] 245 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001l.html [ Slow ]
301 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001m.html [ Slow ] 246 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001m.html [ Slow ]
302 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001n.html [ Slow ] 247 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001n.html [ Slow ]
303 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001o.html [ Slow ] 248 crbug.com/492664 external/csswg-test/css-writing-modes-3/text-orientation-script -001o.html [ Slow ]
304 249
305 crbug.com/336481 inspector/jump-to-previous-editing-location.html [ Slow ] 250 crbug.com/336481 inspector/jump-to-previous-editing-location.html [ Slow ]
306 crbug.com/490511 external/wpt/html/rendering/replaced-elements/svg-embedded-sizi ng/ [ Slow ]
307 crbug.com/490511 external/wpt/html/semantics/forms/textfieldselection/selection. html [ Slow ]
308 crbug.com/346259 http/tests/websocket/no-crash-on-cookie-flood.html [ Slow ] 251 crbug.com/346259 http/tests/websocket/no-crash-on-cookie-flood.html [ Slow ]
309 crbug.com/346259 virtual/mojo-loading/http/tests/websocket/no-crash-on-cookie-fl ood.html [ Slow ] 252 crbug.com/346259 virtual/mojo-loading/http/tests/websocket/no-crash-on-cookie-fl ood.html [ Slow ]
310 253
311 crbug.com/522646 http/tests/media/encrypted-media/encrypted-media-encrypted-even t-different-origin.html [ Slow ] 254 crbug.com/522646 http/tests/media/encrypted-media/encrypted-media-encrypted-even t-different-origin.html [ Slow ]
312 crbug.com/522646 virtual/mojo-loading/http/tests/media/encrypted-media/encrypted -media-encrypted-event-different-origin.html [ Slow ] 255 crbug.com/522646 virtual/mojo-loading/http/tests/media/encrypted-media/encrypted -media-encrypted-event-different-origin.html [ Slow ]
313 crbug.com/411164 [ Win ] http/tests/security/powerfulFeatureRestrictions/service worker-on-insecure-origin.html [ Slow ] 256 crbug.com/411164 [ Win ] http/tests/security/powerfulFeatureRestrictions/service worker-on-insecure-origin.html [ Slow ]
314 crbug.com/411164 [ Win ] virtual/mojo-loading/http/tests/security/powerfulFeatur eRestrictions/serviceworker-on-insecure-origin.html [ Slow ] 257 crbug.com/411164 [ Win ] virtual/mojo-loading/http/tests/security/powerfulFeatur eRestrictions/serviceworker-on-insecure-origin.html [ Slow ]
315 crbug.com/510337 inspector/console/console-format.html [ Slow ] 258 crbug.com/510337 inspector/console/console-format.html [ Slow ]
316 crbug.com/357427 http/tests/workers/terminate-during-sync-operation-file.html [ Slow ] 259 crbug.com/357427 http/tests/workers/terminate-during-sync-operation-file.html [ Slow ]
317 crbug.com/357427 virtual/mojo-loading/http/tests/workers/terminate-during-sync-o peration-file.html [ Slow ] 260 crbug.com/357427 virtual/mojo-loading/http/tests/workers/terminate-during-sync-o peration-file.html [ Slow ]
(...skipping 31 matching lines...) Expand 10 before | Expand all | Expand 10 after
349 crbug.com/448670 virtual/mojo-loading/http/tests/serviceworker/chromium/register -different-script-many-times.html [ Slow ] 292 crbug.com/448670 virtual/mojo-loading/http/tests/serviceworker/chromium/register -different-script-many-times.html [ Slow ]
350 crbug.com/516319 [ Win ] http/tests/fetch/ [ Slow ] 293 crbug.com/516319 [ Win ] http/tests/fetch/ [ Slow ]
351 crbug.com/516319 [ Win ] virtual/mojo-loading/http/tests/fetch/ [ Slow ] 294 crbug.com/516319 [ Win ] virtual/mojo-loading/http/tests/fetch/ [ Slow ]
352 295
353 # Most crypto/subtle tests are slow some or most of the time. 296 # Most crypto/subtle tests are slow some or most of the time.
354 crbug.com/459009 crypto/subtle/ [ Slow ] 297 crbug.com/459009 crypto/subtle/ [ Slow ]
355 298
356 crbug.com/24182 [ Debug ] animations/interpolation/transform-interpolation.html [ Slow ] 299 crbug.com/24182 [ Debug ] animations/interpolation/transform-interpolation.html [ Slow ]
357 crbug.com/24182 [ Debug ] animations/interpolation/webkit-transform-interpolatio n.html [ Slow ] 300 crbug.com/24182 [ Debug ] animations/interpolation/webkit-transform-interpolatio n.html [ Slow ]
358 301
359 crbug.com/521857 [ Win Debug ] external/wpt/IndexedDB/idbdatabase_createObjectSt ore10-1000ends.htm [ Slow ]
360
361 crbug.com/528419 [ Linux ] inspector/elements/shadow/shadow-host-display-modes.h tml [ Slow ] 302 crbug.com/528419 [ Linux ] inspector/elements/shadow/shadow-host-display-modes.h tml [ Slow ]
362 crbug.com/528419 inspector/elements/styles-2/pseudo-elements.html [ Slow ] 303 crbug.com/528419 inspector/elements/styles-2/pseudo-elements.html [ Slow ]
363 304
364 crbug.com/529345 [ Win10 ] paint/masks/fieldset-mask.html [ Slow ] 305 crbug.com/529345 [ Win10 ] paint/masks/fieldset-mask.html [ Slow ]
365 crbug.com/552556 [ Win Linux ] virtual/threaded/fast/scroll-behavior/overflow-sc roll-root-frame-animates.html [ Slow ] 306 crbug.com/552556 [ Win Linux ] virtual/threaded/fast/scroll-behavior/overflow-sc roll-root-frame-animates.html [ Slow ]
366 crbug.com/552556 [ Win Linux ] virtual/threaded/fast/scroll-behavior/overflow-sc roll-animates.html [ Slow ] 307 crbug.com/552556 [ Win Linux ] virtual/threaded/fast/scroll-behavior/overflow-sc roll-animates.html [ Slow ]
367 crbug.com/570656 [ Mac ] fast/writing-mode/Kusa-Makura-background-canvas.html [ Slow ] 308 crbug.com/570656 [ Mac ] fast/writing-mode/Kusa-Makura-background-canvas.html [ Slow ]
368 crbug.com/570656 [ Mac ] fast/text/unicode-fallback-font.html [ Slow ] 309 crbug.com/570656 [ Mac ] fast/text/unicode-fallback-font.html [ Slow ]
369 310
370 crbug.com/658211 [ Win7 Debug ] fast/text/line-break-ascii.html [ Slow ] 311 crbug.com/658211 [ Win7 Debug ] fast/text/line-break-ascii.html [ Slow ]
371 312
372 crbug.com/445194 fast/dom/shadow/focus-controller-recursion-crash.html [ Slow ] 313 crbug.com/445194 fast/dom/shadow/focus-controller-recursion-crash.html [ Slow ]
373 314
374 crbug.com/584807 printing/webgl-oversized-printing.html [ Slow ] 315 crbug.com/584807 printing/webgl-oversized-printing.html [ Slow ]
375 crbug.com/584807 virtual/threaded/printing/webgl-oversized-printing.html [ Slow ] 316 crbug.com/584807 virtual/threaded/printing/webgl-oversized-printing.html [ Slow ]
376 317
377 crbug.com/592183 usb/usbDevice.html [ Slow ] 318 crbug.com/592183 usb/usbDevice.html [ Slow ]
378 319
379 crbug.com/594189 virtual/spv2/fast/overflow/lots-of-sibling-inline-boxes.html [ Slow ] 320 crbug.com/594189 virtual/spv2/fast/overflow/lots-of-sibling-inline-boxes.html [ Slow ]
380 321
381 crbug.com/611442 external/wpt/quirks-mode/hashless-hex-color.html [ Slow ]
382
383 crbug.com/614910 virtual/gpu-rasterization/images/pixel-crack-image-background-w ebkit-transform-scale.html [ Slow ] 322 crbug.com/614910 virtual/gpu-rasterization/images/pixel-crack-image-background-w ebkit-transform-scale.html [ Slow ]
384 crbug.com/614910 virtual/gpu-rasterization/images/color-profile-filter.html [ Sl ow ] 323 crbug.com/614910 virtual/gpu-rasterization/images/color-profile-filter.html [ Sl ow ]
385 324
386 crbug.com/623798 paint/images/animated-gif-last-frame-crash.html [ Slow ] 325 crbug.com/623798 paint/images/animated-gif-last-frame-crash.html [ Slow ]
387 326
388 crbug.com/606649 fast/dom/gc-dom-tree-lifetime.html [ Slow ] 327 crbug.com/606649 fast/dom/gc-dom-tree-lifetime.html [ Slow ]
389 328
390 # Slow on Win Debug in part due to incremental linking. 329 # Slow on Win Debug in part due to incremental linking.
391 crbug.com/647192 [ Win Debug ] fast/css3-text/css3-word-break/word-break-all-asc ii.html [ Slow ] 330 crbug.com/647192 [ Win Debug ] fast/css3-text/css3-word-break/word-break-all-asc ii.html [ Slow ]
392 crbug.com/647192 [ Win Debug ] virtual/mojo-loading/webexposed/global-interface- listing.html [ Slow ] 331 crbug.com/647192 [ Win Debug ] virtual/mojo-loading/webexposed/global-interface- listing.html [ Slow ]
(...skipping 12 matching lines...) Expand all
405 344
406 crbug.com/660492 [ Linux ] storage/indexeddb/structured-clone.html [ Slow ] 345 crbug.com/660492 [ Linux ] storage/indexeddb/structured-clone.html [ Slow ]
407 346
408 # Usually plenty fast, but sometimes very slow on windows. 347 # Usually plenty fast, but sometimes very slow on windows.
409 crbug.com/678498 [ Win ] http/tests/serviceworker/foreign-fetch-cors.html [ Slow ] 348 crbug.com/678498 [ Win ] http/tests/serviceworker/foreign-fetch-cors.html [ Slow ]
410 crbug.com/678498 [ Win ] virtual/mojo-loading/http/tests/serviceworker/foreign-f etch-cors.html [ Slow ] 349 crbug.com/678498 [ Win ] virtual/mojo-loading/http/tests/serviceworker/foreign-f etch-cors.html [ Slow ]
411 crbug.com/678498 [ Win ] virtual/service-worker-navigation-preload/http/tests/se rviceworker/foreign-fetch-cors.html [ Slow ] 350 crbug.com/678498 [ Win ] virtual/service-worker-navigation-preload/http/tests/se rviceworker/foreign-fetch-cors.html [ Slow ]
412 crbug.com/678496 [ Win ] http/tests/serviceworker/foreign-fetch-basics.html [ Sl ow ] 351 crbug.com/678496 [ Win ] http/tests/serviceworker/foreign-fetch-basics.html [ Sl ow ]
413 crbug.com/678496 [ Win ] virtual/mojo-loading/http/tests/serviceworker/foreign-f etch-basics.html [ Slow ] 352 crbug.com/678496 [ Win ] virtual/mojo-loading/http/tests/serviceworker/foreign-f etch-basics.html [ Slow ]
414 crbug.com/678496 [ Win ] virtual/service-worker-navigation-preload/http/tests/se rviceworker/foreign-fetch-basics.html [ Slow ] 353 crbug.com/678496 [ Win ] virtual/service-worker-navigation-preload/http/tests/se rviceworker/foreign-fetch-basics.html [ Slow ]
OLDNEW
« no previous file with comments | « no previous file | third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698