Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(50)

Side by Side Diff: test/test262/test262.status

Issue 2601393002: [test] Allow command-line flags to be turned on per test262 test (Closed)
Patch Set: Rebase Created 3 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
« no previous file with comments | « no previous file | test/test262/testcfg.py » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 # Copyright 2011 the V8 project authors. All rights reserved. 1 # Copyright 2011 the V8 project authors. All rights reserved.
2 # Redistribution and use in source and binary forms, with or without 2 # Redistribution and use in source and binary forms, with or without
3 # modification, are permitted provided that the following conditions are 3 # modification, are permitted provided that the following conditions are
4 # met: 4 # met:
5 # 5 #
6 # * Redistributions of source code must retain the above copyright 6 # * Redistributions of source code must retain the above copyright
7 # notice, this list of conditions and the following disclaimer. 7 # notice, this list of conditions and the following disclaimer.
8 # * Redistributions in binary form must reproduce the above 8 # * Redistributions in binary form must reproduce the above
9 # copyright notice, this list of conditions and the following 9 # copyright notice, this list of conditions and the following
10 # disclaimer in the documentation and/or other materials provided 10 # disclaimer in the documentation and/or other materials provided
(...skipping 10 matching lines...) Expand all
21 # SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT 21 # SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
22 # LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, 22 # LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
23 # DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY 23 # DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
24 # THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT 24 # THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25 # (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE 25 # (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26 # OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. 26 # OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27 27
28 [ 28 [
29 29
30 [ALWAYS, { 30 [ALWAYS, {
31 ###################### NEEDS INVESTIGATION #######################
32
33 # Date tests that fail in CE(S)T timezone.
34 # https://bugs.chromium.org/p/v8/issues/detail?id=5449
35 'built-ins/Date/prototype/setFullYear/new-value-time-clip': [PASS, FAIL],
36 'built-ins/Date/prototype/setMonth/new-value-time-clip': [PASS, FAIL],
37
38 ###################### MISSING ES6 FEATURES ####################### 31 ###################### MISSING ES6 FEATURES #######################
39 32
40 # https://code.google.com/p/v8/issues/detail?id=4248 33 # https://code.google.com/p/v8/issues/detail?id=4248
41 'language/expressions/compound-assignment/S11.13.2_A5.*': [FAIL], 34 'language/expressions/compound-assignment/S11.13.2_A5.*': [FAIL],
42 'language/expressions/compound-assignment/S11.13.2_A6.*': [FAIL], 35 'language/expressions/compound-assignment/S11.13.2_A6.*': [FAIL],
43 'language/expressions/compound-assignment/S11.13.2_A7.10_T4': [FAIL], 36 'language/expressions/compound-assignment/S11.13.2_A7.10_T4': [FAIL],
44 'language/expressions/compound-assignment/S11.13.2_A7.11_T4': [FAIL], 37 'language/expressions/compound-assignment/S11.13.2_A7.11_T4': [FAIL],
45 'language/expressions/compound-assignment/S11.13.2_A7.1_T4': [FAIL], 38 'language/expressions/compound-assignment/S11.13.2_A7.1_T4': [FAIL],
46 'language/expressions/compound-assignment/S11.13.2_A7.2_T4': [FAIL], 39 'language/expressions/compound-assignment/S11.13.2_A7.2_T4': [FAIL],
47 'language/expressions/compound-assignment/S11.13.2_A7.3_T4': [FAIL], 40 'language/expressions/compound-assignment/S11.13.2_A7.3_T4': [FAIL],
(...skipping 293 matching lines...) Expand 10 before | Expand all | Expand 10 after
341 'language/white-space/mongolian-vowel-separator-eval': [FAIL], 334 'language/white-space/mongolian-vowel-separator-eval': [FAIL],
342 'built-ins/RegExp/S15.10.2.12_A2_T1': [FAIL], 335 'built-ins/RegExp/S15.10.2.12_A2_T1': [FAIL],
343 'built-ins/RegExp/S15.10.2.12_A1_T1': [FAIL], 336 'built-ins/RegExp/S15.10.2.12_A1_T1': [FAIL],
344 'built-ins/parseFloat/S15.1.2.3_A2_T10_U180E': [FAIL], 337 'built-ins/parseFloat/S15.1.2.3_A2_T10_U180E': [FAIL],
345 'built-ins/parseInt/S15.1.2.2_A2_T10_U180E': [FAIL], 338 'built-ins/parseInt/S15.1.2.2_A2_T10_U180E': [FAIL],
346 'built-ins/String/prototype/trim/u180e': [FAIL], 339 'built-ins/String/prototype/trim/u180e': [FAIL],
347 'built-ins/Number/S9.3.1_A3_T2_U180E': [FAIL], 340 'built-ins/Number/S9.3.1_A3_T2_U180E': [FAIL],
348 'built-ins/Number/S9.3.1_A3_T1_U180E': [FAIL], 341 'built-ins/Number/S9.3.1_A3_T1_U180E': [FAIL],
349 'built-ins/Number/S9.3.1_A2_U180E': [FAIL], 342 'built-ins/Number/S9.3.1_A2_U180E': [FAIL],
350 343
344 # https://bugs.chromium.org/p/v8/issues/detail?id=5051
345 'language/expressions/arrow-function/params-trailing-comma': ['--harmony-trail ing-commas'],
346 'language/expressions/arrow-function/params-trailing-comma-length': ['--harmon y-trailing-commas'],
347 'language/expressions/call/trailing-comma': ['--harmony-trailing-commas'],
348 'language/expressions/function/params-trailing-comma': ['--harmony-trailing-co mmas'],
349 'language/expressions/function/params-trailing-comma-arguments': ['--harmony-t railing-commas'],
350 'language/expressions/function/params-trailing-comma-length': ['--harmony-trai ling-commas'],
351 'language/expressions/generators/params-trailing-comma': ['--harmony-trailing- commas'],
352 'language/expressions/generators/params-trailing-comma-arguments': ['--harmony -trailing-commas'],
353 'language/expressions/generators/params-trailing-comma-length': ['--harmony-tr ailing-commas'],
354 'language/expressions/object/method-definition/params-trailing-comma': ['--har mony-trailing-commas'],
355 'language/expressions/object/method-definition/params-trailing-comma-arguments ': ['--harmony-trailing-commas'],
356 'language/expressions/object/method-definition/params-trailing-comma-length': ['--harmony-trailing-commas'],
357 'language/statements/class/definition/params-trailing-comma': ['--harmony-trai ling-commas'],
358 'language/statements/class/definition/params-trailing-comma-arguments': ['--ha rmony-trailing-commas'],
359 'language/statements/class/definition/params-trailing-comma-length': ['--harmo ny-trailing-commas'],
360 'language/statements/function/params-trailing-comma': ['--harmony-trailing-com mas'],
361 'language/statements/function/params-trailing-comma-arguments': ['--harmony-tr ailing-commas'],
362 'language/statements/function/params-trailing-comma-length': ['--harmony-trail ing-commas'],
363 'language/statements/generators/params-trailing-comma': ['--harmony-trailing-c ommas'],
364 'language/statements/generators/params-trailing-comma-length': ['--harmony-tra iling-commas'],
365
366 # https://bugs.chromium.org/p/v8/issues/detail?id=4698
367 'language/expressions/call/tco-call-args': ['--harmony-tailcalls'],
368 'language/expressions/call/tco-member-args': ['--harmony-tailcalls'],
369 'language/expressions/comma/tco-final': ['--harmony-tailcalls'],
370 'language/expressions/conditional/tco-cond': ['--harmony-tailcalls'],
371 'language/expressions/conditional/tco-pos': ['--harmony-tailcalls'],
372 'language/expressions/logical-and/tco-right': ['--harmony-tailcalls'],
373 'language/expressions/logical-or/tco-right': ['--harmony-tailcalls'],
374 'language/expressions/tagged-template/tco-call': ['--harmony-tailcalls'],
375 'language/expressions/tagged-template/tco-member': ['--harmony-tailcalls'],
376 'language/expressions/tco-pos': ['--harmony-tailcalls'],
377 'language/statements/block/tco-stmt': ['--harmony-tailcalls'],
378 'language/statements/block/tco-stmt-list': ['--harmony-tailcalls'],
379 'language/statements/do-while/tco-body': ['--harmony-tailcalls'],
380 'language/statements/for/tco-const-body': ['--harmony-tailcalls'],
381 'language/statements/for/tco-let-body': ['--harmony-tailcalls'],
382 'language/statements/for/tco-lhs-body': ['--harmony-tailcalls'],
383 'language/statements/for/tco-var-body': ['--harmony-tailcalls'],
384 'language/statements/if/tco-else-body': ['--harmony-tailcalls'],
385 'language/statements/if/tco-if-body': ['--harmony-tailcalls'],
386 'language/statements/labeled/tco': ['--harmony-tailcalls'],
387 'language/statements/return/tco': ['--harmony-tailcalls'],
388 'language/statements/switch/tco-case-body': ['--harmony-tailcalls'],
389 'language/statements/switch/tco-case-body-dflt': ['--harmony-tailcalls'],
390 'language/statements/switch/tco-dftl-body': ['--harmony-tailcalls'],
391 'language/statements/try/tco-catch': ['--harmony-tailcalls'],
392 'language/statements/try/tco-catch-finally': ['--harmony-tailcalls'],
393 'language/statements/try/tco-finally': ['--harmony-tailcalls'],
394 'language/statements/while/tco-body': ['--harmony-tailcalls'],
395
351 # https://bugs.chromium.org/p/v8/issues/detail?id=5064 396 # https://bugs.chromium.org/p/v8/issues/detail?id=5064
352 'language/expressions/arrow-function/params-dflt-duplicates': [FAIL], 397 'language/expressions/arrow-function/params-dflt-duplicates': [FAIL],
353 398
354 # https://bugs.chromium.org/p/v8/issues/detail?id=5244 399 # https://bugs.chromium.org/p/v8/issues/detail?id=5244
355 'intl402/NumberFormat/prototype/formatToParts/*': [SKIP], 400 'intl402/NumberFormat/prototype/formatToParts/*': [SKIP],
356 401
357 # https://bugs.chromium.org/p/v8/issues/detail?id=5327 402 # https://bugs.chromium.org/p/v8/issues/detail?id=5327
358 'built-ins/TypedArray/prototype/set/array-arg-negative-integer-offset-throws': [FAIL], 403 'built-ins/TypedArray/prototype/set/array-arg-negative-integer-offset-throws': [FAIL],
359 'built-ins/TypedArray/prototype/set/typedarray-arg-negative-integer-offset-thr ows': [FAIL], 404 'built-ins/TypedArray/prototype/set/typedarray-arg-negative-integer-offset-thr ows': [FAIL],
360 'built-ins/TypedArrays/internals/Set/key-is-minus-zero': [FAIL], 405 'built-ins/TypedArrays/internals/Set/key-is-minus-zero': [FAIL],
(...skipping 54 matching lines...) Expand 10 before | Expand all | Expand 10 after
415 'language/module-code/namespace/internals/own-property-keys-binding-types': [S KIP], 460 'language/module-code/namespace/internals/own-property-keys-binding-types': [S KIP],
416 'language/module-code/namespace/internals/own-property-keys-sort': [SKIP], 461 'language/module-code/namespace/internals/own-property-keys-sort': [SKIP],
417 462
418 # Symbol.toString on namespace objects was made non-configurable, tests need 463 # Symbol.toString on namespace objects was made non-configurable, tests need
419 # to be updated. 464 # to be updated.
420 'language/module-code/namespace/Symbol.toStringTag': [SKIP], 465 'language/module-code/namespace/Symbol.toStringTag': [SKIP],
421 466
422 # Possible spec bug, see comment in https://github.com/tc39/ecma262/pull/747. 467 # Possible spec bug, see comment in https://github.com/tc39/ecma262/pull/747.
423 'language/module-code/namespace/internals/delete-non-exported': [SKIP], 468 'language/module-code/namespace/internals/delete-non-exported': [SKIP],
424 469
470 # https://code.google.com/p/v8/issues/detail?id=4476
471 'built-ins/String/prototype/toLowerCase/special_casing_conditional': ['--icu-c ase-mapping'],
472 'built-ins/String/prototype/toLowerCase/supplementary_plane': ['--icu-case-map ping'],
473 'built-ins/String/prototype/toUpperCase/supplementary_plane': ['--icu-case-map ping'],
474 'built-ins/String/prototype/toLocaleLowerCase/Final_Sigma_U180E': ['--icu-case -mapping'],
475 'built-ins/String/prototype/toLowerCase/Final_Sigma_U180E': ['--icu-case-mappi ng'],
476
477 # https://code.google.com/p/v8/issues/detail?id=4477
478 'built-ins/String/prototype/toLocaleUpperCase/supplementary_plane': ['--icu-ca se-mapping'],
479 'built-ins/String/prototype/toLocaleLowerCase/supplementary_plane': ['--icu-ca se-mapping'],
480 'built-ins/String/prototype/toLocaleLowerCase/special_casing_conditional': ['- -icu-case-mapping'],
481 'intl402/String/prototype/toLocaleLowerCase/special_casing_Azeri': ['--icu-cas e-mapping'],
482 'intl402/String/prototype/toLocaleLowerCase/special_casing_Lithuanian': ['--ic u-case-mapping'],
483 'intl402/String/prototype/toLocaleLowerCase/special_casing_Turkish': ['--icu-c ase-mapping'],
484 'intl402/String/prototype/toLocaleUpperCase/special_casing_Azeri': ['--icu-cas e-mapping'],
485 'intl402/String/prototype/toLocaleUpperCase/special_casing_Lithuanian': ['--ic u-case-mapping'],
486 'intl402/String/prototype/toLocaleUpperCase/special_casing_Turkish': ['--icu-c ase-mapping'],
487
425 ######################## NEEDS INVESTIGATION ########################### 488 ######################## NEEDS INVESTIGATION ###########################
426 489
427 # These test failures are specific to the intl402 suite and need investigation 490 # These test failures are specific to the intl402 suite and need investigation
428 # to be either marked as bugs with issues filed for them or as deliberate 491 # to be either marked as bugs with issues filed for them or as deliberate
429 # incompatibilities if the test cases turn out to be broken or ambiguous. 492 # incompatibilities if the test cases turn out to be broken or ambiguous.
430 # Some of these are related to v8:4361 in being visible side effects from Intl . 493 # Some of these are related to v8:4361 in being visible side effects from Intl .
431 'intl402/6.2.3': [FAIL], 494 'intl402/6.2.3': [FAIL],
432 'intl402/Collator/10.1.2_a': [PASS, FAIL], 495 'intl402/Collator/10.1.2_a': [PASS, FAIL],
433 'intl402/Collator/10.2.3_b': [PASS, FAIL], 496 'intl402/Collator/10.2.3_b': [PASS, FAIL],
434 'intl402/Collator/prototype/10.3_a': [FAIL], 497 'intl402/Collator/prototype/10.3_a': [FAIL],
(...skipping 47 matching lines...) Expand 10 before | Expand all | Expand 10 after
482 # https://github.com/tc39/test262/pull/688#pullrequestreview-14025354 545 # https://github.com/tc39/test262/pull/688#pullrequestreview-14025354
483 'built-ins/Function/internals/Construct/derived-this-uninitialized-realm': [FA IL], 546 'built-ins/Function/internals/Construct/derived-this-uninitialized-realm': [FA IL],
484 547
485 # https://github.com/tc39/test262/pull/688/files#r93657665 548 # https://github.com/tc39/test262/pull/688/files#r93657665
486 'built-ins/TypedArrays/typedarray-arg-other-ctor-buffer-ctor-custom-species-pr oto-from-ctor-realm': [FAIL], 549 'built-ins/TypedArrays/typedarray-arg-other-ctor-buffer-ctor-custom-species-pr oto-from-ctor-realm': [FAIL],
487 'built-ins/TypedArrays/typedarray-arg-same-ctor-buffer-ctor-species-custom-pro to-from-ctor-realm': [FAIL], 550 'built-ins/TypedArrays/typedarray-arg-same-ctor-buffer-ctor-species-custom-pro to-from-ctor-realm': [FAIL],
488 551
489 # https://github.com/tc39/test262/commit/c779cba592fcb39051fd1d467e472ea71aa2b 1d6#commitcomment-20276482 552 # https://github.com/tc39/test262/commit/c779cba592fcb39051fd1d467e472ea71aa2b 1d6#commitcomment-20276482
490 'language/statements/class/strict-mode/arguments-caller': [FAIL], 553 'language/statements/class/strict-mode/arguments-caller': [FAIL],
491 554
555 # Date tests that fail in CE(S)T timezone.
556 # https://bugs.chromium.org/p/v8/issues/detail?id=5449
557 'built-ins/Date/prototype/setFullYear/new-value-time-clip': [PASS, FAIL],
558 'built-ins/Date/prototype/setMonth/new-value-time-clip': [PASS, FAIL],
559
492 ############################ SKIPPED TESTS ############################# 560 ############################ SKIPPED TESTS #############################
493 561
494 # These tests take a looong time to run. 562 # These tests take a looong time to run.
495 'built-ins/decodeURI/S15.1.3.1_A1.10_T1': [SKIP], 563 'built-ins/decodeURI/S15.1.3.1_A1.10_T1': [SKIP],
496 'built-ins/decodeURI/S15.1.3.1_A1.11_T1': [SKIP], 564 'built-ins/decodeURI/S15.1.3.1_A1.11_T1': [SKIP],
497 'built-ins/decodeURI/S15.1.3.1_A1.11_T2': [SKIP], 565 'built-ins/decodeURI/S15.1.3.1_A1.11_T2': [SKIP],
498 'built-ins/decodeURI/S15.1.3.1_A1.12_T1': [SKIP], 566 'built-ins/decodeURI/S15.1.3.1_A1.12_T1': [SKIP],
499 'built-ins/decodeURI/S15.1.3.1_A1.12_T2': [SKIP], 567 'built-ins/decodeURI/S15.1.3.1_A1.12_T2': [SKIP],
500 'built-ins/decodeURI/S15.1.3.1_A2.5_T1': [SKIP], 568 'built-ins/decodeURI/S15.1.3.1_A2.5_T1': [SKIP],
501 'built-ins/decodeURIComponent/S15.1.3.2_A1.11_T1': [SKIP], 569 'built-ins/decodeURIComponent/S15.1.3.2_A1.11_T1': [SKIP],
(...skipping 70 matching lines...) Expand 10 before | Expand all | Expand 10 after
572 640
573 ['variant == asm_wasm', { 641 ['variant == asm_wasm', {
574 '*': [SKIP], 642 '*': [SKIP],
575 }], # variant == asm_wasm 643 }], # variant == asm_wasm
576 644
577 ['variant == wasm_traps', { 645 ['variant == wasm_traps', {
578 '*': [SKIP], 646 '*': [SKIP],
579 }], # variant == wasm_traps 647 }], # variant == wasm_traps
580 648
581 ] 649 ]
OLDNEW
« no previous file with comments | « no previous file | test/test262/testcfg.py » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698