| OLD | NEW |
| 1 # Copyright (c) 2012, the Dart project authors. Please see the AUTHORS file | 1 # Copyright (c) 2012, the Dart project authors. Please see the AUTHORS file |
| 2 # for details. All rights reserved. Use of this source code is governed by a | 2 # for details. All rights reserved. Use of this source code is governed by a |
| 3 # BSD-style license that can be found in the LICENSE file. | 3 # BSD-style license that can be found in the LICENSE file. |
| 4 | 4 |
| 5 # This directory contains tests that are intended to show the | 5 # This directory contains tests that are intended to show the |
| 6 # current state of the language. | 6 # current state of the language. |
| 7 | 7 |
| 8 # In order to maintain maximum test coverage for all builds, | 8 # In order to maintain maximum test coverage for all builds, |
| 9 # please use the following procedure to mark a test | 9 # please use the following procedure to mark a test |
| 10 # failed on architectures other than the one you are working on. | 10 # failed on architectures other than the one you are working on. |
| 11 # | 11 # |
| 12 # 1) Copy the old version of the test to | 12 # 1) Copy the old version of the test to |
| 13 # tests/language/src/TestName[Dartc|VM|Frog]Test.dart. | 13 # tests/language/src/TestName[Dartc|VM|Frog]Test.dart. |
| 14 # to maintain coverage. | 14 # to maintain coverage. |
| 15 # 2) File a bug on each architecture for the failure due to the language change. | 15 # 2) File a bug on each architecture for the failure due to the language change. |
| 16 # 3) Update the language/src directory with the updated test. | 16 # 3) Update the language/src directory with the updated test. |
| 17 | 17 |
| 18 [ $component == vm || $component == dartium ] | 18 [ $compiler == none ] |
| 19 GCTest: Fail # Issue 1487 | 19 GCTest: Fail # Issue 1487 |
| 20 ImpliedInterfaceTest: Fail # Bug 5349944 | 20 ImpliedInterfaceTest: Fail # Bug 5349944 |
| 21 FBoundedQuantificationTest: Skip # Issue 439 | 21 FBoundedQuantificationTest: Skip # Issue 439 |
| 22 FieldOverrideTest/none: Fail # Issue 742: field shadowing now allowed | 22 FieldOverrideTest/none: Fail # Issue 742: field shadowing now allowed |
| 23 FieldOverrideTest/01: Fail # Issue 742: field shadowing now allowed | 23 FieldOverrideTest/01: Fail # Issue 742: field shadowing now allowed |
| 24 FieldOverrideTest/02: Fail # Issue 742: field shadowing now allowed | 24 FieldOverrideTest/02: Fail # Issue 742: field shadowing now allowed |
| 25 SuperFieldAccessTest: Fail # Issue 742: field shadowing now allowed | 25 SuperFieldAccessTest: Fail # Issue 742: field shadowing now allowed |
| 26 PseudoKWIllegalTest/03: Fail # Issue 356 | 26 PseudoKWIllegalTest/03: Fail # Issue 356 |
| 27 PseudoKWIllegalTest/08: Fail # Issue 356 | 27 PseudoKWIllegalTest/08: Fail # Issue 356 |
| 28 PseudoKWIllegalTest/10: Fail # Issue 356 | 28 PseudoKWIllegalTest/10: Fail # Issue 356 |
| (...skipping 59 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 88 AssignStaticTypeTest/02: Skip # Issue 2070 (fails only in checked mode) | 88 AssignStaticTypeTest/02: Skip # Issue 2070 (fails only in checked mode) |
| 89 | 89 |
| 90 ConstructorRedirectTest/01: Fail # Issue 2103. | 90 ConstructorRedirectTest/01: Fail # Issue 2103. |
| 91 | 91 |
| 92 # DartC or Frog specific tests that should not be run by the VM | 92 # DartC or Frog specific tests that should not be run by the VM |
| 93 *DartcTest: Skip | 93 *DartcTest: Skip |
| 94 *DartcNegativeTest: Skip | 94 *DartcNegativeTest: Skip |
| 95 *FrogTest: Skip | 95 *FrogTest: Skip |
| 96 *FrogNegativeTest: Skip | 96 *FrogNegativeTest: Skip |
| 97 | 97 |
| 98 [ ($component == vm || $component == dartium) && $unchecked ] | 98 [ $compiler == none && $unchecked ] |
| 99 | 99 |
| 100 IsNotClass3NegativeTest: Fail # Spec unclear. | 100 IsNotClass3NegativeTest: Fail # Spec unclear. |
| 101 Prefix16NegativeTest: Fail # Bug 5532534 | 101 Prefix16NegativeTest: Fail # Bug 5532534 |
| 102 | 102 |
| 103 [ ($component == vm || $component == dartium) && $mode == debug ] | 103 [ $compiler == none && $mode == debug ] |
| 104 GCTest: Skip # Takes too long. | 104 GCTest: Skip # Takes too long. |
| 105 | 105 |
| 106 [ $component == vm && $mode == release ] | 106 [ $compiler == dartc ] |
| 107 | |
| 108 [ $component == dartc || $component == chromium ] | |
| 109 AbstractSyntaxTest/01: Fail | 107 AbstractSyntaxTest/01: Fail |
| 110 ApplicationNegativeTest: Fail | 108 ApplicationNegativeTest: Fail |
| 111 AssertKeywordNegativeTest: Fail | 109 AssertKeywordNegativeTest: Fail |
| 112 AssertTest: Fail # Uses AssertError class. Bug 4385894. | 110 AssertTest: Fail # Uses AssertError class. Bug 4385894. |
| 113 AssignInstanceMethodNegativeTest: Fail | 111 AssignInstanceMethodNegativeTest: Fail |
| 114 BadNamedParametersTest: Fail # Issue 1941 | 112 BadNamedParametersTest: Fail # Issue 1941 |
| 115 BadNamedParameters2Test: Fail # Issue 1941 | 113 BadNamedParameters2Test: Fail # Issue 1941 |
| 116 BodyLessConstructorWrongArgNegativeTest: Fail | 114 BodyLessConstructorWrongArgNegativeTest: Fail |
| 117 CallOperatorTest: Pass # Issue 1355 | 115 CallOperatorTest: Pass # Issue 1355 |
| 118 CharEscapeTest: Pass # Issue 1654 | 116 CharEscapeTest: Pass # Issue 1654 |
| (...skipping 74 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 193 # Add new dartc annotations above in alphabetical order | 191 # Add new dartc annotations above in alphabetical order |
| 194 # | 192 # |
| 195 | 193 |
| 196 # VM or Frog specific tests that should not be run by DartC. | 194 # VM or Frog specific tests that should not be run by DartC. |
| 197 *VMTest: Skip | 195 *VMTest: Skip |
| 198 *VMNegativeTest: Skip | 196 *VMNegativeTest: Skip |
| 199 *FrogTest: Skip | 197 *FrogTest: Skip |
| 200 *FrogNegativeTest: Skip | 198 *FrogNegativeTest: Skip |
| 201 | 199 |
| 202 | 200 |
| 203 [ $component == dartium ] | 201 [ $compiler == none && $runtime == drt ] |
| 204 # TODO: These need to be retriaged. | 202 # TODO: These need to be retriaged. |
| 205 DisablePrivacyTest: Skip | 203 DisablePrivacyTest: Skip |
| 206 RichardsTest: Fail | 204 RichardsTest: Fail |
| 207 StringEscape1NegativeTest: Skip | 205 StringEscape1NegativeTest: Skip |
| 208 GCTest: Skip # Issue 1487 | 206 GCTest: Skip # Issue 1487 |
| 209 | 207 |
| 210 | 208 [ $compiler == frogsh ] |
| 211 [ $component == frogsh ] | |
| 212 ArithmeticTest: Fail # Issue 1470 | 209 ArithmeticTest: Fail # Issue 1470 |
| 213 IntrinsifiedMethodsTest: Fail # Issue 1470 | 210 IntrinsifiedMethodsTest: Fail # Issue 1470 |
| 214 | 211 |
| 215 # This set of four test components (frog, frogsh, frogium, and webdriver) all | 212 [ ($compiler == frog || $compiler == frogsh) && $unchecked ] |
| 216 # consume frog output, so if frog is generating the incorrect code, chances are | |
| 217 # it will fail on all of these components. | |
| 218 # | |
| 219 # Further explanation: | |
| 220 # frog: frog compiler, run using the VM | |
| 221 # frogsh: self-hosted frog compiler | |
| 222 # frogium: Dart code compiled with frog VM running under DumpRenderTree | |
| 223 # webdriver: Dart code compiled with frog VM running on an actual browser | |
| 224 # (Chrome, IE, Firefox, Safari, etc). If a test is only failing on a particular | |
| 225 # browser, you can be more specific about the failure by using $browser: | |
| 226 # [ $component == webdriver && $browser == chrome ] for example. | |
| 227 [ ($component == frog || $component == frogsh || $component == frogium || $compo
nent == webdriver) && $unchecked ] | |
| 228 BoolTest: Fail # Issue 2092 | 213 BoolTest: Fail # Issue 2092 |
| 229 CompileTimeConstantCTest/01: Fail # integers as keys in literal maps. | 214 CompileTimeConstantCTest/01: Fail # integers as keys in literal maps. |
| 230 | 215 |
| 231 [ $component == frog || $component == frogsh || $component == frogium || $compon
ent == webdriver] | 216 [ $component == frog || $compiler == frogsh ] |
| 232 ExceptionTest: Fail # Issue 1785 | 217 ExceptionTest: Fail # Issue 1785 |
| 233 Factory3Test: Fail # Issue 417 | 218 Factory3Test: Fail # Issue 417 |
| 234 Factory2NegativeTest: Fail | 219 Factory2NegativeTest: Fail |
| 235 CallThroughNullGetterTest: Fail # Throw ObjectNotClosure instead of NullPointerE
xception. | 220 CallThroughNullGetterTest: Fail # Throw ObjectNotClosure instead of NullPointerE
xception. |
| 236 CompileTimeConstantCTest/02: Fail # string-concatenated (+) keys in literal maps
. | 221 CompileTimeConstantCTest/02: Fail # string-concatenated (+) keys in literal maps
. |
| 237 CompileTimeConstantDTest: Fail # doesn't recognize 400 + z (with z parameter of
constructor) as compile-time constant. | 222 CompileTimeConstantDTest: Fail # doesn't recognize 400 + z (with z parameter of
constructor) as compile-time constant. |
| 238 CompileTimeConstantETest: Fail | 223 CompileTimeConstantETest: Fail |
| 239 CompileTimeConstantGTest: Fail # compile time constants with super calls to opti
onal arguments. | 224 CompileTimeConstantGTest: Fail # compile time constants with super calls to opti
onal arguments. |
| 240 DisablePrivacyTest: Skip # Issue 1882: Needs --disable_privacy support. | 225 DisablePrivacyTest: Skip # Issue 1882: Needs --disable_privacy support. |
| 241 DoubleToStringAsExponentialTest: Fail # fails due to -0.0. | 226 DoubleToStringAsExponentialTest: Fail # fails due to -0.0. |
| 242 # Once the -0.0 in DoubleToStringAsFixedTest is fixed it will probably need to | 227 # Once the -0.0 in DoubleToStringAsFixedTest is fixed it will probably need to |
| 243 # be moved to a | 228 # be moved to a |
| 244 # [ $component == frog || $component == frogium || $component == webdriver ] | 229 # [ $compiler == frog ] |
| 245 # section. | 230 # section. |
| 246 DoubleToStringAsFixedTest: Fail # fails due to -0.0 and due to rounding in const
ant propagation. | 231 DoubleToStringAsFixedTest: Fail # fails due to -0.0 and due to rounding in const
ant propagation. |
| 247 DoubleToStringAsPrecisionTest: Fail # fails due to -0.0. | 232 DoubleToStringAsPrecisionTest: Fail # fails due to -0.0. |
| 248 ExtendTypeParameterNegativeTest: Skip # Issue 886 | 233 ExtendTypeParameterNegativeTest: Skip # Issue 886 |
| 249 ExtendTypeParameter2NegativeTest: Skip # Issue 886 | 234 ExtendTypeParameter2NegativeTest: Skip # Issue 886 |
| 250 FinalSyntaxTest/none: Fail | 235 FinalSyntaxTest/none: Fail |
| 251 GetSetSyntaxTest/00: Fail # Issue 1571 | 236 GetSetSyntaxTest/00: Fail # Issue 1571 |
| 252 GetSetSyntaxTest/01: Fail # Issue 1571 | 237 GetSetSyntaxTest/01: Fail # Issue 1571 |
| 253 GetSetSyntaxTest/02: Fail # Issue 1571 | 238 GetSetSyntaxTest/02: Fail # Issue 1571 |
| 254 GetSetSyntaxTest/03: Fail # Issue 1571 | 239 GetSetSyntaxTest/03: Fail # Issue 1571 |
| (...skipping 131 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
| 386 | 371 |
| 387 #Issue 1308 | 372 #Issue 1308 |
| 388 NamedParameters2Test: Fail | 373 NamedParameters2Test: Fail |
| 389 NamedParameters3Test: Fail | 374 NamedParameters3Test: Fail |
| 390 NamedParameters4Test: Fail | 375 NamedParameters4Test: Fail |
| 391 | 376 |
| 392 StringEscape4NegativeTest: Fail # Issue 1352 | 377 StringEscape4NegativeTest: Fail # Issue 1352 |
| 393 | 378 |
| 394 Issue4515170Test: Fail | 379 Issue4515170Test: Fail |
| 395 | 380 |
| 396 [ $component == webdriver && $browser == chrome ] | 381 [ $runtime == chrome ] |
| 397 StringEscape1NegativeTest: Skip | 382 StringEscape1NegativeTest: Skip |
| 398 | 383 |
| 399 [ $component == webdriver && ($browser == ff || $browser == safari || $browser =
= ie) ] | 384 [ $runtime == ff || $runtime == safari || $runtime == ie) ] |
| 400 Closure3Test: Fail | 385 Closure3Test: Fail |
| 401 MethodInvocationTest: Fail | 386 MethodInvocationTest: Fail |
| 402 Private3Test: Fail | 387 Private3Test: Fail |
| 403 StackTraceTest: Fail | 388 StackTraceTest: Fail |
| 404 StringInterpolateNPETest: Fail | 389 StringInterpolateNPETest: Fail |
| 405 | 390 |
| 406 # For these tests Frog generates invalid JS. Chrome throws a SyntaxError, but | 391 # For these tests Frog generates invalid JS. Chrome throws a SyntaxError, but |
| 407 # other browsers don't, so they eventually timeout. See issue 1515. | 392 # other browsers don't, so they eventually timeout. See issue 1515. |
| 408 # In any case, we shouldn't be relying on SyntaxError. | 393 # In any case, we shouldn't be relying on SyntaxError. |
| 409 Label2NegativeTest: Skip | 394 Label2NegativeTest: Skip |
| 410 Label3NegativeTest: Skip | 395 Label3NegativeTest: Skip |
| 411 Label5NegativeTest: Skip | 396 Label5NegativeTest: Skip |
| 412 Label6NegativeTest: Skip | 397 Label6NegativeTest: Skip |
| 413 LabelTest: Skip | 398 LabelTest: Skip |
| 414 StringEscape1NegativeTest: Skip | 399 StringEscape1NegativeTest: Skip |
| 415 Switch3NegativeTest: Skip | 400 Switch3NegativeTest: Skip |
| 416 Switch4NegativeTest: Skip | 401 Switch4NegativeTest: Skip |
| 417 ExecuteFinally6Test: Skip | 402 ExecuteFinally6Test: Skip |
| 418 | 403 |
| 419 # TODO(jmesserly): now that we have a bot, we need to set up Opera testing. | 404 # TODO(jmesserly): now that we have a bot, we need to set up Opera testing. |
| 420 [ $component == webdriver && $browser == opera ] | 405 [ $runtime == opera ] |
| 421 *: Skip | 406 *: Skip |
| 422 | 407 |
| 423 [ $component == webdriver && $browser == ff ] | 408 [ $runtime == ff ] |
| 424 NamingTest: Fail | 409 NamingTest: Fail |
| 425 StackOverflowTest: Fail | 410 StackOverflowTest: Fail |
| 426 ExecuteFinally7Test: Skip | 411 ExecuteFinally7Test: Skip |
| 427 StaticFinalField2NegativeTest: Skip | 412 StaticFinalField2NegativeTest: Skip |
| 428 | 413 |
| 429 [ $component == webdriver && $browser == ff && $system == windows ] | 414 [ $runtime == ff && $system == windows ] |
| 430 CTConst2Test: Pass,Fail # Issue 2101 | 415 CTConst2Test: Pass,Fail # Issue 2101 |
| 431 | 416 |
| 432 [ $component == webdriver && $browser == ie ] | 417 [ $runtime == ie ] |
| 433 StackOverflowTest: Fail | 418 StackOverflowTest: Fail |
| 434 ObjectDynamicMethodTest: Fail | 419 ObjectDynamicMethodTest: Fail |
| 435 NumberSyntaxTest: Fail | 420 NumberSyntaxTest: Fail |
| 436 | 421 |
| 437 [ $component == webdriver && $browser == ie && ($system == linux || $system == m
ac) ] | 422 [ $runtime == ie && ($system == linux || $system == mac) ] |
| 438 *: Skip | 423 *: Skip |
| 439 | 424 |
| 440 [ $component == webdriver && $browser == safari && ($system == linux || $system
== windows) ] | 425 [ $runtime == safari && ($system == linux || $system == windows) ] |
| 441 *: Skip | 426 *: Skip |
| 442 | 427 |
| 443 | 428 [ ($compiler == frog || $compiler == frogsh) && $unchecked ] |
| 444 [ ($component == frogsh || $component == frog || $component == frogium) && $unc
hecked ] | |
| 445 PrivateMemberTest/01: Fail # test seems bad - see issue #353 | 429 PrivateMemberTest/01: Fail # test seems bad - see issue #353 |
| 446 PrivateMemberTest/02: Fail # test seems bad - see issue #353 | 430 PrivateMemberTest/02: Fail # test seems bad - see issue #353 |
| 447 PrivateMemberTest/03: Fail # test seems bad - see issue #353 | 431 PrivateMemberTest/03: Fail # test seems bad - see issue #353 |
| 448 PrivateMemberTest/04: Fail # test seems bad - see issue #353 | 432 PrivateMemberTest/04: Fail # test seems bad - see issue #353 |
| 449 | 433 |
| 450 [ ($component == frogsh || $component == frog || $component == frogium) && $che
cked ] | 434 [ ($compiler == frog || $compiler == frogsh) && $checked ] |
| 451 PrivateMemberTest/none: Fail # test seems bad - see issue #353 | 435 PrivateMemberTest/none: Fail # test seems bad - see issue #353 |
| 452 AssignStaticTypeTest/01: Fail # Unrecognized option: --no-enable-type-checks. | 436 AssignStaticTypeTest/01: Fail # Unrecognized option: --no-enable-type-checks. |
| 453 AssignStaticTypeTest/02: Fail # Unrecognized option: --no-enable-type-checks. | 437 AssignStaticTypeTest/02: Fail # Unrecognized option: --no-enable-type-checks. |
| 454 AssignStaticTypeTest/03: Fail # Unrecognized option: --no-enable-type-checks. | 438 AssignStaticTypeTest/03: Fail # Unrecognized option: --no-enable-type-checks. |
| 455 AssignStaticTypeTest/04: Fail # Unrecognized option: --no-enable-type-checks. | 439 AssignStaticTypeTest/04: Fail # Unrecognized option: --no-enable-type-checks. |
| 456 TypeVariableBoundsTest/01: Fail # Issue 2135 | 440 TypeVariableBoundsTest/01: Fail # Issue 2135 |
| 457 TypeVariableBoundsTest/02: Fail # Issue 2135 | 441 TypeVariableBoundsTest/02: Fail # Issue 2135 |
| 458 TypeVariableBoundsTest/05: Fail # Issue 2135 | 442 TypeVariableBoundsTest/05: Fail # Issue 2135 |
| 459 TypeVariableBounds2Test/00: Fail # Issue 2135 | 443 TypeVariableBounds2Test/00: Fail # Issue 2135 |
| 460 TypeVariableBounds2Test/03: Fail # Issue 2135 | 444 TypeVariableBounds2Test/03: Fail # Issue 2135 |
| 461 TypeVariableBounds2Test/05: Fail # Issue 2135 | 445 TypeVariableBounds2Test/05: Fail # Issue 2135 |
| 462 | 446 |
| 463 [ $component == frog || $component == frogsh ] | 447 [ ($compiler == frog || $compiler == frogsh) && $runtime == d8 ] |
| 464 # these tests are inconsistent in frogium and frogsh-node, investigate | 448 # these tests are inconsistent in frogium and frogsh-node, investigate |
| 465 StaticField1RunNegativeTest: Pass | 449 StaticField1RunNegativeTest: Pass |
| 466 StaticField2RunNegativeTest: Pass | 450 StaticField2RunNegativeTest: Pass |
| 467 SyntaxTest/28: Fail # Issue 1109 | 451 SyntaxTest/28: Fail # Issue 1109 |
| 468 SyntaxTest/29: Fail # Issue 1109 | 452 SyntaxTest/29: Fail # Issue 1109 |
| 469 SyntaxTest/31: Fail # Issue 1109 | 453 SyntaxTest/31: Fail # Issue 1109 |
| 470 SyntaxTest/32: Fail # Issue 1109 | 454 SyntaxTest/32: Fail # Issue 1109 |
| 471 SyntaxTest/33: Fail # Issue 1109 | 455 SyntaxTest/33: Fail # Issue 1109 |
| 472 LiteralUnaryPlusTest/01: Fail # Issue 1400 | 456 LiteralUnaryPlusTest/01: Fail # Issue 1400 |
| 473 | 457 |
| 474 [ $component == frog || $component == frogsh || $component == frogium || $compon
ent == webdriver ] | 458 [ $compiler == frog || $compiler == frogsh ] |
| 475 StringEscape3NegativeTest: Fail # Issue 1352 | 459 StringEscape3NegativeTest: Fail # Issue 1352 |
| 476 | 460 |
| 477 [ $component == frogium ] | 461 [ $compiler == frog && $runtime == drt ] |
| 478 # these tests are inconsistent in frogium and frogsh-node, investigate | 462 # these tests are inconsistent in frogium and frogsh-node, investigate |
| 479 StaticField1RunNegativeTest: Pass # but error is not correct | 463 StaticField1RunNegativeTest: Pass # but error is not correct |
| 480 StaticField2RunNegativeTest: Pass # but error is not correct | 464 StaticField2RunNegativeTest: Pass # but error is not correct |
| 481 | 465 |
| 482 [ $component == frog && $mode == debug ] | 466 [ $compiler == frog && $mode == debug ] |
| 483 ConstructorRedirect1NegativeTest: Skip # Undiagnosed infinite loop. | 467 ConstructorRedirect1NegativeTest: Skip # Undiagnosed infinite loop. |
| 484 ConstructorRedirect2NegativeTest: Skip # Undiagnosed infinite loop. | 468 ConstructorRedirect2NegativeTest: Skip # Undiagnosed infinite loop. |
| 485 | 469 |
| 486 [ $arch == simarm ] | 470 [ $arch == simarm ] |
| 487 *: Skip | 471 *: Skip |
| 488 | 472 |
| 489 [ $arch == arm ] | 473 [ $arch == arm ] |
| 490 *: Skip | 474 *: Skip |
| 491 | 475 |
| OLD | NEW |