[gardening] Skip flaky vm tests.

runtime/tests/vm/vm.status

 # Copyright (c) 2012, the Dart project authors.  Please see the AUTHORS file
 # for details. All rights reserved. Use of this source code is governed by a
 # BSD-style license that can be found in the LICENSE file.
 
 # Issue 28198

[Vyacheslav Egorov (Google), 2017/06/14 11:52:43]

I have updated the issue. We need to find an owner for these tests or delete
them.

[ahe, 2017/06/14 12:03:44]

Thank you.

-cc/IsolateReload_PendingUnqualifiedCall_InstanceToStatic: Fail, Crash, Timeout
-cc/IsolateReload_PendingUnqualifiedCall_StaticToInstance: Fail, Crash, Timeout
-cc/IsolateReload_PendingConstructorCall_AbstractToConcrete: Fail, Crash, Timeout
-cc/IsolateReload_PendingConstructorCall_ConcreteToAbstract: Fail, Crash, Timeout
-cc/IsolateReload_PendingStaticCall_DefinedToNSM: Fail, Crash, Timeout
-cc/IsolateReload_PendingStaticCall_NSMToDefined: Fail, Crash, Timeout
+cc/IsolateReload_PendingUnqualifiedCall_InstanceToStatic: SkipSlow
+cc/IsolateReload_PendingUnqualifiedCall_StaticToInstance: SkipSlow
+cc/IsolateReload_PendingConstructorCall_AbstractToConcrete: SkipSlow
+cc/IsolateReload_PendingConstructorCall_ConcreteToAbstract: SkipSlow
+cc/IsolateReload_PendingStaticCall_DefinedToNSM: SkipSlow
+cc/IsolateReload_PendingStaticCall_NSMToDefined: SkipSlow
 
 # These tests are expected to crash on all platforms.
-cc/ArrayNew_Overflow_Crash: Crash, Timeout
-cc/AllocGeneric_Overflow: Crash, Timeout
-cc/CodeImmutability: Crash
+cc/ArrayNew_Overflow_Crash: SkipSlow
+cc/AllocGeneric_Overflow: SkipSlow
+cc/CodeImmutability: SkipSlow

[Vyacheslav Egorov (Google), 2017/06/14 11:52:42]

This is not a flaky test, it *must* always crash. Please revert this line.

[ahe, 2017/06/14 12:03:44]

Good catch. I didn't notice this test wasn't timing out.

 cc/Fail0: Fail
 cc/Fail1: Fail
 cc/Fail2: Fail
 
 cc/Dart2JSCompileAll: Fail, Crash # Issue 27369
 cc/Dart2JSCompilerStats: Fail, Crash # Issue 27369
 
 cc/SNPrint_BadArgs: Skip
 
 cc/Profiler_InliningIntervalBoundry: Skip # Differences in ia32, debug, release
 
 # Flaky on buildbot. Issue 5133 and 10409.
-cc/Sleep: Pass, Fail
+cc/Sleep: Skip # Flaky

[Vyacheslav Egorov (Google), 2017/06/14 11:52:42]

Both issues are marked as closed. Could you either reopen an issue or open a new
one to delete this test?

[ahe, 2017/06/14 12:03:44]

Done.

 
 dart/data_uri_import_test/none: SkipByDesign
 
 [ $mode == debug ]
 # This is a benchmark that is not informative in debug mode.
 cc/CorelibIsolateStartup: Skip
 # Negative tests of VerifiedMemory should crash iff in DEBUG mode.
 # TODO(koda): Improve support for negative tests.
 cc/VerifyImplicit_Crash: Crash
 cc/VerifyExplicit_Crash: Crash
@@ skipping 107 matching lines @@
 dart/simd128float32_array_test: Skip # compilers not aware of Simd128
 dart/simd128float32_test: Skip # compilers not aware of Simd128
 
 [ $compiler == dart2js ]
 # The source positions do not match with dart2js.
 dart/optimized_stacktrace_line_test: RuntimeError
 dart/optimized_stacktrace_line_and_column_test: RuntimeError
 
 # Methods can be missing in dart2js stack traces due to inlining.  Also when
 # minifying they can be renamed, which is issue 7953.
-dart/inline_stack_frame_test: RuntimeError, Pass # Issue 7953
+dart/inline_stack_frame_test: Skip # Issue 7953
 
 [ $compiler == dart2js || $compiler == dart2analyzer ]
 # Data uri's not supported by dart2js or the analyzer.
 dart/data_uri*test: Skip
 
 [ $compiler == dart2analyzer ]
 dart/optimized_stacktrace_line_test: StaticWarning
 dart/optimized_stacktrace_line_and_column_test: StaticWarning
 
 [ $compiler == dart2analyzer && $builder_tag == strong ]
@@ skipping 67 matching lines @@
 cc/GuardFieldConstructor2Test: Skip
 cc/GuardFieldConstructorTest: Skip
 cc/GuardFieldFinalListTest: Skip
 cc/GuardFieldFinalVariableLengthListTest: Skip
 cc/GuardFieldSimpleTest: Skip
 
 # This test is meaningless for DBC as allocation stubs are not used.
 cc/RegenerateAllocStubs: Skip
 
 [ $arch == simdbc64 && $mode == release ]
-cc/UseDartApi: Pass,Crash # Issue 28499
+cc/UseDartApi: Skip # Issue 28499
 
 [ $hot_reload || $hot_reload_rollback ]
 dart/spawn_shutdown_test: Skip # We can shutdown an isolate before it reloads.
 dart/spawn_infinite_loop_test: Skip # We can shutdown an isolate before it reloads.
 
 [ ($compiler == dartkp) && ($runtime == vm || $runtime == dart_precompiled) && ! $checked ]
 dart/redirection_type_shuffling_test/00: RuntimeError # Issue 29201
 
 [ ($compiler == dartkp) && ($runtime == vm || $runtime == dart_precompiled) ]
 dart/byte_array_optimized_test: RuntimeError
 dart/byte_array_test: RuntimeError
 dart/data_uri_import_test/base64: CompileTimeError
 dart/data_uri_import_test/nocharset: CompileTimeError
 dart/data_uri_import_test/nomime: CompileTimeError
 dart/data_uri_import_test/percentencoded: CompileTimeError
 dart/data_uri_import_test/wrongmime: CompileTimeError
 dart/data_uri_spawn_test: RuntimeError
 dart/double_materialize_test: RuntimeError
 dart/double_to_smi_test: RuntimeError
 dart/error_stacktrace_test: RuntimeError
 dart/inline_stack_frame_test: RuntimeError
 dart/optimized_stacktrace_line_test: RuntimeError
 dart/redirection_type_shuffling_test/none: RuntimeError # Issue 29201
 dart/regress29620_test: RuntimeError
-dart/spawn_shutdown_test: Timeout
+dart/spawn_shutdown_test: SkipSlow
 
 [ ($compiler == dartk) && ($runtime == vm) ]
 cc/CanonicalizationInScriptSnapshots: Fail
 cc/ClassHierarchyAnalysis: Crash
 cc/Class_ComputeEndTokenPos: Crash
 cc/CurrentStackTraceInfo: Fail
 cc/CustomIsolates: Crash
 cc/DartGeneratedArrayLiteralMessages: Crash
 cc/DartGeneratedArrayLiteralMessagesWithBackref: Crash
 cc/DartGeneratedListMessages: Crash
 cc/DartGeneratedListMessagesWithBackref: Crash
 cc/DartGeneratedListMessagesWithTypedData: Crash
 cc/DartGeneratedMessages: Crash
 cc/Dart_LoadLibraryPatch_Error1: Fail
 cc/Dart_LoadLibraryPatch_Error2: Fail
 cc/Dart_LoadLibraryPatch_Error3: Fail
 cc/Dart_PropagateError: Fail
 cc/Debug_EvaluateExpr: Fail
 cc/Debug_EvaluateInActivationOfEvaluate: Fail
 cc/Debug_GetClosureInfo: Fail
-cc/Debug_InterruptIsolate: Timeout
+cc/Debug_InterruptIsolate: SkipSlow
 cc/Debug_IsolateID: Fail
 cc/Debug_ListSuperType: Fail
 cc/Debug_ScriptGetTokenInfo_Basic: Fail
 cc/Debug_ScriptGetTokenInfo_MultiLineInterpolation: Fail
 cc/Debugger_PrintBreakpointsToJSONArray: Fail
-cc/Debugger_Rewind_Optimized: Timeout
+cc/Debugger_Rewind_Optimized: SkipSlow
 cc/Debugger_SetBreakpointInFunctionLiteralFieldInitializers: Crash
 cc/ErrorHandleBasics: Fail
 cc/EvalExpression: Crash
 cc/ExternalUint8ClampedArrayAccess: Fail
 cc/ExternalizeConstantStrings: Fail
 cc/FieldAccess: Fail
 cc/Float32x4List: Crash
 cc/FrameLookup: Fail
 cc/FullSnapshot1: Crash
 cc/FullSnapshot: Crash
@@ skipping 70 matching lines @@
 cc/IsolateReload_TearOff_Class_Identity: Fail
 cc/IsolateReload_TearOff_Instance_Equality: Fail
 cc/IsolateReload_TearOff_Library_Identity: Fail
 cc/IsolateReload_TearOff_List_Set: Fail
 cc/IsolateReload_TopLevelParseError: Fail
 cc/IsolateReload_TypeIdentity: Fail
 cc/IsolateReload_TypeIdentityGeneric: Fail
 cc/IsolateReload_TypeIdentityParameter: Fail
 cc/IsolateReload_TypedefAddParameter: Fail
 cc/IsolateReload_TypedefToNotTypedef: Fail
-cc/IsolateShutdownRunDartCode: Pass, Fail # Flaky
+cc/IsolateShutdownRunDartCode: Skip # Flaky
 cc/IsolateSpawn: Crash
 cc/JSON_JSONStream_DartString: Crash
 cc/LazyLoadDeoptimizes: Crash
 cc/LinkedHashMap: Crash
 cc/LinkedHashMap_iteration: Crash
 cc/ListAccess: Crash
 cc/MalformedStringToUTF8: Crash
 cc/MapAccess: Crash
 cc/NativeFieldAccess: Fail
 cc/NativePortPostInteger: Fail
@@ skipping 61 matching lines @@
 cc/ValidateNoSuchMethodStackFrameIteration: Fail
 cc/ValidateStackFrameIteration: Fail
 dart/data_uri_import_test/base64: CompileTimeError
 dart/data_uri_import_test/nocharset: CompileTimeError
 dart/data_uri_import_test/nomime: CompileTimeError
 dart/data_uri_import_test/percentencoded: Fail
 dart/data_uri_import_test/wrongmime: CompileTimeError
 dart/data_uri_spawn_test: RuntimeError
 dart/redirection_type_shuffling_test/00: Crash
 dart/redirection_type_shuffling_test/none: Crash
-dart/spawn_shutdown_test: Timeout
+dart/spawn_shutdown_test: SkipSlow
 
 [ ($compiler == dartk) && ($runtime == vm) && ($mode == release) ]
 cc/Debug_BreakpointStubPatching: Fail
 cc/Debug_InspectObject: Fail
 cc/Debug_InspectStackWithClosure_NotOptimized: Fail
 cc/Debug_InspectStackWithClosure_Optimized: Fail
 cc/Debug_InspectStack_NotOptimized: Fail
 cc/Debug_InspectStack_Optimized: Fail
 cc/DeepStackTraceInfo: Fail
 cc/HashCode: Fail
@@ skipping 68 matching lines @@
 cc/Parser_AllocateVariables_Issue7681: Crash
 cc/Parser_AllocateVariables_MiddleChain: Crash
 cc/Parser_AllocateVariables_NestedCapturedVar: Crash
 cc/Parser_AllocateVariables_TwoChains: Crash
 cc/Profiler_BasicSourcePosition: Crash
 cc/Profiler_BasicSourcePositionOptimized: Crash
 cc/Profiler_BinaryOperatorSourcePosition: Crash
 cc/Profiler_BinaryOperatorSourcePositionOptimized: Crash
 cc/Profiler_SourcePosition: Crash
 cc/Profiler_SourcePositionOptimized: Crash
-cc/Debugger_Rewind_Optimized: Skip # Flaky and times out.