Add Subzero to scons tests on the bots. x86-32 only.

tests/benchmark/nacl.scons

 # -*- python -*-
 # Copyright 2014 The Native Client Authors. All rights reserved.
 # Use of this source code is governed by a BSD-style license that can be
 # found in the LICENSE file.
 
 Import('env')
 
 
 # Disable this on Valgrind because we don't particularly need to measure
 # performance under Valgrind.  Also, disable on emulation, since these
 # are benchmarks and need to run on real hardware.
 is_broken = env.Bit('running_on_valgrind') or env.UsingEmulator()
 
+# Disable for Subzero.  (Alternatively, increase the timeout if possible.)
+# https://code.google.com/p/nativeclient/issues/detail?id=4136
+is_broken = is_broken or env.Bit('use_sz')

[Jim Stichnoth, 2015/03/29 03:12:56]

Would be nice if we could bump the timeout for this test only so that we could
still test correctness.  time_error?  scale_timeout?

[jvoung (off chromium), 2015/03/30 17:56:15]

Could also set "size=huge" (for this case).

size=large gives you 60 seconds * scale_timeout, and huge gives you 1800 *
scale_timeout

Despite the fact that this is under 'large_tests', size still defaults to
'small' which is 2 seconds?

This was under large_tests primarily to avoid running the test in parallel with
other stuff (since this is a benchmark).

[Jim Stichnoth, 2015/03/30 20:36:53]

Managed to find a way to bump the timeout for this one test (thanks Derek!).

+
 libs = []
 if env.Bit('nacl_glibc'):
   # Needed for clock_gettime().
   libs.append('rt')
 
 env.Append(CFLAGS=['-std=c99', '-O2'])
 env.Append(CCFLAGS=['-O2'])
 env.Prepend(CPPPATH=['${MAIN_DIR}/src'])
 
 nexe = env.ComponentProgram(
@@ skipping 11 matching lines @@
 if 'TRUSTED_ENV' not in env:
   Return()
 
 node = env.CommandSelLdrTestNacl(
     'benchmark_test.out', nexe, [env.GetPerfEnvDescription()],
     # Don't hide output: We want the timings to be reported in the
     # Buildbot logs so that Buildbot records the "RESULT" lines.
     capture_output=False)
 env.AddNodeToTestSuite(node, ['large_tests'], 'run_benchmark_test',
                        is_broken=is_broken)