Upstream: Test scripts for Android (phase 2)

build/android/base_test_sharder.py

Index: build/android/base_test_sharder.py
diff --git a/build/android/base_test_sharder.py b/build/android/base_test_sharder.py
new file mode 100644
index 0000000000000000000000000000000000000000..dc05a906f03ecf262d2abb5ea5496ed3258a0fa1
--- /dev/null
+++ b/build/android/base_test_sharder.py
@@ -0,0 +1,103 @@
+#!/usr/bin/python
+# Copyright (c) 2011 The Chromium Authors. All rights reserved.
+# Use of this source code is governed by a BSD-style license that can be
+# found in the LICENSE file.
+
+
+import logging
+import multiprocessing
+
+from test_result import TestResults
+
+
+def _ShardedTestRunnable(test):
+  """Standalone function needed by multiprocessing.Pool."""
+  return test.RunTests()
+
+
+def SetTestsContainer(tests_container):
+  """Sets tests container.
+
+  multiprocessing.Queue can't be pickled across processes, so we need to set
+  this as a 'global', per process, via multiprocessing.Pool.
+  """
+  BaseTestSharder.tests_container = tests_container
+
+
+class BaseTestSharder(object):

[Paweł Hajdan Jr., 2011/10/21 09:12:58]

We have a sharding supervisor written by Charles Lee (Gavin Peters should know
more details). Please try to avoid adding duplicate piece of infrastructure
here.

It seems to me that Charles' supervisor handles more edge cases than this one.

[michaelbai, 2011/10/21 21:08:41]

I didn't get the reply from him yet. I removed this file from CL as it is not
necessary at this stage.

On 2011/10/21 09:12:58, Paweł Hajdan Jr. wrote:

+  """Base class for sharding tests across multiple devices.
+
+  Args:

[Nirnimesh, 2011/10/21 08:16:15]

should go in __init__

+    attached_devices: A list of attached devices.
+  """
+  # See more in SetTestsContainer.
+  tests_container = None
+
+  def __init__(self, attached_devices):
+    self.attached_devices = attached_devices

[Nirnimesh, 2011/10/21 08:16:15]

non-public member vars should have _ prefix

+    self.retries = 1
+    self.tests = []
+
+  def CreateShardedTestRunner(self, device, index):
+    """Factory function to create a suite-specific test runner.
+
+    Args:
+      device: Device serial where this shard will run
+      index: Index of this device in the pool.
+
+    Returns:
+      An object of BaseTestRunner type (that can provide a "RunTests()" method).
+    """
+    pass
+
+  def SetupSharding(self, tests):
+    """Called before starting the shards."""
+    pass
+
+  def OnTestsCompleted(self, test_runners, test_results):
+    """Notifies that we completed the tests."""
+    pass
+
+  def RunShardedTests(self):
+    """Runs the tests in all connected devices.
+
+    Returns:
+      A TestResults object.
+    """
+    logging.warning('*' * 80)

[Nirnimesh, 2011/10/21 08:16:15]

Why warning?
maybe debug or info?

+    logging.warning('Sharding in ' + str(len(self.attached_devices)) +
+                    ' devices.')
+    logging.warning('Note that the output is not synchronized.')
+    logging.warning('Look for the "Final result" banner in the end.')
+    logging.warning('*' * 80)
+    final_results = TestResults()
+    for retry in xrange(self.retries):
+      logging.warning('Try %d of %d' % (retry + 1, self.retries))
+      self.SetupSharding(self.tests)
+      test_runners = []
+      for index, device in enumerate(self.attached_devices):
+        logging.warning('*' * 80)
+        logging.warning('Creating shard %d for %s' % (index, device))
+        logging.warning('*' * 80)
+        test_runner = self.CreateShardedTestRunner(device, index)
+        test_runners += [test_runner]
+      logging.warning('Starting...')
+      pool = multiprocessing.Pool(len(self.attached_devices),
+                                  SetTestsContainer,
+                                  [BaseTestSharder.tests_container])
+      results_lists = pool.map(_ShardedTestRunnable, test_runners)
+      test_results = TestResults.FromTestResults(results_lists)
+      if retry == self.retries - 1:
+        all_passed = final_results.ok + test_results.ok
+        final_results = test_results
+        final_results.ok = all_passed
+        break
+      else:
+        final_results.ok += test_results.ok
+        self.tests = []
+        for t in test_results.GetAllBroken():
+          self.tests += [t.name]
+        if not self.tests:
+          break
+    self.OnTestsCompleted(test_runners, final_results)
+    return final_results