Fix bisect script to match a results with {mean, stddev} format.

tools/bisect-perf-regression.py

Index: tools/bisect-perf-regression.py
diff --git a/tools/bisect-perf-regression.py b/tools/bisect-perf-regression.py
index 80d87ef29d35005b8f121972f5affd48df27c7f7..d6d29a9d54eff9c815dbd26781552d81dc2e9c8c 100755
--- a/tools/bisect-perf-regression.py
+++ b/tools/bisect-perf-regression.py
@@ -1953,6 +1953,8 @@ class BisectPerformanceMetrics(object):
     for current_line in text_lines:
       # Parse the output from the performance test for the metric we're
       # interested in.
+      # The log will be parsed looking for format:
+      # <*>RESULT <graph_name>: <trace_name>= <value>
       metric_re = metric_formatted +\
                   "(\s)*(?P<values>[0-9]+(\.[0-9]*)?)"
       metric_re = re.compile(metric_re)
@@ -1961,6 +1963,8 @@ class BisectPerformanceMetrics(object):
       if not regex_results is None:
         values_list += [regex_results.group('values')]
       else:
+        # The log will be parsed looking for format:
+        # <*>RESULT <graph_name>: <trace_name>= [<value>,value,value,...]
         metric_re = metric_formatted +\
                     "(\s)*\[(\s)*(?P<values>[0-9,.]+)\]"
         metric_re = re.compile(metric_re)
@@ -1970,6 +1974,18 @@ class BisectPerformanceMetrics(object):
           metric_values = regex_results.group('values')
 
           values_list += metric_values.split(',')
+        else:
+          # The log will be parsed looking for format:
+          # <*>RESULT <graph_name>: <trace_name>= {<mean>, <std deviation>}

[qyearsley, 2014/05/14 22:28:33]

It would probably be neater/more readable to put these three regular expressions
up at the top (before the loop), and avoid nesting the else expressions. For
example:

single_result_re = metric_re + '\s*(?P<VALUE>[0-9]+(\.[0-9]*)?)'
multi_results_re = metric_re + '\s*\[\s*(?P<VALUES>[0-9,.]+)\]'
mean_stddev_re = (
    metric_re +
    '\s*\{\s*(?P<MEAN>[0-9]+(\.[0-9]*)?),\s*' +
    '(?P<STDDEV>[0-9]+(\.[0-9]*)?)\}')

single_result_match = re.search(single_result_re, current_line)
multi_results_match = re.search(multi_results_re, current_line)
mean_stddev_match = re.search(mean_stddev_re, current_line)

if single_result_match:
  # ...
elif multi_results_match:
  # ...
elif mean_stddev_match:
  # ...
else:
  # ...

Looking more closely at these regular expressions, I have a few questions:
 (1) For single result lines and square-bracket value list result lines, are we
not allowing negative numbers? Most tests don't output negative numbers but some
might and I think it's valid.
 (2) It looks like we're allowing whitespace after the opening bracket but NOT
before the closing bracket. Is there a reason for this? i.e. we're allowing [
1,2] but not [1,2 ]. (Might as well allow space before the closing bracket as
well).
 (3) The second regex is a too accepting. It would accept:
     [123.123.123,.3..3] or [.]
     (But it would not accept: [1, 2, 3] or [-1,2].

[prasadv, 2014/05/15 19:49:09]

Agreed, tried to trim this method and make it more readable.
Also added tests for each of the results patterns.

On 2014/05/14 22:28:33, qyearsley wrote:
Done.

+          metric_re = metric_formatted +\
+                      "(\s)*\{(\s)*(?P<values>[-\d\., ]+)\}"
+          metric_re = re.compile(metric_re)
+          regex_results = metric_re.search(current_line)
+          if not regex_results is None:
+            metric_values = regex_results.group('values')
+            if metric_values:
+              # Here we are interested only in mean.
+              values_list += [metric_values.split(',')[0]]
 
     values_list = [float(v) for v in values_list if IsStringFloat(v)]