Add timeouts.py to gather task durations.

Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454
Committed: https://crrev.com/b274e87c99da4150b8c4e0f2600b9b5100333142
Cr-Commit-Position: refs/heads/master@{#431890}

[M-A Ruel, 2016-11-08 19:32:45]

Description was changed from

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=dpranke@chromium.org
BUG=402454
==========

to

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454
==========

[M-A Ruel, 2016-11-08 19:32:45]

maruel@chromium.org changed reviewers:
+ phajdan.jr@chromium.org
- dpranke@chromium.org

[M-A Ruel, 2016-11-08 19:43:52]

Patchset #1 (id:1) has been deleted

[M-A Ruel, 2016-11-08 19:48:13]

Patchset #1 (id:20001) has been deleted

[M-A Ruel, 2016-11-08 19:52:18]

Here's sample outputs. The code to start enforcing timeouts will be added later
since it requires change in the recipes. The goal here is to get data to
estimate reasonable timeouts. See http://go/lower-timeout for the rationale. The
recommended timeout listed by the tool is twice the maximum observed runtime
rounded at 120s.


$ ./timeouts.py -h
usage: timeouts.py [-h] -f chromium.foo.json [-s foo_unittest] [-N 200]
                   [-S chromium-swarm.appspot.com]

Calculate reasonable timeout for each step as analysed by the actual runtimes
on the Swarming server.

optional arguments:
  -h, --help            show this help message and exit
  -f chromium.foo.json  file to open
  -s foo_unittest       step to process
  -N 200                number of executions to look at
  -S chromium-swarm.appspot.com
                        server to use


$ ./timeouts.py -f chromium.memory.json
129/129  Elapsed: 25.7s  ETA: 0s   
Linux ASan LSan Tests (1)             / accessibility_unittests      avg:    2s 
 max:    3s   timeout:  120s
Linux ASan LSan Tests (1)             / angle_unittests              avg:  157s 
 max:  205s   timeout:  360s
Linux ASan LSan Tests (1)             / base_unittests               avg:   69s 
 max:   72s   timeout:  120s
Linux ASan LSan Tests (1)             / blink_heap_unittests         avg:   16s 
 max:   26s   timeout:  120s
Linux ASan LSan Tests (1)             / blink_platform_unittests     avg:   62s 
 max:  126s   timeout:  240s
Linux ASan LSan Tests (1)             / browser_tests                avg:  991s 
 max: 1210s   timeout: 2400s
Linux ASan LSan Tests (1)             / cacheinvalidation_unittests  avg:    0s 
 max:    2s   timeout:  120s
Linux ASan LSan Tests (1)             / capture_unittests            avg:    3s 
 max:    6s   timeout:  120s
Linux ASan LSan Tests (1)             / cast_unittests               avg:    5s 
 max:    8s   timeout:  120s
Linux ASan LSan Tests (1)             / cc_unittests                 avg:  170s 
 max:  264s   timeout:  480s
Linux ASan LSan Tests (1)             / components_unittests         avg: 1052s 
 max: 1530s   timeout: 3000s
Linux ASan LSan Tests (1)             / content_browsertests         avg: 1306s 
 max: 1460s   timeout: 2880s
Linux ASan LSan Tests (1)             / content_unittests            avg:  496s 
 max:  561s   timeout: 1080s
(...)
Mac ASan 64 Tests (1)                 / skia_unittests               avg:    2s 
 max:    3s   timeout:  120s
Mac ASan 64 Tests (1)                 / sql_unittests                avg:    2s 
 max:    2s   timeout:  120s
Mac ASan 64 Tests (1)                 / storage_unittests            avg:    1s 
 max:    1s   timeout:  120s
Mac ASan 64 Tests (1)                 / ui_base_unittests            avg:    5s 
 max:    7s   timeout:  120s
Mac ASan 64 Tests (1)                 / unit_tests                   avg:  214s 
 max: 1030s   timeout: 2040s
Mac ASan 64 Tests (1)                 / url_unittests                avg:    3s 
 max:    3s   timeout:  120s
Mac ASan 64 Tests (1)                 / views_unittests              avg:   31s 
 max:  121s   timeout:  240s
Mac ASan 64 Tests (1)                 / webkit_unit_tests            avg:  298s 
 max: 1170s   timeout: 2280s
Mac ASan 64 Tests (1)                 / wtf_unittests                avg:    6s 
 max:    6s   timeout:  120s

[M-A Ruel, 2016-11-10 00:44:51]

ping

[Paweł Hajdan Jr., 2016-11-14 09:51:39]

LGTM

[M-A Ruel, 2016-11-14 14:30:02]

The CQ bit was checked by maruel@chromium.org

[commit-bot: I haz the power, 2016-11-14 14:30:11]

CQ is trying da patch. Follow status at
 
https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.or...

[commit-bot: I haz the power, 2016-11-14 19:14:24]

Description was changed from

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454
==========

to

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454
==========

[commit-bot: I haz the power, 2016-11-14 19:14:25]

Committed patchset #1 (id:40001)

[commit-bot: I haz the power, 2016-11-14 19:35:03]

Description was changed from

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454
==========

to

==========
Add timeouts.py to gather task durations.

This tool queries the Swarming server for the actual run times. It prints a
dense summary of each of the steps per builder, and suggested timeout values.
The timeout values are not yet implemented but this tool will be leveraged to
enforce the timeouts.

R=phajdan.jr@chromium.org
BUG=402454

Committed: https://crrev.com/b274e87c99da4150b8c4e0f2600b9b5100333142
Cr-Commit-Position: refs/heads/master@{#431890}
==========

[commit-bot: I haz the power, 2016-11-14 19:35:04]

Patchset 1 (id:??) landed as
https://crrev.com/b274e87c99da4150b8c4e0f2600b9b5100333142
Cr-Commit-Position: refs/heads/master@{#431890}