Adds tools/ninja.py that runs goma builds in parallel

Adds tools/ninja.py that runs goma builds in parallel

This CL adds a script tools/ninja.py that runs Goma enabled builds
in parallel. Non-goma builds are run serially, as before.

Conflating this feature with gyp support in tools/build.py
got to be a bit of a mess, which is why this is split off as a
separate script. This script can replace build.py after gyp support
is removed.

With a warm goma:
$ time ./tools/build.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
real	4m25.627s
user	3m30.740s
sys	1m3.873s

$ ./tools/ninja.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
The build took 108.900 seconds

R=rmacnak@google.com

Committed: https://github.com/dart-lang/sdk/commit/1f0168b95c7e2e8867cacb780a15e131f40ec65c

[zra, 2017-02-27 18:20:28]

Description was changed from

==========
[infra] build.py: Run goma builds in parallel

WIP
==========

to

==========
Adds tools/ninja.py that runs goma builds in parallel

This CL adds a script tools/ninja.py that runs Goma enabled builds
in parallel. Non-goma builds are run serially, as before.

Conflating this feature with gyp support in tools/build.py
got to be a bit of a mess, which is why this is split off as a
separate script. This script can replace build.py after gyp support
is removed.

With a warm goma:
$ time ./tools/build.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
real	4m25.627s
user	3m30.740s
sys	1m3.873s

$ ./tools/ninja.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
The build took 108.900 seconds
==========

[zra, 2017-02-27 18:20:58]

zra@google.com changed reviewers:
+ rmacnak@google.com

[rmacnak, 2017-02-27 18:46:31]

LGTM!

https://codereview.chromium.org/2712743009/diff/40001/tools/ninja.py
File tools/ninja.py (right):

https://codereview.chromium.org/2712743009/diff/40001/tools/ninja.py#newcode272
tools/ninja.py:272: utils.ConfigureJava()
Probably leftover from the Java-based analyzer and Dart Editor.

[zra, 2017-02-27 18:54:40]

https://codereview.chromium.org/2712743009/diff/40001/tools/ninja.py
File tools/ninja.py (right):

https://codereview.chromium.org/2712743009/diff/40001/tools/ninja.py#newcode272
tools/ninja.py:272: utils.ConfigureJava()
On 2017/02/27 18:46:31, rmacnak wrote:
> Probably leftover from the Java-based analyzer and Dart Editor.

Done.

[zra, 2017-02-27 18:55:08]

Description was changed from

==========
Adds tools/ninja.py that runs goma builds in parallel

This CL adds a script tools/ninja.py that runs Goma enabled builds
in parallel. Non-goma builds are run serially, as before.

Conflating this feature with gyp support in tools/build.py
got to be a bit of a mess, which is why this is split off as a
separate script. This script can replace build.py after gyp support
is removed.

With a warm goma:
$ time ./tools/build.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
real	4m25.627s
user	3m30.740s
sys	1m3.873s

$ ./tools/ninja.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
The build took 108.900 seconds
==========

to

==========
Adds tools/ninja.py that runs goma builds in parallel

This CL adds a script tools/ninja.py that runs Goma enabled builds
in parallel. Non-goma builds are run serially, as before.

Conflating this feature with gyp support in tools/build.py
got to be a bit of a mess, which is why this is split off as a
separate script. This script can replace build.py after gyp support
is removed.

With a warm goma:
$ time ./tools/build.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
real	4m25.627s
user	3m30.740s
sys	1m3.873s

$ ./tools/ninja.py -m debug,release -a x64,ia32 runtime runtime_precompiled
...
The build took 108.900 seconds

R=rmacnak@google.com

Committed:
https://github.com/dart-lang/sdk/commit/1f0168b95c7e2e8867cacb780a15e131f40ec65c
==========

[zra, 2017-02-27 18:55:09]

Committed patchset #4 (id:60001) manually as
1f0168b95c7e2e8867cacb780a15e131f40ec65c (presubmit successful).

[Florian Schneider, 2017-02-27 23:08:37]

On 2017/02/27 18:55:09, zra wrote:
> Committed patchset #4 (id:60001) manually as
> 1f0168b95c7e2e8867cacb780a15e131f40ec65c (presubmit successful).

When I try to interrupt the build using ctrl-C, I can't and get the following
output:

KeyboardInterrupt
    racquire()
    racquire()
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
KeyboardInterrupt
KeyboardInterrupt
    racquire()
    racquire()
KeyboardInterrupt
KeyboardInterrupt
    racquire()
KeyboardInterrupt
    racquire()
  File "/usr/lib/python2.7/multiprocessing/pool.py", line 102, in worker
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
    task = get()
KeyboardInterrupt
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
KeyboardInterrupt
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
    racquire()
    racquire()
    task = get()
KeyboardInterrupt
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 374, in get
    racquire()