[CT] Use zips of SKPs to speed up "isolate tests" in recipes

[CT] Use zips of SKPs to speed up "isolate tests" in recipes.

Context: The isolate binary is slow when it deals with >100k files (see https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=

Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298749

[rmistry, 2016-02-11 20:02:42]

Description was changed from

==========
Again

BUG=
==========

to

==========
[CT] Use zips of SKPs to speed up "isolate tests".

Context: The isolate binary is slow when it deals with >100k files (see
https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=
==========

[rmistry, 2016-02-11 20:03:00]

Description was changed from

==========
[CT] Use zips of SKPs to speed up "isolate tests".

Context: The isolate binary is slow when it deals with >100k files (see
https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=
==========

to

==========
[CT] Use zips of SKPs to speed up "isolate tests" in recipes.

Context: The isolate binary is slow when it deals with >100k files (see
https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=
==========

[rmistry, 2016-02-11 20:03:17]

rmistry@google.com changed reviewers:
+ borenet@google.com

[borenet, 2016-02-11 20:11:55]

https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
File scripts/slave/recipes/skia/ct_skps.py (right):

https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
scripts/slave/recipes/skia/ct_skps.py:123: output=skps_dir.join('slave%s.zip' %
slave_num))
I'm confused; what's the point of zipping the SKPs if you aren't using the zip
file?

[rmistry, 2016-02-11 20:42:53]

https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
File scripts/slave/recipes/skia/ct_skps.py (right):

https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
scripts/slave/recipes/skia/ct_skps.py:123: output=skps_dir.join('slave%s.zip' %
slave_num))
On 2016/02/11 20:11:55, borenet wrote:
> I'm confused; what's the point of zipping the SKPs if you aren't using the zip
> file?

It is used by the .isolate file in the CL referenced in the description.

[borenet, 2016-02-11 20:51:28]

On 2016/02/11 20:42:53, rmistry wrote:
>
https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
> File scripts/slave/recipes/skia/ct_skps.py (right):
> 
>
https://codereview.chromium.org/1689093004/diff/40001/scripts/slave/recipes/s...
> scripts/slave/recipes/skia/ct_skps.py:123: output=skps_dir.join('slave%s.zip'
%
> slave_num))
> On 2016/02/11 20:11:55, borenet wrote:
> > I'm confused; what's the point of zipping the SKPs if you aren't using the
zip
> > file?
> 
> It is used by the .isolate file in the CL referenced in the description.

Got it.  LGTM.

[rmistry, 2016-02-11 20:57:40]

The CQ bit was checked by rmistry@google.com to run a CQ dry run

[commit-bot: I haz the power, 2016-02-11 20:57:45]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1689093004/40001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1689093004/40001

[commit-bot: I haz the power, 2016-02-11 21:01:05]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-02-11 21:01:06]

Dry run: This issue passed the CQ dry run.

[rmistry, 2016-02-11 22:46:51]

The CQ bit was checked by rmistry@google.com

[commit-bot: I haz the power, 2016-02-11 22:46:56]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1689093004/40001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1689093004/40001

[commit-bot: I haz the power, 2016-02-11 22:50:04]

Description was changed from

==========
[CT] Use zips of SKPs to speed up "isolate tests" in recipes.

Context: The isolate binary is slow when it deals with >100k files (see
https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=
==========

to

==========
[CT] Use zips of SKPs to speed up "isolate tests" in recipes.

Context: The isolate binary is slow when it deals with >100k files (see
https://github.com/luci/luci-go/issues/9)
This change compresses the 1M SKPs into 100 zip files.

See related .isolate change in https://codereview.chromium.org/1691023002/

BUG=

Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=298749
==========

[commit-bot: I haz the power, 2016-02-11 22:50:05]

Committed patchset #3 (id:40001) as
http://src.chromium.org/viewvc/chrome?view=rev&revision=298749

[rmistry1, 2016-02-12 12:03:17]

A revert of this CL (patchset #3 id:40001) has been created in
https://codereview.chromium.org/1695723002/ by rmistry@chromium.org.

The reason for reverting is: The zipping and unzipping process seems to take
longer than the isolate binary did for >100k files. Reverting this experiment.
I am instead going to break up the "isolate tests" steps into multiple steps if
>100k files..