Use swarming in capture_skps and capture_skps_from_pdfs CT tasks

Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1 --num=10 --pageset_type=Dummy1k --chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch --run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr --emails=”rmistry@google.com” --pageset_type=Dummy1k --chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch --run_id=testing

Verified that the above created 872 SKPs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp | grep -v TOTAL | wc -l
872


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr --start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing --run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr --emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing --run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL | wc -l
978


BUG=skia:5294
Committed: https://skia.googlesource.com/buildbot/+/d22b24489b8cd5026d598a279d832659bb8bc208

[rmistry, 2016-05-18 16:20:35]

Description was changed from

==========
Use swarming in capture_skps CT task

Tested with:
$
$

Verified that the above created x SKPs:

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$
$
Verified that the above created x SKPs:

Tested capture_skps_from_pdfs with:
$
$
Verified that the above created x PDFs:

BUG=skia:5294
==========

[rmistry, 2016-05-18 16:30:29]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$
$
Verified that the above created x SKPs:

Tested capture_skps_from_pdfs with:
$
$
Verified that the above created x PDFs:

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$
Verified that the above created x SKPs:

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:00:02]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$
Verified that the above created x SKPs:

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$
Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:00:24]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$
Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing
Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:00:40]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing
Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l

Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$
Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:30:29]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l
gs://cluster-telemetry-test/swarming/pdfs/PDF1k/testing/*/*.pdf | grep -v TOTAL
| wc -l

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:37:08]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l

BUG=skia:5294
==========

[rmistry, 2016-05-18 17:53:47]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l

BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

[rmistry, 2016-05-18 17:57:44]

The CQ bit was checked by rmistry@google.com to run a CQ dry run

[commit-bot: I haz the power, 2016-05-18 17:57:49]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1994663002/100001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1994663002/100001

[rmistry, 2016-05-18 17:58:16]

rmistry@google.com changed reviewers:
+ benjaminwagner@google.com

[commit-bot: I haz the power, 2016-05-18 18:04:11]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-05-18 18:04:12]

Dry run: Try jobs failed on following builders:
  Infra-PerCommit-Trybot on client.skia.fyi (JOB_FAILED,
http://build.chromium.org/p/client.skia.fyi/builders/Infra-PerCommit-Trybot/b...)

[rmistry, 2016-05-18 18:11:56]

The CQ bit was checked by rmistry@google.com to run a CQ dry run

[commit-bot: I haz the power, 2016-05-18 18:12:00]

Dry run: CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1994663002/120001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1994663002/120001

[rmistry, 2016-05-18 18:13:34]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.

Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

[commit-bot: I haz the power, 2016-05-18 18:14:51]

The CQ bit was unchecked by commit-bot@chromium.org

[commit-bot: I haz the power, 2016-05-18 18:14:51]

Dry run: This issue passed the CQ dry run.

[rmistry, 2016-05-18 18:20:16]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created x SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created x PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created 844 SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

[rmistry, 2016-05-19 15:25:15]

Ready for review

[rmistry, 2016-05-19 16:11:11]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created 844 SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
844


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
979


BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created 872 SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
872


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
978


BUG=skia:5294
==========

[dogben, 2016-05-19 16:48:41]

lgtm

Only ignorable comments.

https://codereview.chromium.org/1994663002/diff/120001/ct/go/util/util.go
File ct/go/util/util.go (right):

https://codereview.chromium.org/1994663002/diff/120001/ct/go/util/util.go#new...
ct/go/util/util.go:289: // This splice will be used to run remove_invalid_skp.py
on.
s/splice/slice/, s/ on//

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go
File ct/go/util/util.go (right):

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go#new...
ct/go/util/util.go:289: // This splice will be used to run remove_invalid_skp.py
on.
s/splice/slice/, s/ on//

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go#new...
ct/go/util/util.go:294: return fmt.Errorf("Unable to read %s: %s", indexDirs,
err)
s/indexDirs/pathToSkps/

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
File ct/go/worker_scripts/capture_skps/main.go (right):

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
ct/go/worker_scripts/capture_skps/main.go:94: // if err :=
gs.DownloadWorkerArtifacts(util.PAGESETS_DIR_NAME, *pagesetType, *workerNum);
err != nil {
nit: delete

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
ct/go/worker_scripts/capture_skps/main.go:162: index :=
archivesToIndex[decodedPageset.ArchiveDataFile]
paranoid: check that archivesToIndex contains an entry for this archive.

[rmistry, 2016-05-19 17:01:25]

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go
File ct/go/util/util.go (right):

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go#new...
ct/go/util/util.go:289: // This splice will be used to run remove_invalid_skp.py
on.
On 2016/05/19 16:48:41, Ben Wagner wrote:
> s/splice/slice/, s/ on//

Done.

https://codereview.chromium.org/1994663002/diff/160001/ct/go/util/util.go#new...
ct/go/util/util.go:294: return fmt.Errorf("Unable to read %s: %s", indexDirs,
err)
On 2016/05/19 16:48:41, Ben Wagner wrote:
> s/indexDirs/pathToSkps/

Done.

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
File ct/go/worker_scripts/capture_skps/main.go (right):

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
ct/go/worker_scripts/capture_skps/main.go:94: // if err :=
gs.DownloadWorkerArtifacts(util.PAGESETS_DIR_NAME, *pagesetType, *workerNum);
err != nil {
On 2016/05/19 16:48:41, Ben Wagner wrote:
> nit: delete

Done.

https://codereview.chromium.org/1994663002/diff/160001/ct/go/worker_scripts/c...
ct/go/worker_scripts/capture_skps/main.go:162: index :=
archivesToIndex[decodedPageset.ArchiveDataFile]
On 2016/05/19 16:48:41, Ben Wagner wrote:
> paranoid: check that archivesToIndex contains an entry for this archive.

Done.

[dogben, 2016-05-19 17:07:18]

lgtm

Still LGTM.

[rmistry, 2016-05-19 17:19:14]

The CQ bit was checked by rmistry@google.com

[commit-bot: I haz the power, 2016-05-19 17:19:18]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1994663002/180001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1994663002/180001

[commit-bot: I haz the power, 2016-05-19 17:22:15]

Description was changed from

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created 872 SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
872


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
978


BUG=skia:5294
==========

to

==========
Use swarming in capture_skps and capture_skps_from_pdfs CT tasks.


Tested capture_skps with:
$ go run go/worker_scripts/capture_skps/main.go --logtostderr --start_range=1
--num=10 --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=Dummy1k
--chromium_build=try-1e224f6-f1036b2-rmistry-20160206122201-withpatch
--run_id=testing

Verified that the above created 872 SKPs:
$ gsutil -m ls -l
gs://cluster-telemetry/swarming/skps/Dummy1k/try-1e224f6-f1036b2-rmistry-20160206122201-withpatch/*/*.skp
| grep -v TOTAL | wc -l
872


Tested capture_skps_from_pdfs with:
$ go run go/worker_scripts/capture_skps_from_pdfs/main.go --logtostderr
--start_range=1 --num=10 --pageset_type=PDF1k --chromium_build=testing
--run_id=testing --local
$ go run go/master_scripts/capture_skps_on_workers/main.go --logtostderr
--emails=”rmistry@google.com” --pageset_type=PDF1k --chromium_build=testing
--run_id=testing

Verified that the above created 979 PDFs:
$ gsutil -m ls -l gs://cluster-telemetry/swarming/pdfs/PDF1k/testing/*/*.pdf |
grep -v TOTAL | wc -l
978


BUG=skia:5294

Committed:
https://skia.googlesource.com/buildbot/+/d22b24489b8cd5026d598a279d832659bb8b...
==========

[commit-bot: I haz the power, 2016-05-19 17:22:16]

Committed patchset #10 (id:180001) as
https://skia.googlesource.com/buildbot/+/d22b24489b8cd5026d598a279d832659bb8b...