Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(626)

Issue 1361523003: Add crash_service to Telemetry's isolates. (Closed)

Created:
5 years, 3 months ago by aiolos (Not reviewing)
Modified:
5 years, 2 months ago
CC:
chromium-reviews, darin-cc_chromium.org, jam, telemetry-reviews_chromium.org, ghost stip (do not use), jbudorick, pkotwicz, agrieve
Base URL:
https://chromium.googlesource.com/chromium/src.git@fck
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Add crash_service to Telemetry's isolates. Switch to using binary_manager for the crash_service executable, eliminating downloads of this binary from cloud storage. (A follow-on CL will likely forbid the bots from downloading this and other executables from cloud storage entirely, rather than continuing to use this as a fallback path.) Telemetry's isolates are currently specified fairly differently for the GYP and GN builds; other CLs underway will unify their specification more. Follow up CL's will be needed to add the client config to gpu's tests. authors=kbr@,aiolos@ BUG=466877 Committed: https://crrev.com/6bdfb7dfb3ce2e571697629895089cffc42b48e6 Cr-Commit-Position: refs/heads/master@{#351196} Committed: https://crrev.com/70c5d0c0e2ff03c3b6cef0bdce391f93c35d218a Cr-Commit-Position: refs/heads/master@{#351803}

Patch Set 1 #

Patch Set 2 : Debug logging #

Patch Set 3 : Create isolate for binary_manager dependencies. #

Total comments: 5

Patch Set 4 : maruel comment #

Patch Set 5 : Moving isolates to chrome. #

Patch Set 6 : Add BUILD.gn changes. #

Total comments: 8

Patch Set 7 : Dirk comments. #

Total comments: 2

Patch Set 8 : Maruel nits. #

Patch Set 9 : Fix gyp all targets build failure. #

Total comments: 2

Patch Set 10 : Dirk nit. #

Patch Set 11 : rebase #

Patch Set 12 : #

Unified diffs Side-by-side diffs Delta from patch set Stats (+112 lines, -113 lines) Patch
M chrome/chrome_tests.gypi View 1 2 3 4 5 6 7 8 11 2 chunks +18 lines, -0 lines 0 comments Download
A + chrome/telemetry.isolate View 1 2 3 4 1 chunk +3 lines, -0 lines 0 comments Download
A + chrome/telemetry_binary_manager.isolate View 1 2 3 4 9 10 11 1 chunk +8 lines, -11 lines 0 comments Download
M chrome/telemetry_chrome_test.isolate View 1 2 3 4 1 chunk +1 line, -1 line 0 comments Download
A + chrome/telemetry_gpu_unittests.isolate View 1 2 3 4 0 chunks +-1 lines, --1 lines 0 comments Download
M chrome/test/BUILD.gn View 1 2 3 4 5 6 7 8 3 chunks +16 lines, -12 lines 0 comments Download
M content/content_tests.gypi View 1 2 3 4 5 6 7 8 9 10 11 1 chunk +0 lines, -13 lines 0 comments Download
D content/telemetry.isolate View 1 2 3 4 1 chunk +0 lines, -34 lines 0 comments Download
M content/telemetry_gpu_unittests.isolate View 1 2 3 4 1 chunk +0 lines, -28 lines 0 comments Download
M content/test/gpu/run_gpu_test.py View 1 2 3 4 5 6 7 8 1 chunk +4 lines, -1 line 0 comments Download
M content/test/gpu/run_unittests.py View 1 2 3 4 5 6 7 8 9 10 1 chunk +7 lines, -3 lines 0 comments Download
A tools/perf/core/binary_dependencies.json View 9 10 11 1 chunk +15 lines, -0 lines 0 comments Download
M tools/perf/core/project_config.py View 1 2 3 4 5 6 7 1 chunk +12 lines, -8 lines 0 comments Download
M tools/telemetry/BUILD.gn View 1 2 3 4 5 6 1 chunk +14 lines, -0 lines 0 comments Download
M tools/telemetry/catapult_base/dependency_manager/dependency_manager.py View 1 2 3 4 5 6 7 8 9 1 chunk +0 lines, -1 line 0 comments Download
M tools/telemetry/telemetry/internal/binary_dependencies.json View 1 chunk +15 lines, -2 lines 0 comments Download

Messages

Total messages: 74 (24 generated)
aiolos (Not reviewing)
5 years, 3 months ago (2015-09-22 20:51:13 UTC) #4
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/40001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/40001
5 years, 3 months ago (2015-09-22 20:52:11 UTC) #5
M-A Ruel
Thanks for doing this! (And enduring me) https://codereview.chromium.org/1361523003/diff/40001/tools/perf/core/binary_dependencies.json File tools/perf/core/binary_dependencies.json (right): https://codereview.chromium.org/1361523003/diff/40001/tools/perf/core/binary_dependencies.json#newcode8 tools/perf/core/binary_dependencies.json:8: "../../../out/Debug/crash_service.exe", This ...
5 years, 3 months ago (2015-09-22 21:02:35 UTC) #6
Ken Russell (switch to Gerrit)
Thanks for picking this up. It looks good overall. Have you verified locally again that ...
5 years, 3 months ago (2015-09-22 21:16:58 UTC) #7
aiolos (Not reviewing)
On 2015/09/22 21:16:58, Ken Russell wrote: > Thanks for picking this up. It looks good ...
5 years, 3 months ago (2015-09-22 21:36:05 UTC) #8
Dirk Pranke
lgtm w/ the others' concerns addressed.
5 years, 3 months ago (2015-09-22 21:36:21 UTC) #9
aiolos (Not reviewing)
https://codereview.chromium.org/1361523003/diff/40001/tools/perf/core/binary_dependencies.json File tools/perf/core/binary_dependencies.json (right): https://codereview.chromium.org/1361523003/diff/40001/tools/perf/core/binary_dependencies.json#newcode8 tools/perf/core/binary_dependencies.json:8: "../../../out/Debug/crash_service.exe", On 2015/09/22 21:16:58, Ken Russell wrote: > On ...
5 years, 3 months ago (2015-09-22 21:39:47 UTC) #10
Ken Russell (switch to Gerrit)
On 2015/09/22 21:36:05, aiolos wrote: > On 2015/09/22 21:16:58, Ken Russell wrote: > > Thanks ...
5 years, 3 months ago (2015-09-22 21:40:52 UTC) #11
aiolos (Not reviewing)
On 2015/09/22 21:40:52, Ken Russell wrote: > On 2015/09/22 21:36:05, aiolos wrote: > > On ...
5 years, 3 months ago (2015-09-22 21:50:22 UTC) #12
commit-bot: I haz the power
Dry run: CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/60001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/60001
5 years, 3 months ago (2015-09-22 21:57:05 UTC) #14
commit-bot: I haz the power
Dry run: Try jobs failed on following builders: linux_android_rel_ng on tryserver.chromium.linux (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.linux/builders/linux_android_rel_ng/builds/72277)
5 years, 3 months ago (2015-09-23 03:35:29 UTC) #16
aiolos (Not reviewing)
From discussion in https://codereview.chromium.org/1358903004/ with kbr: should I move content/telemetry_binary_manager.isolate to chrome instead?
5 years, 3 months ago (2015-09-23 18:59:55 UTC) #17
Ken Russell (switch to Gerrit)
On 2015/09/23 18:59:55, aiolos wrote: > From discussion in https://codereview.chromium.org/1358903004/ with kbr: should > I ...
5 years, 3 months ago (2015-09-23 19:06:13 UTC) #18
aiolos (Not reviewing)
On 2015/09/23 19:06:13, Ken Russell wrote: > On 2015/09/23 18:59:55, aiolos wrote: > > From ...
5 years, 3 months ago (2015-09-24 00:48:25 UTC) #19
Ken Russell (switch to Gerrit)
On 2015/09/24 00:48:25, aiolos wrote: > On 2015/09/23 19:06:13, Ken Russell wrote: > > On ...
5 years, 3 months ago (2015-09-24 01:46:33 UTC) #20
Paweł Hajdan Jr.
LGTM
5 years, 3 months ago (2015-09-24 14:26:08 UTC) #21
aiolos (Not reviewing)
ptal
5 years, 2 months ago (2015-09-25 20:09:55 UTC) #24
Dirk Pranke
https://codereview.chromium.org/1361523003/diff/140001/chrome/test/BUILD.gn File chrome/test/BUILD.gn (right): https://codereview.chromium.org/1361523003/diff/140001/chrome/test/BUILD.gn#newcode222 chrome/test/BUILD.gn:222: source_set("telemtry_binary_deps") { if there's no sources, it shouldn't be ...
5 years, 2 months ago (2015-09-25 20:16:20 UTC) #25
aiolos (Not reviewing)
https://codereview.chromium.org/1361523003/diff/140001/chrome/test/BUILD.gn File chrome/test/BUILD.gn (right): https://codereview.chromium.org/1361523003/diff/140001/chrome/test/BUILD.gn#newcode222 chrome/test/BUILD.gn:222: source_set("telemtry_binary_deps") { On 2015/09/25 20:16:20, Dirk Pranke wrote: > ...
5 years, 2 months ago (2015-09-25 20:40:07 UTC) #26
Dirk Pranke
lgtm
5 years, 2 months ago (2015-09-25 20:42:04 UTC) #27
Ken Russell (switch to Gerrit)
Please hold off submitting this. http://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng/builds/118764 indicates catastrophic failures. I don't know whether they were ...
5 years, 2 months ago (2015-09-25 21:49:11 UTC) #28
aiolos (Not reviewing)
On 2015/09/25 21:49:11, Ken Russell wrote: > Please hold off submitting this. > http://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng/builds/118764 > ...
5 years, 2 months ago (2015-09-25 21:54:03 UTC) #29
aiolos (Not reviewing)
On 2015/09/25 21:54:03, aiolos wrote: > On 2015/09/25 21:49:11, Ken Russell wrote: > > Please ...
5 years, 2 months ago (2015-09-25 21:55:23 UTC) #30
Ken Russell (switch to Gerrit)
On 2015/09/25 21:55:23, aiolos wrote: > On 2015/09/25 21:54:03, aiolos wrote: > > On 2015/09/25 ...
5 years, 2 months ago (2015-09-26 02:57:29 UTC) #31
Ken Russell (switch to Gerrit)
For the record, LGTM again, assuming that this passes the tests.
5 years, 2 months ago (2015-09-26 02:58:00 UTC) #32
M-A Ruel
cc stip, jbudorick, pkotwicz, agrieve for android/isolate part. lgtm with nits https://codereview.chromium.org/1361523003/diff/160001/tools/perf/core/project_config.py File tools/perf/core/project_config.py (right): ...
5 years, 2 months ago (2015-09-28 16:42:12 UTC) #33
aiolos (Not reviewing)
https://codereview.chromium.org/1361523003/diff/160001/tools/perf/core/project_config.py File tools/perf/core/project_config.py (right): https://codereview.chromium.org/1361523003/diff/160001/tools/perf/core/project_config.py#newcode7 tools/perf/core/project_config.py:7: On 2015/09/28 16:42:12, M-A Ruel wrote: > Create one ...
5 years, 2 months ago (2015-09-28 17:35:18 UTC) #34
aiolos (Not reviewing)
crbug.com/536192 has been fixed, so I'm going to send this through the CQ.
5 years, 2 months ago (2015-09-28 21:48:26 UTC) #35
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/180001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/180001
5 years, 2 months ago (2015-09-28 21:52:42 UTC) #38
commit-bot: I haz the power
Try jobs failed on following builders: chromium_presubmit on tryserver.chromium.linux (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.linux/builders/chromium_presubmit/builds/104455)
5 years, 2 months ago (2015-09-28 22:08:12 UTC) #40
Ken Russell (switch to Gerrit)
On 2015/09/28 22:08:12, commit-bot: I haz the power wrote: > Try jobs failed on following ...
5 years, 2 months ago (2015-09-28 22:40:10 UTC) #41
aiolos (Not reviewing)
Adding pieman as a secondary owner, and filed crbug.com/536970
5 years, 2 months ago (2015-09-28 22:52:21 UTC) #43
piman
lgtm
5 years, 2 months ago (2015-09-28 22:52:26 UTC) #44
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/180001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/180001
5 years, 2 months ago (2015-09-28 22:54:09 UTC) #46
commit-bot: I haz the power
Committed patchset #8 (id:180001)
5 years, 2 months ago (2015-09-28 23:13:44 UTC) #47
commit-bot: I haz the power
Patchset 8 (id:??) landed as https://crrev.com/6bdfb7dfb3ce2e571697629895089cffc42b48e6 Cr-Commit-Position: refs/heads/master@{#351196}
5 years, 2 months ago (2015-09-28 23:14:40 UTC) #48
kcarattini
A revert of this CL (patchset #8 id:180001) has been created in https://codereview.chromium.org/1379473002/ by kcarattini@chromium.org. ...
5 years, 2 months ago (2015-09-29 04:14:16 UTC) #49
aiolos (Not reviewing)
tldr: Dirk was right about the issue. PTAL I repro'd the build failure locally, and ...
5 years, 2 months ago (2015-09-30 02:27:04 UTC) #50
Dirk Pranke
and ... to answer my confusion, apparently test_isolation_mode=="check" by default on the official desktop builds, ...
5 years, 2 months ago (2015-09-30 02:53:30 UTC) #51
M-A Ruel
On 2015/09/30 02:53:30, Dirk Pranke wrote: > and ... to answer my confusion, apparently test_isolation_mode=="check" ...
5 years, 2 months ago (2015-09-30 13:16:06 UTC) #52
Ken Russell (switch to Gerrit)
Still LGTM.
5 years, 2 months ago (2015-09-30 18:07:29 UTC) #53
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/200001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/200001
5 years, 2 months ago (2015-09-30 18:22:38 UTC) #56
Dirk Pranke
lgtm w/ one minor comment. https://codereview.chromium.org/1361523003/diff/200001/tools/telemetry/catapult_base/dependency_manager/dependency_manager.py File tools/telemetry/catapult_base/dependency_manager/dependency_manager.py (right): https://codereview.chromium.org/1361523003/diff/200001/tools/telemetry/catapult_base/dependency_manager/dependency_manager.py#newcode221 tools/telemetry/catapult_base/dependency_manager/dependency_manager.py:221: logging.info('local_path %s exists.', local_path) ...
5 years, 2 months ago (2015-09-30 18:24:00 UTC) #57
aiolos (Not reviewing)
https://codereview.chromium.org/1361523003/diff/200001/tools/telemetry/catapult_base/dependency_manager/dependency_manager.py File tools/telemetry/catapult_base/dependency_manager/dependency_manager.py (right): https://codereview.chromium.org/1361523003/diff/200001/tools/telemetry/catapult_base/dependency_manager/dependency_manager.py#newcode221 tools/telemetry/catapult_base/dependency_manager/dependency_manager.py:221: logging.info('local_path %s exists.', local_path) On 2015/09/30 18:24:00, Dirk Pranke ...
5 years, 2 months ago (2015-09-30 18:32:16 UTC) #59
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/220001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/220001
5 years, 2 months ago (2015-09-30 18:35:02 UTC) #62
commit-bot: I haz the power
Try jobs failed on following builders: ios_dbg_simulator_ninja on tryserver.chromium.mac (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.mac/builders/ios_dbg_simulator_ninja/builds/75757) ios_rel_device_ninja on tryserver.chromium.mac (JOB_FAILED, ...
5 years, 2 months ago (2015-09-30 18:43:45 UTC) #64
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1361523003/340001 View timeline at https://chromium-cq-status.appspot.com/patch-timeline/1361523003/340001
5 years, 2 months ago (2015-10-01 14:58:20 UTC) #71
commit-bot: I haz the power
Committed patchset #12 (id:340001)
5 years, 2 months ago (2015-10-01 15:08:43 UTC) #72
commit-bot: I haz the power
Patchset 12 (id:??) landed as https://crrev.com/70c5d0c0e2ff03c3b6cef0bdce391f93c35d218a Cr-Commit-Position: refs/heads/master@{#351803}
5 years, 2 months ago (2015-10-01 15:09:36 UTC) #73
jwd
5 years, 2 months ago (2015-10-01 15:58:01 UTC) #74
Message was sent while issue was closed.
A revert of this CL (patchset #12 id:340001) has been created in
https://codereview.chromium.org/1369213004/ by jwd@chromium.org.

The reason for reverting is: Seems to be causing failures on linux test bots
https://build.chromium.org/p/chromium.linux/builders/Linux%20Tests/builds/318....

Powered by Google App Engine
This is Rietveld 408576698