Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(51)

Issue 545803002: Update buildbots to parse new telemetry JSON format. (Closed)

Created:
6 years, 3 months ago by sullivan
Modified:
6 years, 3 months ago
CC:
chromium-reviews, pgervais+watch_chromium.org, kjellander-cc_chromium.org, cmp-cc_chromium.org, stip+watch_chromium.org, tonyg, smut, luqui
Base URL:
https://chromium.googlesource.com/chromium/tools/build.git@master
Project:
tools
Visibility:
Public.

Description

Add a new parser for telemetry JSON format, and tell telemetry to use the new format. BUG= Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=291952

Patch Set 1 #

Total comments: 14

Patch Set 2 : Implement sending results to dashboard. This still needs tests. #

Patch Set 3 : Switched to having telemetry output json to files. #

Total comments: 19

Patch Set 4 : Addressed review comments; still need to write/update test and remove temp code #

Patch Set 5 : updated existing tests #

Patch Set 6 : Added unit tests and removed debugging code #

Total comments: 4

Patch Set 7 : Addressed review comments #

Unified diffs Side-by-side diffs Delta from patch set Stats (+388 lines, -129 lines) Patch
M scripts/slave/performance_log_processor.py View 1 2 3 4 5 1 chunk +4 lines, -0 lines 0 comments Download
M scripts/slave/results_dashboard.py View 1 2 3 4 5 6 5 chunks +83 lines, -28 lines 0 comments Download
M scripts/slave/runtest.py View 1 2 3 4 5 15 chunks +118 lines, -83 lines 0 comments Download
M scripts/slave/telemetry.py View 1 2 3 4 4 chunks +7 lines, -1 line 0 comments Download
A scripts/slave/telemetry_utils.py View 1 2 3 4 5 6 1 chunk +71 lines, -0 lines 0 comments Download
M scripts/slave/unittests/results_dashboard_test.py View 1 2 3 4 5 2 chunks +44 lines, -8 lines 0 comments Download
M scripts/slave/unittests/runtest_test.py View 1 2 3 4 5 2 chunks +51 lines, -3 lines 0 comments Download
M scripts/slave/unittests/telemetry_test.py View 1 2 3 4 4 chunks +10 lines, -6 lines 0 comments Download

Messages

Total messages: 29 (5 generated)
sullivan
Mike, this isn't ready for review at all, but I had a bunch of questions ...
6 years, 3 months ago (2014-09-05 04:30:00 UTC) #2
sullivan
I finished the implementation. I'm still working on tests, but would really like some feedback ...
6 years, 3 months ago (2014-09-05 21:32:16 UTC) #3
ghost stip (do not use)
https://chromiumcodereview.appspot.com/545803002/diff/1/scripts/slave/runtest.py File scripts/slave/runtest.py (right): https://chromiumcodereview.appspot.com/545803002/diff/1/scripts/slave/runtest.py#newcode571 scripts/slave/runtest.py:571: return telemetry_utils.TelemetryLogParser On 2014/09/05 04:30:00, sullivan wrote: > Is ...
6 years, 3 months ago (2014-09-05 21:39:06 UTC) #4
sullivan
+smut for question about if/how telemetry runs on iOS +luqui for question about how to ...
6 years, 3 months ago (2014-09-05 21:47:03 UTC) #5
smut
https://chromiumcodereview.appspot.com/545803002/diff/1/scripts/slave/runtest.py File scripts/slave/runtest.py (right): https://chromiumcodereview.appspot.com/545803002/diff/1/scripts/slave/runtest.py#newcode1105 scripts/slave/runtest.py:1105: def _MainIOS(options, args, extra_env): On 2014/09/05 04:30:00, sullivan wrote: ...
6 years, 3 months ago (2014-09-05 21:59:09 UTC) #7
ghost stip (do not use)
(actually add luqui)
6 years, 3 months ago (2014-09-06 01:13:19 UTC) #9
ghost stip (do not use)
On 2014/09/05 21:47:03, sullivan wrote: > +smut for question about if/how telemetry runs on iOS ...
6 years, 3 months ago (2014-09-06 01:14:27 UTC) #10
eakuefner
On 2014/09/05 21:47:03, sullivan wrote: > Oops, I think I gave eakuefner some out-of-date advice ...
6 years, 3 months ago (2014-09-06 03:18:49 UTC) #11
sullivan
On 2014/09/06 01:14:27, stip wrote: > On 2014/09/05 21:47:03, sullivan wrote: > > +smut for ...
6 years, 3 months ago (2014-09-06 03:26:58 UTC) #12
sullivan
On 2014/09/06 03:26:58, sullivan wrote: > On 2014/09/06 01:14:27, stip wrote: > > On 2014/09/05 ...
6 years, 3 months ago (2014-09-08 22:01:22 UTC) #13
ghost stip (do not use)
I think this approach looks pretty good. I've written a few comments, I mainly wanted ...
6 years, 3 months ago (2014-09-09 02:20:06 UTC) #14
ghost stip (do not use)
some extra comments https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py File scripts/slave/results_dashboard.py (right): https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py#newcode216 scripts/slave/results_dashboard.py:216: chart_data, master) this needs a prefix, ...
6 years, 3 months ago (2014-09-09 02:24:16 UTC) #15
ghost stip (do not use)
take a look at https://chromiumcodereview.appspot.com/548773004/ which may conflict a tiny bit with this CL
6 years, 3 months ago (2014-09-09 17:48:22 UTC) #16
qyearsley
Excellent, I didn't know that this change was already under-way :-)
6 years, 3 months ago (2014-09-09 20:22:42 UTC) #18
qyearsley
https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py File scripts/slave/results_dashboard.py (right): https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py#newcode31 scripts/slave/results_dashboard.py:31: build_dir): What about having a function which just constructs ...
6 years, 3 months ago (2014-09-09 20:22:54 UTC) #19
eakuefner
https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py File scripts/slave/results_dashboard.py (right): https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py#newcode216 scripts/slave/results_dashboard.py:216: chart_data, master) On 2014/09/09 02:24:16, stip wrote: > this ...
6 years, 3 months ago (2014-09-09 21:00:54 UTC) #20
eakuefner
On 2014/09/09 21:00:54, eakuefner wrote: > https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py > File scripts/slave/results_dashboard.py (right): > > https://chromiumcodereview.appspot.com/545803002/diff/40001/scripts/slave/results_dashboard.py#newcode216 > ...
6 years, 3 months ago (2014-09-09 21:02:17 UTC) #21
sullivan
This isn't ready for review yet (still need to update tests and remove testing code), ...
6 years, 3 months ago (2014-09-11 00:25:56 UTC) #22
sullivan
This is ready for review now. Still not sure how to handle android. luqui, any ...
6 years, 3 months ago (2014-09-11 03:43:47 UTC) #23
ghost stip (do not use)
lgtm w/ nits https://chromiumcodereview.appspot.com/545803002/diff/100001/scripts/slave/results_dashboard.py File scripts/slave/results_dashboard.py (right): https://chromiumcodereview.appspot.com/545803002/diff/100001/scripts/slave/results_dashboard.py#newcode423 scripts/slave/results_dashboard.py:423: if type(data) is list: usually better ...
6 years, 3 months ago (2014-09-12 18:17:25 UTC) #24
sullivan
Before I submit, should we have a plan for rolling this out to the buildbots? ...
6 years, 3 months ago (2014-09-12 19:14:21 UTC) #25
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patchset/545803002/120001
6 years, 3 months ago (2014-09-12 19:54:03 UTC) #27
commit-bot: I haz the power
Committed patchset #7 (id:120001) as 291952
6 years, 3 months ago (2014-09-12 19:56:42 UTC) #28
sullivan
6 years, 3 months ago (2014-09-12 20:31:07 UTC) #29
Message was sent while issue was closed.
A revert of this CL (patchset #7 id:120001) has been created in
https://codereview.chromium.org/565973005/ by sullivan@chromium.org.

The reason for reverting is: Broke the build:
http://build.chromium.org/p/chromium.perf/builders/Mac%2010.8%20Perf%20%282%2....

Powered by Google App Engine
This is Rietveld 408576698