Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(62)

Issue 2474573002: Convert chart-json to Histograms. (Closed)

Created:
4 years, 1 month ago by benjhayden
Modified:
4 years ago
CC:
catapult-reviews_chromium.org, telemetry-reviews_chromium.org, tracing-review_chromium.org
Target Ref:
refs/heads/master
Project:
catapult
Visibility:
Public.

Description

Convert chart-json to Histograms. Currently, TBMv1 benchmarks and other scripts produce chart-json, which cannot be displayed by results2.html. This CL implements ConvertChartJson(), which converts chart-json to single-bin Histograms with IterationInfo diagnostics. HtmlOutputFormatter is now unused. If there are no complaints, then it and its template can be deleted. https://screenshot.googleplex.com/omepkp6EUPN.png Legacy units and what to do about them: https://docs.google.com/spreadsheets/d/1poCtwvaIsXiPQWKGYkz4iOTk6XErpAJPO6aZMykNHwU/edit Committed: https://chromium.googlesource.com/external/github.com/catapult-project/catapult/+/4b8ce174b7ef489bd850983f3897b5d2bf8cbf33

Patch Set 1 : . #

Total comments: 13

Patch Set 2 : rebase #

Patch Set 3 : legacyTIRLabel #

Patch Set 4 : convertLegacyUnit #

Patch Set 5 : ChartJsonConverter #

Patch Set 6 : . #

Patch Set 7 : LEGACY_UNIT_INFO #

Patch Set 8 : tir grouping #

Patch Set 9 : fix chart-json in results2.html #

Patch Set 10 : test with tir label #

Total comments: 7

Patch Set 11 : no script #

Patch Set 12 : pre-convert #

Patch Set 13 : non-tir test #

Patch Set 14 : cleanup #

Patch Set 15 : rebase #

Patch Set 16 : cleanup #

Patch Set 17 : comments #

Patch Set 18 : indentation #

Patch Set 19 : fix #

Patch Set 20 : ReadExistingResults #

Patch Set 21 : . #

Unified diffs Side-by-side diffs Delta from patch set Stats (+419 lines, -34 lines) Patch
M telemetry/telemetry/internal/results/html2_output_formatter.py View 1 2 3 4 5 6 7 8 9 10 11 1 chunk +30 lines, -5 lines 0 comments Download
M telemetry/telemetry/internal/results/html_output_formatter.py View 1 chunk +2 lines, -1 line 0 comments Download
M telemetry/telemetry/internal/results/results_options.py View 2 chunks +3 lines, -4 lines 0 comments Download
M tracing/bin/results2json View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 1 chunk +2 lines, -1 line 0 comments Download
M tracing/bin/valueset2html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 1 chunk +1 line, -1 line 0 comments Download
M tracing/tracing/results2_template.html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 2 chunks +3 lines, -1 line 0 comments Download
M tracing/tracing/results_renderer.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 2 chunks +10 lines, -11 lines 0 comments Download
M tracing/tracing/results_renderer_unittest.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 3 chunks +9 lines, -5 lines 0 comments Download
M tracing/tracing/ui/base/box_chart.html View 1 2 3 4 5 6 7 8 9 10 1 chunk +30 lines, -0 lines 0 comments Download
A tracing/tracing/value/__init__.py View 1 2 3 4 5 6 7 8 9 10 11 0 chunks +-1 lines, --1 lines 0 comments Download
A tracing/tracing/value/chart_json_converter.html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +75 lines, -0 lines 0 comments Download
A tracing/tracing/value/chart_json_converter_test.html View 1 2 3 4 5 6 7 8 9 10 11 12 1 chunk +98 lines, -0 lines 0 comments Download
A tracing/tracing/value/convert_chart_json.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +24 lines, -0 lines 0 comments Download
A tracing/tracing/value/convert_chart_json_cmdline.html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 1 chunk +20 lines, -0 lines 0 comments Download
M tracing/tracing/value/diagnostics/iteration_info.html View 1 2 3 4 5 6 7 8 9 3 chunks +12 lines, -0 lines 0 comments Download
M tracing/tracing/value/histogram_set.html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 1 chunk +16 lines, -6 lines 0 comments Download
A tracing/tracing/value/legacy_unit_info.html View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +85 lines, -0 lines 0 comments Download

Messages

Total messages: 38 (23 generated)
benjhayden
Obviously, convert_chart_json.html isn't quite done yet, but I think this is surprisingly close to producing ...
4 years, 1 month ago (2016-11-02 05:16:23 UTC) #5
benjhayden
On 2016/11/02 at 05:16:23, benjhayden wrote: > Obviously, convert_chart_json.html isn't quite done yet, but I ...
4 years, 1 month ago (2016-11-02 05:26:38 UTC) #6
benjhayden
Hold review while I pivot from chart-json to telemetry-json.
4 years, 1 month ago (2016-11-02 23:10:12 UTC) #12
nednguyen
On 2016/11/02 23:10:12, benjhayden wrote: > Hold review while I pivot from chart-json to telemetry-json. ...
4 years, 1 month ago (2016-11-02 23:12:18 UTC) #13
benjhayden
On 2016/11/02 at 23:12:18, nednguyen wrote: > On 2016/11/02 23:10:12, benjhayden wrote: > > Hold ...
4 years, 1 month ago (2016-11-03 00:17:11 UTC) #14
benjhayden
On 2016/11/03 at 00:17:11, benjhayden wrote: > On 2016/11/02 at 23:12:18, nednguyen wrote: > > ...
4 years, 1 month ago (2016-11-03 20:21:25 UTC) #18
nednguyen
https://codereview.chromium.org/2474573002/diff/100001/tracing/bin/chartjson2histograms File tracing/bin/chartjson2histograms (right): https://codereview.chromium.org/2474573002/diff/100001/tracing/bin/chartjson2histograms#newcode28 tracing/bin/chartjson2histograms:28: histograms.extend(json.load(file(args.histogram_json, 'r'))) This could be confusing to people that ...
4 years, 1 month ago (2016-11-03 21:10:24 UTC) #19
benjhayden
I still need to write some tests, otherwise PTAL. https://codereview.chromium.org/2474573002/diff/100001/tracing/bin/chartjson2histograms File tracing/bin/chartjson2histograms (right): https://codereview.chromium.org/2474573002/diff/100001/tracing/bin/chartjson2histograms#newcode28 tracing/bin/chartjson2histograms:28: ...
4 years, 1 month ago (2016-11-09 23:48:55 UTC) #22
eakuefner
lgtm % more tests https://codereview.chromium.org/2474573002/diff/280001/tracing/bin/chartjson2histograms File tracing/bin/chartjson2histograms (right): https://codereview.chromium.org/2474573002/diff/280001/tracing/bin/chartjson2histograms#newcode1 tracing/bin/chartjson2histograms:1: #!/usr/bin/env python no need https://codereview.chromium.org/2474573002/diff/280001/tracing/tracing/results2_template.html ...
4 years, 1 month ago (2016-11-18 21:37:11 UTC) #26
eakuefner
lgtm % more tests https://codereview.chromium.org/2474573002/diff/280001/tracing/bin/chartjson2histograms File tracing/bin/chartjson2histograms (right): https://codereview.chromium.org/2474573002/diff/280001/tracing/bin/chartjson2histograms#newcode1 tracing/bin/chartjson2histograms:1: #!/usr/bin/env python no need https://codereview.chromium.org/2474573002/diff/280001/tracing/tracing/results2_template.html ...
4 years, 1 month ago (2016-11-18 21:37:12 UTC) #27
eakuefner
https://codereview.chromium.org/2474573002/diff/280001/tracing/tracing/value/convert_chart_json.py File tracing/tracing/value/convert_chart_json.py (right): https://codereview.chromium.org/2474573002/diff/280001/tracing/tracing/value/convert_chart_json.py#newcode1 tracing/tracing/value/convert_chart_json.py:1: #!/usr/bin/env python On 2016/11/18 at 21:37:11, eakuefner wrote: > ...
4 years, 1 month ago (2016-11-22 18:01:48 UTC) #29
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2474573002/500001
4 years, 1 month ago (2016-11-22 21:06:38 UTC) #32
commit-bot: I haz the power
Committed patchset #21 (id:500001) as https://chromium.googlesource.com/external/github.com/catapult-project/catapult/+/4b8ce174b7ef489bd850983f3897b5d2bf8cbf33
4 years, 1 month ago (2016-11-22 21:25:40 UTC) #35
alex clarke (OOO till 29th)
Please revert this patch. It completely breaks the following workflow: git checkout patch cr build ...
4 years ago (2016-11-25 13:50:09 UTC) #37
Primiano Tucci (use gerrit)
4 years ago (2016-11-25 14:20:14 UTC) #38
Message was sent while issue was closed.
A revert of this CL (patchset #21 id:500001) has been created in
https://codereview.chromium.org/2528113003/ by primiano@chromium.org.

The reason for reverting is: As per go/catabug/3036 and comment #37 here this
seems to
not work well with run_benchmark and is breaking people's ability
to run A/B tests.

BUG=catapult:3036.

Powered by Google App Engine
This is Rietveld 408576698