Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(265)

Issue 1104053006: [Storage] Blob Storage perf tests (Closed)

Created:
5 years, 7 months ago by dmurph
Modified:
5 years, 6 months ago
Reviewers:
eakuefner, kinuko, nednguyen
CC:
chromium-reviews, telemetry-reviews_chromium.org
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

[Storage] Blob Storage perf tests BUG=489799 CQ_EXTRA_TRYBOTS=tryserver.chromium.perf:linux_perf_bisect;tryserver.chromium.perf:mac_perf_bisect;tryserver.chromium.perf:win_perf_bisect;tryserver.chromium.perf:android_nexus5_perf_bisect Committed: https://crrev.com/dbd2315e79df68af221c06dadbc00adfcdef07df Cr-Commit-Position: refs/heads/master@{#332541}

Patch Set 1 #

Patch Set 2 : page set update #

Patch Set 3 : PageSet update #

Patch Set 4 : Next iter #

Patch Set 5 : Added metric to timeline metrics #

Patch Set 6 : Whoops, forgot timeline metric #

Total comments: 1

Patch Set 7 : Partly working! #

Total comments: 2

Patch Set 8 : Added test names #

Patch Set 9 : Added read stats #

Total comments: 18

Patch Set 10 : Fixes and metric unittest #

Total comments: 21

Patch Set 11 : comments #

Patch Set 12 : fixes #

Total comments: 10

Patch Set 13 : comments, and using thread_duration #

Total comments: 2

Patch Set 14 : Removed reliance on Interactions in metric #

Total comments: 7

Patch Set 15 : UUID-based reads, updated tests #

Total comments: 2

Patch Set 16 : None case, filter nones #

Patch Set 17 : copyright fix #

Unified diffs Side-by-side diffs Delta from patch set Stats (+560 lines, -2 lines) Patch
M storage/browser/blob/blob_url_request_job.cc View 1 2 3 4 5 6 7 8 9 10 11 1 chunk +1 line, -1 line 0 comments Download
A tools/perf/benchmarks/blob_storage.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +42 lines, -0 lines 0 comments Download
A tools/perf/page_sets/blob/blob-workshop.html View 1 2 3 4 5 6 7 8 9 10 11 12 1 chunk +169 lines, -0 lines 0 comments Download
A tools/perf/page_sets/blob_workshop.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +94 lines, -0 lines 0 comments Download
A tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +112 lines, -0 lines 0 comments Download
A tools/telemetry/telemetry/web_perf/metrics/blob_timeline_unittest.py View 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 chunk +139 lines, -0 lines 0 comments Download
M tools/telemetry/telemetry/web_perf/timeline_based_measurement.py View 1 2 3 4 2 chunks +3 lines, -1 line 0 comments Download

Messages

Total messages: 58 (8 generated)
nednguyen
https://codereview.chromium.org/1104053006/diff/100001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/100001/tools/perf/benchmarks/blob_storage.py#newcode18 tools/perf/benchmarks/blob_storage.py:18: TOPLEVEL_CATEGORY) My guess is this category filter confused telemetry ...
5 years, 7 months ago (2015-05-07 10:51:06 UTC) #2
chromium-reviews
That worked, thanks! Next problem that I'm having: For some reason telemetry isn't reading some ...
5 years, 7 months ago (2015-05-07 20:59:20 UTC) #3
dmurph
On 2015/05/07 at 20:59:20, chromium-reviews wrote: > That worked, thanks! > > Next problem that ...
5 years, 7 months ago (2015-05-07 22:50:34 UTC) #4
nednguyen
https://codereview.chromium.org/1104053006/diff/120001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py File tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py (right): https://codereview.chromium.org/1104053006/diff/120001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py#newcode24 tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py:24: self._AddResultsInternal(renderer_thread.parent.IterAllSlices(), Instead of IterAllSlices(), try IterAllEvents instead. Async event ...
5 years, 7 months ago (2015-05-08 01:35:12 UTC) #5
chromium-reviews
We can keep going on this. I think this is close to be land-able. It ...
5 years, 7 months ago (2015-05-08 01:38:27 UTC) #6
dmurph
any more ideas? I printed out every event name that I get and no "BlobRequest" ...
5 years, 7 months ago (2015-05-08 18:59:23 UTC) #7
nednguyen
On 2015/05/08 18:59:23, dmurph wrote: > any more ideas? I printed out every event name ...
5 years, 7 months ago (2015-05-08 19:28:48 UTC) #8
nednguyen
On 2015/05/08 19:28:48, nednguyen wrote: > On 2015/05/08 18:59:23, dmurph wrote: > > any more ...
5 years, 7 months ago (2015-05-08 21:35:44 UTC) #9
chromium-reviews
Right, there are no "blob_reads". Only the writes. If you print out every event, you ...
5 years, 7 months ago (2015-05-08 21:36:45 UTC) #10
dmurph
Whoops, replying with @chromium Right, there are no "blob_reads". Only the writes. If you print ...
5 years, 7 months ago (2015-05-08 21:38:01 UTC) #11
chromium-reviews
I actually don't find BlobRequest in the trace-viewer either, only Registry::RegisterBlob On Fri, May 8, ...
5 years, 7 months ago (2015-05-08 22:04:20 UTC) #12
chromium-reviews
Did you do a full build of Chrome? The patch fixes a bug where that ...
5 years, 7 months ago (2015-05-08 22:21:01 UTC) #13
nednguyen
I confirm that I see those events in trace.json. I will work on the trace ...
5 years, 7 months ago (2015-05-11 16:05:53 UTC) #14
nednguyen
On 2015/05/11 16:05:53, nednguyen (slow review) wrote: > I confirm that I see those events ...
5 years, 7 months ago (2015-05-11 16:34:51 UTC) #15
dmurph
On 2015/05/11 at 16:34:51, nednguyen wrote: > On 2015/05/11 16:05:53, nednguyen (slow review) wrote: > ...
5 years, 7 months ago (2015-05-14 03:55:13 UTC) #16
nednguyen
On 2015/05/14 03:55:13, dmurph wrote: > On 2015/05/11 at 16:34:51, nednguyen wrote: > > On ...
5 years, 7 months ago (2015-05-14 16:45:11 UTC) #17
dmurph
On 2015/05/14 at 16:45:11, nednguyen wrote: > On 2015/05/14 03:55:13, dmurph wrote: > > On ...
5 years, 7 months ago (2015-05-18 22:28:56 UTC) #18
nednguyen
https://codereview.chromium.org/1104053006/diff/160001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/160001/tools/perf/benchmarks/blob_storage.py#newcode11 tools/perf/benchmarks/blob_storage.py:11: nit: add another blank line https://codereview.chromium.org/1104053006/diff/160001/tools/perf/page_sets/blob_workshop.py File tools/perf/page_sets/blob_workshop.py (right): ...
5 years, 7 months ago (2015-05-18 22:55:54 UTC) #19
nednguyen
https://codereview.chromium.org/1104053006/diff/160001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py File tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py (right): https://codereview.chromium.org/1104053006/diff/160001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py#newcode35 tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py:35: self._AddResultsInternal(events, interactions, results) On 2015/05/18 22:55:54, nednguyen wrote: > ...
5 years, 7 months ago (2015-05-19 00:34:16 UTC) #20
nednguyen
On 2015/05/19 00:34:16, nednguyen wrote: > https://codereview.chromium.org/1104053006/diff/160001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py > File tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py (right): > > https://codereview.chromium.org/1104053006/diff/160001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py#newcode35 > ...
5 years, 7 months ago (2015-05-19 15:52:53 UTC) #21
dmurph
It's working yay! Bug here: https://code.google.com/p/chromium/issues/detail?id=489799 +kinuko for storage/browser/blob/blob_url_request_job.cc https://codereview.chromium.org/1104053006/diff/160001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/160001/tools/perf/benchmarks/blob_storage.py#newcode11 tools/perf/benchmarks/blob_storage.py:11: ...
5 years, 7 months ago (2015-05-21 00:21:36 UTC) #22
nednguyen
Ethan: you want to take a pass at reviewing this?
5 years, 7 months ago (2015-05-22 15:35:43 UTC) #24
eakuefner
looking good; some notes, mostly style stuff. https://codereview.chromium.org/1104053006/diff/180001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/180001/tools/perf/benchmarks/blob_storage.py#newcode10 tools/perf/benchmarks/blob_storage.py:10: TOPLEVEL_CATEGORY = ...
5 years, 7 months ago (2015-05-22 18:33:19 UTC) #25
dmurph
Done w/ a couple questions https://codereview.chromium.org/1104053006/diff/180001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/180001/tools/perf/benchmarks/blob_storage.py#newcode10 tools/perf/benchmarks/blob_storage.py:10: TOPLEVEL_CATEGORY = 'Blob' On ...
5 years, 7 months ago (2015-05-22 19:06:21 UTC) #26
dmurph
Whoops, I forgot to upload. Also, I changed to the lambda for the event checking.
5 years, 7 months ago (2015-05-22 22:30:48 UTC) #27
dmurph
+kinuko for storage/browser/blob/blob_url_request_job.cc (and fixed tests)
5 years, 7 months ago (2015-05-22 23:02:32 UTC) #29
kinuko
On 2015/05/22 23:02:32, dmurph wrote: > +kinuko for storage/browser/blob/blob_url_request_job.cc lgtm for blob_url_request_job.cc > (and fixed ...
5 years, 7 months ago (2015-05-25 08:33:16 UTC) #30
dmurph
Gentle ping for ned and ethan :)
5 years, 6 months ago (2015-05-28 04:54:58 UTC) #31
nednguyen
https://codereview.chromium.org/1104053006/diff/220001/tools/perf/benchmarks/blob_storage.py File tools/perf/benchmarks/blob_storage.py (right): https://codereview.chromium.org/1104053006/diff/220001/tools/perf/benchmarks/blob_storage.py#newcode34 tools/perf/benchmarks/blob_storage.py:34: return (value.name.startswith('Action_CreateBlob') or I thought we want to filter ...
5 years, 6 months ago (2015-05-28 05:10:12 UTC) #32
eakuefner
lgtm https://codereview.chromium.org/1104053006/diff/180001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline_unittest.py File tools/telemetry/telemetry/web_perf/metrics/blob_timeline_unittest.py (right): https://codereview.chromium.org/1104053006/diff/180001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline_unittest.py#newcode20 tools/telemetry/telemetry/web_perf/metrics/blob_timeline_unittest.py:20: blob_timeline.BlobTimelineMetric()._AddWriteResultsInternal( On 2015/05/22 19:06:21, dmurph wrote: > On ...
5 years, 6 months ago (2015-05-28 20:36:56 UTC) #33
eakuefner
sorry, i meant lgtm as long as ned is happy :)
5 years, 6 months ago (2015-05-28 20:37:20 UTC) #34
dmurph
Switched to using thread_duration, using an accumulation of read times for blob read, and fixed ...
5 years, 6 months ago (2015-05-29 05:05:47 UTC) #35
nednguyen
https://codereview.chromium.org/1104053006/diff/240001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py File tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py (right): https://codereview.chromium.org/1104053006/diff/240001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py#newcode103 tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py:103: not self.IsWriteReadInteraction(interaction)): Again, you cannot make any assumption about ...
5 years, 6 months ago (2015-05-29 17:57:53 UTC) #36
dmurph
But this is how I'm computing my metrics. How will I know if my 'read' ...
5 years, 6 months ago (2015-05-29 18:44:54 UTC) #37
dmurph
On 2015/05/29 at 18:44:54, dmurph wrote: > But this is how I'm computing my metrics. ...
5 years, 6 months ago (2015-06-01 19:22:18 UTC) #38
nednguyen
A bit of caveat: we will move the interaction record out of the metric name, ...
5 years, 6 months ago (2015-06-01 23:29:27 UTC) #39
dmurph
On 2015/06/01 at 23:29:27, nednguyen wrote: > A bit of caveat: we will move the ...
5 years, 6 months ago (2015-06-01 23:42:48 UTC) #40
eakuefner
On 2015/06/01 23:42:48, dmurph wrote: > On 2015/06/01 at 23:29:27, nednguyen wrote: > > A ...
5 years, 6 months ago (2015-06-02 00:04:57 UTC) #41
dmurph
Switched to UUID-based tracking for reading and expanded tests a bit. patch selfie: http://i.imgur.com/YiEGExB.gif https://codereview.chromium.org/1104053006/diff/240001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py ...
5 years, 6 months ago (2015-06-02 20:04:07 UTC) #42
eakuefner
On 2015/06/02 at 20:04:07, dmurph wrote: > Switched to UUID-based tracking for reading and expanded ...
5 years, 6 months ago (2015-06-02 20:29:00 UTC) #43
nednguyen
lgtm with nits https://codereview.chromium.org/1104053006/diff/260001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py File tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py (right): https://codereview.chromium.org/1104053006/diff/260001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py#newcode74 tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py:74: values=writes, On 2015/06/02 20:04:07, dmurph wrote: ...
5 years, 6 months ago (2015-06-02 21:06:58 UTC) #44
dmurph
On 2015/06/02 at 21:06:58, nednguyen wrote: > lgtm with nits > > https://codereview.chromium.org/1104053006/diff/260001/tools/telemetry/telemetry/web_perf/metrics/blob_timeline.py > File ...
5 years, 6 months ago (2015-06-02 22:12:52 UTC) #45
dmurph
Actually, it would be worse than that. Every interaction in a benchmark would have two ...
5 years, 6 months ago (2015-06-02 22:18:24 UTC) #46
dmurph
Based on outside conversation, added None state and then filter it out in our benchmark. ...
5 years, 6 months ago (2015-06-02 22:55:45 UTC) #47
nednguyen
On 2015/06/02 22:55:45, dmurph wrote: > Based on outside conversation, added None state and then ...
5 years, 6 months ago (2015-06-02 22:59:44 UTC) #48
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1104053006/300001
5 years, 6 months ago (2015-06-02 23:16:14 UTC) #51
commit-bot: I haz the power
Try jobs failed on following builders: chromium_presubmit on tryserver.chromium.linux (JOB_FAILED, http://build.chromium.org/p/tryserver.chromium.linux/builders/chromium_presubmit/builds/67768)
5 years, 6 months ago (2015-06-02 23:31:54 UTC) #53
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/1104053006/320001
5 years, 6 months ago (2015-06-03 00:14:58 UTC) #56
commit-bot: I haz the power
Committed patchset #17 (id:320001)
5 years, 6 months ago (2015-06-03 03:24:49 UTC) #57
commit-bot: I haz the power
5 years, 6 months ago (2015-06-03 03:26:29 UTC) #58
Message was sent while issue was closed.
Patchset 17 (id:??) landed as
https://crrev.com/dbd2315e79df68af221c06dadbc00adfcdef07df
Cr-Commit-Position: refs/heads/master@{#332541}

Powered by Google App Engine
This is Rietveld 408576698