Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(384)

Issue 914253005: Telemetry: Create new profile creator large_profile_creator. (Closed)

Created:
5 years, 10 months ago by erikchen
Modified:
5 years, 10 months ago
Reviewers:
nednguyen, sullivan
CC:
chromium-reviews, telemetry-reviews_chromium.org
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Telemetry: Create new profile creator large_profile_creator. This CL creates two subclasses of FastNavigationProfileExtender: CookieProfileExtender and HistoryProfilerExtender. The former performs up to 500 navigations, with the goal of filling up the Cookie Database but not overfilling it (which is possible, unfortunately). The latter performs a large number ~20,000 navigations to URIs pointing at the local file system to fill up the History Database. The run these profile extenders, this CL adds the class LargeProfileCreator. This new class intentionally contains minimal logic, since the existing profile_creator.py file is pretty hacky, and the goal is to eventually move away from it entirely. BUG=442546 Committed: https://crrev.com/40e8ee4f57bdb5d0c6fcc27f8a551a9ea2420029 Cr-Commit-Position: refs/heads/master@{#317112}

Patch Set 1 #

Patch Set 2 : #

Patch Set 3 : Exact copy of patch set 10 from https://codereview.chromium.org/907503002/. #

Patch Set 4 : Reapply changes. Fixes after rebase. #

Patch Set 5 : Rebase against top of tree. #

Total comments: 14

Patch Set 6 : Comments from sullivan. #

Patch Set 7 : Comments from nednguyen. #

Total comments: 19

Patch Set 8 : Fix unit tests. Rename batch_size -> maximum_batch_size in class constructor. #

Patch Set 9 : Comments from nednguyen. #

Total comments: 4

Patch Set 10 : Comments from nednguyen, round three. #

Patch Set 11 : Comments from sullivan. #

Unified diffs Side-by-side diffs Delta from patch set Stats (+388 lines, -63 lines) Patch
A tools/perf/profile_creators/cookie_profile_extender.py View 1 2 3 4 5 6 7 8 1 chunk +68 lines, -0 lines 0 comments Download
A tools/perf/profile_creators/cookie_profile_extender_unittest.py View 1 2 3 4 5 6 7 8 9 10 1 chunk +48 lines, -0 lines 0 comments Download
M tools/perf/profile_creators/fast_navigation_profile_extender.py View 1 2 3 4 5 6 7 8 4 chunks +93 lines, -43 lines 0 comments Download
M tools/perf/profile_creators/fast_navigation_profile_extender_unittest.py View 1 2 3 4 5 6 7 8 1 chunk +28 lines, -20 lines 0 comments Download
A tools/perf/profile_creators/history_profile_extender.py View 1 2 3 4 5 6 7 8 9 10 1 chunk +90 lines, -0 lines 0 comments Download
A tools/perf/profile_creators/history_profile_extender_unittest.py View 1 2 3 4 5 6 7 1 chunk +44 lines, -0 lines 0 comments Download
A tools/perf/profile_creators/large_profile_creator.py View 1 2 3 1 chunk +17 lines, -0 lines 0 comments Download

Messages

Total messages: 27 (7 generated)
erikchen
nednguyen: Please review. This CL builds on top of https://codereview.chromium.org/907503002/. If/when we land that CL, ...
5 years, 10 months ago (2015-02-12 02:02:01 UTC) #2
erikchen
nednguyen: Ping?
5 years, 10 months ago (2015-02-13 04:02:12 UTC) #3
nednguyen
On 2015/02/13 04:02:12, erikchen wrote: > nednguyen: Ping? I want to wait for the other ...
5 years, 10 months ago (2015-02-13 04:04:05 UTC) #4
erikchen
On 2015/02/13 04:04:05, nednguyen wrote: > On 2015/02/13 04:02:12, erikchen wrote: > > nednguyen: Ping? ...
5 years, 10 months ago (2015-02-13 04:05:37 UTC) #5
erikchen
nednguyen: PTAL If you diff patch set 4 against patch set 3, you will get ...
5 years, 10 months ago (2015-02-18 00:24:37 UTC) #8
erikchen
nednguyen: PTAL The dependency CL has landed, and patch set 5 has rebased against top ...
5 years, 10 months ago (2015-02-18 02:26:49 UTC) #9
nednguyen
5 years, 10 months ago (2015-02-18 02:31:26 UTC) #11
sullivan
https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/fast_navigation_profile_extender.py File tools/perf/profile_creators/fast_navigation_profile_extender.py (right): https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/fast_navigation_profile_extender.py#newcode28 tools/perf/profile_creators/fast_navigation_profile_extender.py:28: # The path of the profile that the browser ...
5 years, 10 months ago (2015-02-18 21:18:06 UTC) #12
erikchen
sullivan: PTAL https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/fast_navigation_profile_extender.py File tools/perf/profile_creators/fast_navigation_profile_extender.py (right): https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/fast_navigation_profile_extender.py#newcode28 tools/perf/profile_creators/fast_navigation_profile_extender.py:28: # The path of the profile that ...
5 years, 10 months ago (2015-02-18 22:04:01 UTC) #13
nednguyen
https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/cookie_profile_extender.py File tools/perf/profile_creators/cookie_profile_extender.py (right): https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/cookie_profile_extender.py#newcode41 tools/perf/profile_creators/cookie_profile_extender.py:41: def _IsCookieDBFull(self): Can you add unittest coverage for this? ...
5 years, 10 months ago (2015-02-18 22:43:14 UTC) #14
erikchen
nednguyen: PTAL https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/cookie_profile_extender.py File tools/perf/profile_creators/cookie_profile_extender.py (right): https://codereview.chromium.org/914253005/diff/120001/tools/perf/profile_creators/cookie_profile_extender.py#newcode41 tools/perf/profile_creators/cookie_profile_extender.py:41: def _IsCookieDBFull(self): On 2015/02/18 22:43:14, nednguyen wrote: ...
5 years, 10 months ago (2015-02-18 23:32:30 UTC) #15
nednguyen
https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py File tools/perf/profile_creators/cookie_profile_extender_unittest.py (right): https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py#newcode31 tools/perf/profile_creators/cookie_profile_extender_unittest.py:31: handle, path = tempfile.mkstemp() Can you try tempfile.TemporaryFile() here ...
5 years, 10 months ago (2015-02-19 00:33:32 UTC) #16
erikchen
nednguyen: PTAL https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py File tools/perf/profile_creators/cookie_profile_extender_unittest.py (right): https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py#newcode31 tools/perf/profile_creators/cookie_profile_extender_unittest.py:31: handle, path = tempfile.mkstemp() On 2015/02/19 00:33:31, ...
5 years, 10 months ago (2015-02-19 01:56:03 UTC) #17
nednguyen
lgtm with nits. Please wait for Annie's approval also. https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py File tools/perf/profile_creators/cookie_profile_extender_unittest.py (right): https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py#newcode31 tools/perf/profile_creators/cookie_profile_extender_unittest.py:31: ...
5 years, 10 months ago (2015-02-19 17:07:37 UTC) #18
sullivan
lgtm https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py File tools/perf/profile_creators/cookie_profile_extender_unittest.py (right): https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py#newcode31 tools/perf/profile_creators/cookie_profile_extender_unittest.py:31: handle, path = tempfile.mkstemp() On 2015/02/19 17:07:37, nednguyen ...
5 years, 10 months ago (2015-02-19 18:24:42 UTC) #20
erikchen
sullivan: PTAL https://codereview.chromium.org/914253005/diff/200001/tools/perf/profile_creators/history_profile_extender.py File tools/perf/profile_creators/history_profile_extender.py (right): https://codereview.chromium.org/914253005/diff/200001/tools/perf/profile_creators/history_profile_extender.py#newcode41 tools/perf/profile_creators/history_profile_extender.py:41: self._file_paths = [] On 2015/02/19 17:07:37, nednguyen ...
5 years, 10 months ago (2015-02-19 18:24:49 UTC) #21
erikchen
On 2015/02/19 18:24:42, sullivan wrote: > lgtm > > https://codereview.chromium.org/914253005/diff/160001/tools/perf/profile_creators/cookie_profile_extender_unittest.py > File tools/perf/profile_creators/cookie_profile_extender_unittest.py (right): > ...
5 years, 10 months ago (2015-02-19 18:31:15 UTC) #23
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/patch-status/914253005/240001
5 years, 10 months ago (2015-02-19 18:32:34 UTC) #25
commit-bot: I haz the power
Committed patchset #11 (id:240001)
5 years, 10 months ago (2015-02-19 19:53:13 UTC) #26
commit-bot: I haz the power
5 years, 10 months ago (2015-02-19 19:53:39 UTC) #27
Message was sent while issue was closed.
Patchset 11 (id:??) landed as
https://crrev.com/40e8ee4f57bdb5d0c6fcc27f8a551a9ea2420029
Cr-Commit-Position: refs/heads/master@{#317112}

Powered by Google App Engine
This is Rietveld 408576698