Add benchmark that tests garbage collector and idle time handler.

Add benchmark that tests garbage collector and idle time handler.

High memory usage is forced by duplicate tabs in the same process.

BUG=
CQ_EXTRA_TRYBOTS=tryserver.chromium.perf:linux_perf_bisect;tryserver.chromium.perf:mac_perf_bisect;tryserver.chromium.perf:win_perf_bisect;tryserver.chromium.perf:android_nexus5_perf_bisect

Committed: https://crrev.com/22ead27351ef035b4b9f983bdc4a4077a1455d77
Cr-Commit-Position: refs/heads/master@{#330930}

[ulan, 2015-05-20 14:32:44]

ulan@chromium.org changed reviewers:
+ hpayer@chromium.org, skyostil@chromium.org

[ulan, 2015-05-20 14:32:44]

Hi Sami, would you be the right reviewer for this?

[Sami, 2015-05-20 15:52:20]

Thanks for the patch. Overall the logic looks good, I just had some style nits.

I wonder about the runtime of this -- it looks like roughly 7 minutes over all
the pages? Is there a way to we could make it faster?

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
File tools/perf/page_sets/idle_multi_tab_cases.py (right):

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:12: def SpawnTab(action_runner):
nit: Two blank lines between toplevel items please.
nit: _SpawnTab?

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:13: return
action_runner.EvaluateJavaScript("__telemetry_spawn_tab()")
nit: single quotes for strings

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:15: def CloseTab(action_runner,
tab):
_CloseTab

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:16:
action_runner.EvaluateJavaScript("__telemetry_close_tab(" + str(tab) + ")")
Ditto about quotes.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:35: # Quikly open tabs.
typo: Quickly

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:39: # Quikly close tabs.
Ditto.

[ulan, 2015-05-20 16:14:43]

Thank you for review!

> I wonder about the runtime of this -- it looks like roughly 7 minutes over all
the pages? Is there a way to we could make it faster?
I removed 20 seconds per page, now it is about 6 minutes overall. The large
delays test how well we can reclaim garbage in the idle time, so it would be
nice to have them.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
File tools/perf/page_sets/idle_multi_tab_cases.py (right):

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:12: def SpawnTab(action_runner):
On 2015/05/20 15:52:19, Sami wrote:
> nit: Two blank lines between toplevel items please.
> nit: _SpawnTab?

Done.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:13: return
action_runner.EvaluateJavaScript("__telemetry_spawn_tab()")
On 2015/05/20 15:52:19, Sami wrote:
> nit: single quotes for strings

Done.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:15: def CloseTab(action_runner,
tab):
On 2015/05/20 15:52:19, Sami wrote:
> _CloseTab

Done.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:16:
action_runner.EvaluateJavaScript("__telemetry_close_tab(" + str(tab) + ")")
On 2015/05/20 15:52:19, Sami wrote:
> Ditto about quotes.

Done.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:35: # Quikly open tabs.
On 2015/05/20 15:52:20, Sami wrote:
> typo: Quickly

Done.

https://codereview.chromium.org/1145173002/diff/40001/tools/perf/page_sets/id...
tools/perf/page_sets/idle_multi_tab_cases.py:39: # Quikly close tabs.
On 2015/05/20 15:52:20, Sami wrote:
> Ditto.

Done.

[Sami, 2015-05-20 16:22:54]

Thanks, lgtm.

cc +sullivan in case she has opinions about the increased test run time.

[sullivan, 2015-05-20 19:22:25]

On 2015/05/20 16:22:54, Sami wrote:
> Thanks, lgtm.
> 
> cc +sullivan in case she has opinions about the increased test run time.

lgtm for runtime (but we will double-check it on the CQ_EXTRA_TRYBOTS)

[ulan, 2015-05-21 07:57:48]

The CQ bit was checked by ulan@chromium.org

[commit-bot: I haz the power, 2015-05-21 07:58:06]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1145173002/70001

[ulan, 2015-05-21 09:24:29]

The CQ bit was checked by ulan@chromium.org

[ulan, 2015-05-21 09:24:30]

The patchset sent to the CQ was uploaded after l-g-t-m from
sullivan@chromium.org, skyostil@chromium.org
Link to the patchset: https://codereview.chromium.org/1145173002/#ps90001
(title: "Disable for Android to avoid OOM crash (benchmark needs > 700MB)")

[commit-bot: I haz the power, 2015-05-21 09:24:45]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1145173002/90001

[commit-bot: I haz the power, 2015-05-21 11:17:15]

Committed patchset #6 (id:90001)

[commit-bot: I haz the power, 2015-05-21 11:18:03]

Patchset 6 (id:??) landed as
https://crrev.com/22ead27351ef035b4b9f983bdc4a4077a1455d77
Cr-Commit-Position: refs/heads/master@{#330930}