OLD | NEW |
1 # Copyright 2016 The Chromium Authors. All rights reserved. | 1 # Copyright 2016 The Chromium Authors. All rights reserved. |
2 # Use of this source code is governed by a BSD-style license that can be | 2 # Use of this source code is governed by a BSD-style license that can be |
3 # found in the LICENSE file. | 3 # found in the LICENSE file. |
4 | 4 |
5 """Run all system health stories used by system health benchmarks. | 5 """Run all system health stories used by system health benchmarks. |
6 | 6 |
7 Only memory benchmarks are used when running these stories to make the total | 7 Only memory benchmarks are used when running these stories to make the total |
8 cycle time manageable. Other system health benchmarks should be using the same | 8 cycle time manageable. Other system health benchmarks should be using the same |
9 stories as memory ones, only with fewer actions (no memory dumping). | 9 stories as memory ones, only with fewer actions (no memory dumping). |
10 """ | 10 """ |
(...skipping 45 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
56 | 56 |
57 # crbug.com/696824 | 57 # crbug.com/696824 |
58 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:news:qq', # pylint: disable=line-too-long | 58 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:news:qq', # pylint: disable=line-too-long |
59 | 59 |
60 # crbug.com/698006 | 60 # crbug.com/698006 |
61 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:tools:drive', # pylint: disable=line-too-long | 61 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:tools:drive', # pylint: disable=line-too-long |
62 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:tools:gmail', # pylint: disable=line-too-long | 62 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:tools:gmail', # pylint: disable=line-too-long |
63 | 63 |
64 # crbug.com/699966 | 64 # crbug.com/699966 |
65 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.multitab:misc:typical24', # pylint: disable=line-too-long | 65 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.multitab:misc:typical24', # pylint: disable=line-too-long |
| 66 # crbug.com/725923 |
| 67 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:social:facebook', # pylint: disable=line-too-long |
| 68 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:media:flickr', # pylint: disable=line-too-long |
| 69 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:social:tumblr', # pylint: disable=line-too-long |
| 70 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_desktop.load:social:twitter', # pylint: disable=line-too-long |
| 71 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_mobile.load:social:facebook', # pylint: disable=line-too-long |
| 72 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_mobile.load:social:tumblr', # pylint: disable=line-too-long |
| 73 'benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_hea
lth.memory_mobile.load:social:pinterest', # pylint: disable=line-too-long |
66 }) | 74 }) |
67 | 75 |
68 | 76 |
69 def _GenerateSmokeTestCase(benchmark_class, story_to_smoke_test): | 77 def _GenerateSmokeTestCase(benchmark_class, story_to_smoke_test): |
70 | 78 |
71 # NOTE TO SHERIFFS: DO NOT DISABLE THIS TEST. | 79 # NOTE TO SHERIFFS: DO NOT DISABLE THIS TEST. |
72 # | 80 # |
73 # This smoke test dynamically tests all system health user stories. So | 81 # This smoke test dynamically tests all system health user stories. So |
74 # disabling it for one failing or flaky benchmark would disable a much | 82 # disabling it for one failing or flaky benchmark would disable a much |
75 # wider swath of coverage than is usally intended. Instead, if a test is | 83 # wider swath of coverage than is usally intended. Instead, if a test is |
(...skipping 84 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
160 # Prefetch WPR archive needed by the stories set to avoid race condition | 168 # Prefetch WPR archive needed by the stories set to avoid race condition |
161 # when feching them when tests are run in parallel. | 169 # when feching them when tests are run in parallel. |
162 # See crbug.com/700426 for more details. | 170 # See crbug.com/700426 for more details. |
163 stories_set.wpr_archive_info.DownloadArchivesIfNeeded() | 171 stories_set.wpr_archive_info.DownloadArchivesIfNeeded() |
164 | 172 |
165 for story_to_smoke_test in stories_set.stories: | 173 for story_to_smoke_test in stories_set.stories: |
166 suite.addTest( | 174 suite.addTest( |
167 _GenerateSmokeTestCase(benchmark_class, story_to_smoke_test)) | 175 _GenerateSmokeTestCase(benchmark_class, story_to_smoke_test)) |
168 | 176 |
169 return suite | 177 return suite |
OLD | NEW |