Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(546)

Issue 515473004: Deflakify CastStreamingApiTest.EndToEnd, enabling it for Release builds. (Closed)

Created:
6 years, 3 months ago by miu
Modified:
6 years, 3 months ago
CC:
chromium-reviews, hclam+watch_chromium.org, imcheng+watch_chromium.org, extensions-reviews_chromium.org, hguihot+watch_chromium.org, jasonroberts+watch_google.com, avayvod+watch_chromium.org, pwestin+watch_google.com, chromium-apps-reviews_chromium.org, miu+watch_chromium.org, hubbe+watch_chromium.org, mikhal+watch_chromium.org
Base URL:
https://chromium.googlesource.com/chromium/src.git@master
Project:
chromium
Visibility:
Public.

Description

Deflakify CastStreamingApiTest.EndToEnd, enabling it for Release builds. An analysis was performed for sources of flakiness in this test. A number of implementation problems have been resolved in recent changes, with this change focusing on addressing problems with the test code itself: 1. Do not require the color to match the tone at the same time. A/V sync belongs in a perf test. 2. Do not require a color or tone to be held for a full half-second. Instead, any momentary observation that matches expectations is sufficient. 3. Only examine the content part of each video frame (i.e., exclude the surrounding black borders caused by letterboxing). 4. Generate the source content using a canvas and requestAnimationFrame(). The source content has a little "ball" animating within it to ensure changing video frames are being sent through end-to-end. Also added AES keys to test end-to-end with encryption enabled. This change re-enables the test for Release builds only. Once the test has proven to be stable again, it will be re-enabled for Debug builds as well. Baby steps... BUG=396413 Committed: https://crrev.com/4b0ebd322e95bd691a510c19b16fb258be86ef51 Cr-Commit-Position: refs/heads/master@{#292539}

Patch Set 1 #

Patch Set 2 : Do not block for each tone/color, block once for all. #

Total comments: 2

Patch Set 3 : Disable for OS_CHROMEOS. Audio worked, but video did not. #

Patch Set 4 : Capitalization matters. #

Unified diffs Side-by-side diffs Delta from patch set Stats (+275 lines, -202 lines) Patch
M chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc View 1 2 3 8 chunks +189 lines, -140 lines 0 comments Download
M chrome/test/data/extensions/api_test/cast_streaming/end_to_end_sender.html View 1 chunk +0 lines, -1 line 0 comments Download
M chrome/test/data/extensions/api_test/cast_streaming/end_to_end_sender.js View 4 chunks +86 lines, -61 lines 0 comments Download

Messages

Total messages: 11 (0 generated)
miu
miu@chromium.org changed reviewers: + hubbe@chromium.org
6 years, 3 months ago (2014-08-28 03:40:16 UTC) #1
miu
hubbe: PTAL.
6 years, 3 months ago (2014-08-28 03:40:16 UTC) #2
hubbe
lgtm https://codereview.chromium.org/515473004/diff/20001/chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc File chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc (right): https://codereview.chromium.org/515473004/diff/20001/chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc#newcode211 chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc:211: const gfx::Rect region = FindLetterboxedContentRegion(video_frame); Excluding the letterboxing ...
6 years, 3 months ago (2014-08-28 17:29:23 UTC) #3
Alpha Left Google
hclam@chromium.org changed reviewers: + hclam@chromium.org
6 years, 3 months ago (2014-08-28 18:13:23 UTC) #4
Alpha Left Google
LGTM.
6 years, 3 months ago (2014-08-28 18:13:23 UTC) #5
miu
https://codereview.chromium.org/515473004/diff/20001/chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc File chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc (right): https://codereview.chromium.org/515473004/diff/20001/chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc#newcode211 chrome/browser/extensions/api/cast_streaming/cast_streaming_apitest.cc:211: const gfx::Rect region = FindLetterboxedContentRegion(video_frame); On 2014/08/28 17:29:23, hubbe ...
6 years, 3 months ago (2014-08-28 18:58:17 UTC) #6
miu
The CQ bit was checked by miu@chromium.org
6 years, 3 months ago (2014-08-28 23:04:21 UTC) #7
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/miu@chromium.org/515473004/60001
6 years, 3 months ago (2014-08-28 23:05:42 UTC) #8
commit-bot: I haz the power
FYI, CQ is re-trying this CL (attempt #1). The failing builders are: win_chromium_x64_rel_swarming on tryserver.chromium.win ...
6 years, 3 months ago (2014-08-29 00:06:20 UTC) #9
commit-bot: I haz the power
Committed patchset #4 (id:60001) as 888a30dd0c2715de1e861542438b27ebdad08ccb
6 years, 3 months ago (2014-08-29 01:31:18 UTC) #10
commit-bot: I haz the power
6 years, 3 months ago (2014-09-10 03:04:57 UTC) #11
Message was sent while issue was closed.
Patchset 4 (id:??) landed as
https://crrev.com/4b0ebd322e95bd691a510c19b16fb258be86ef51
Cr-Commit-Position: refs/heads/master@{#292539}

Powered by Google App Engine
This is Rietveld 408576698