Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(61)

Issue 216523003: Tighten up webrtc audio tests. (Closed)

Created:
6 years, 9 months ago by phoglund_chromium
Modified:
6 years, 8 months ago
Reviewers:
perkj_chrome
CC:
chromium-reviews, feature-media-reviews_chromium.org, jam, darin-cc_chromium.org
Visibility:
Public.

Description

Tighten up webrtc audio tests. See http://goo.gl/LDae10. I'm trying to improve this algorithm. We used to check that some value was high enough and that the average was in the right ballpark. The new algorithm will count falling edges in the peaks instead, as a means to detect the peaks in the audio signal. The algorithm reliably yields one peak per second of sampled audio, which is correct because the audio signal beeps at 1 Hz. To get some margin, I'm sampling four seconds and checking that I get at least two peaks, which should be a rock solid assumption even on slow machines. BUG=357287, 357626 R=perkj@chromium.org NOTRY=True (passed all trybots, just got stuck on a broken win trybot) Committed: https://src.chromium.org/viewvc/chrome?view=rev&revision=260878

Patch Set 1 #

Total comments: 5

Patch Set 2 : Halved beep time and sampling times. #

Patch Set 3 : Improved documentation, tightened up a bit more. #

Patch Set 4 : Backing down to two peaks after flakes. #

Patch Set 5 : Further tweaks to combat flakes on Android. #

Unified diffs Side-by-side diffs Delta from patch set Stats (+29 lines, -25 lines) Patch
M content/test/data/media/peerconnection-call.html View 1 2 3 4 4 chunks +6 lines, -6 lines 0 comments Download
M content/test/data/media/webrtc_test_audio.js View 1 2 3 4 2 chunks +22 lines, -18 lines 0 comments Download
M media/video/capture/fake_video_capture_device.cc View 1 1 chunk +1 line, -1 line 0 comments Download

Messages

Total messages: 26 (0 generated)
phoglund_chromium
6 years, 9 months ago (2014-03-28 12:52:25 UTC) #1
perkj_chrome
4 seconds per test sounds like a lot. Why not increase the the frequency of ...
6 years, 9 months ago (2014-03-28 13:29:17 UTC) #2
phoglund_chromium
PTAL https://codereview.chromium.org/216523003/diff/1/content/test/data/media/peerconnection-call.html File content/test/data/media/peerconnection-call.html (right): https://codereview.chromium.org/216523003/diff/1/content/test/data/media/peerconnection-call.html#newcode295 content/test/data/media/peerconnection-call.html:295: gatherAudioLevelSamples(gSecondConnection, 40, 10, function(samples) { Ok, I doubled ...
6 years, 9 months ago (2014-03-28 13:55:26 UTC) #3
phoglund_chromium
The tests will now analyze audio in two-second intervals rather than 4-second; check the code ...
6 years, 9 months ago (2014-03-28 14:38:34 UTC) #4
perkj_chrome
On 2014/03/28 14:38:34, phoglund wrote: > The tests will now analyze audio in two-second intervals ...
6 years, 8 months ago (2014-03-31 07:52:39 UTC) #5
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-03-31 07:59:21 UTC) #6
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/40001
6 years, 8 months ago (2014-03-31 07:59:27 UTC) #7
commit-bot: I haz the power
The CQ bit was unchecked by commit-bot@chromium.org
6 years, 8 months ago (2014-03-31 15:50:46 UTC) #8
commit-bot: I haz the power
The commit queue went berserk retrying too often for a seemingly flaky test on builder ...
6 years, 8 months ago (2014-03-31 15:50:47 UTC) #9
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-03-31 16:22:56 UTC) #10
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/40001
6 years, 8 months ago (2014-03-31 16:27:33 UTC) #11
commit-bot: I haz the power
The CQ bit was unchecked by commit-bot@chromium.org
6 years, 8 months ago (2014-04-01 00:15:18 UTC) #12
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-04-01 07:02:26 UTC) #14
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/40001
6 years, 8 months ago (2014-04-01 07:03:01 UTC) #15
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-04-01 08:20:11 UTC) #16
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/60001
6 years, 8 months ago (2014-04-01 08:20:37 UTC) #17
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-04-01 13:31:54 UTC) #18
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/80001
6 years, 8 months ago (2014-04-01 13:32:08 UTC) #19
phoglund_chromium
The CQ bit was unchecked by phoglund@chromium.org
6 years, 8 months ago (2014-04-01 15:44:43 UTC) #20
phoglund_chromium
The CQ bit was checked by phoglund@chromium.org
6 years, 8 months ago (2014-04-01 15:45:28 UTC) #21
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/phoglund@chromium.org/216523003/80001
6 years, 8 months ago (2014-04-01 15:46:23 UTC) #22
commit-bot: I haz the power
Change committed as 260878
6 years, 8 months ago (2014-04-01 15:47:57 UTC) #23
Alexander Potapenko
On 2014/04/01 15:47:57, I haz the power (commit-bot) wrote: > Change committed as 260878 BTW ...
6 years, 8 months ago (2014-04-01 16:00:05 UTC) #24
phoglund_chromium
On 2014/04/01 16:00:05, Alexander Potapenko wrote: > On 2014/04/01 15:47:57, I haz the power (commit-bot) ...
6 years, 8 months ago (2014-04-01 16:10:27 UTC) #25
rlarocque
6 years, 8 months ago (2014-04-01 19:05:43 UTC) #26
Message was sent while issue was closed.
A revert of this CL has been created in
https://codereview.chromium.org/220403006/ by rlarocque@chromium.org.

The reason for reverting is: This might have resulted in some flaky tests.  This
failure happened two builds after the patch landed.

http://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%2...

See bug for more details.

BUG=358759.

Powered by Google App Engine
This is Rietveld 408576698