Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(730)

Issue 2517503003: Reland: Make more media APIs aware of |delay| and |delay_timestamp| (Closed)

Created:
4 years, 1 month ago by Mikhail
Modified:
4 years ago
CC:
chromium-reviews, darin-cc_chromium.org, feature-media-reviews_chromium.org, jam, mcasas+watch+vc_chromium.org, miu+watch_chromium.org, mlamouri+watch-content_chromium.org, posciak+watch_chromium.org, xjz+watch_chromium.org
Target Ref:
refs/pending/heads/master
Project:
chromium
Visibility:
Public.

Description

Reland: Make more media APIs aware of |delay| and |delay_timestamp| This patch is a part of 'AudioContext.getOutputTimestamp' method implementation [1] and it continues the changes introduced at [2]. The AudioRendererSink::RenderCallback::Render method has same semantics as AudioSourceCallback::OnMoreData. That caused other changes in the following interfaces: - AudioSyncReader::UpdatePendingBytes(uint32_t bytes, uint32_t frames_skipped) -> AudioSyncReader::PrepareNextData(base::TimeDelta delay, base::TimeTicks delay_timestamp, uint32_t frames_skipped) - AudioDeviceThread::Callback::Process(uint32_t pending_data) -> AudioDeviceThread::Callback::Process(int64_t pending_data, base::TimeTicks data_timestamp) - AudioDeviceThread is receiving a "packet" of two int64_t values BUG=619533 [1] https://codereview.chromium.org/2060833002/ [2] https://codereview.chromium.org/2101303004/ Initially committed at: https://crrev.com/06d9d80a203b9c329fc6d53fde44bae66645a389 Reverted at: https://crrev.com/2665e952502835c6c37d51153bfa180343635a41 CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:linux_optional_gpu_tests_rel;master.tryserver.chromium.mac:mac_optional_gpu_tests_rel;master.tryserver.chromium.win:win_optional_gpu_tests_rel Committed: https://crrev.com/a6a331af3e247c40a7aa360c0422db4ec4e5b275 Cr-Commit-Position: refs/heads/master@{#435597}

Patch Set 1 : Initial (reverted) patch #

Patch Set 2 : Fixed speech synthesis on Chrome OS #

Total comments: 4

Patch Set 3 : Comments from miu@ , also removed unused class member #

Total comments: 6

Patch Set 4 : Comments from chcunningham@ #

Patch Set 5 : Pepper audio fixed #

Total comments: 12

Patch Set 6 : Comments from Dale #

Patch Set 7 : Updated audio_output_win_unittest #

Total comments: 6

Patch Set 8 : Comments from chcunningham@ and Dale #

Unified diffs Side-by-side diffs Delta from patch set Stats (+320 lines, -215 lines) Patch
M content/browser/renderer_host/media/audio_sync_reader.h View 1 chunk +3 lines, -1 line 0 comments Download
M content/browser/renderer_host/media/audio_sync_reader.cc View 1 2 3 4 5 6 7 2 chunks +29 lines, -7 lines 0 comments Download
M content/renderer/media/renderer_webaudiodevice_impl.h View 1 chunk +4 lines, -3 lines 0 comments Download
M content/renderer/media/renderer_webaudiodevice_impl.cc View 2 chunks +5 lines, -3 lines 0 comments Download
M content/renderer/media/track_audio_renderer.h View 1 chunk +4 lines, -3 lines 0 comments Download
M content/renderer/media/track_audio_renderer.cc View 2 chunks +6 lines, -11 lines 0 comments Download
M content/renderer/media/webrtc_audio_renderer.h View 2 chunks +5 lines, -4 lines 0 comments Download
M content/renderer/media/webrtc_audio_renderer.cc View 5 chunks +12 lines, -22 lines 0 comments Download
M media/audio/audio_output_controller.h View 1 chunk +8 lines, -8 lines 0 comments Download
M media/audio/audio_output_controller.cc View 4 chunks +6 lines, -7 lines 0 comments Download
M media/audio/audio_output_controller_unittest.cc View 2 chunks +5 lines, -3 lines 0 comments Download
M media/audio/audio_output_device.cc View 1 2 3 4 5 4 chunks +12 lines, -11 lines 0 comments Download
M media/audio/audio_output_device_unittest.cc View 1 2 3 4 chunks +21 lines, -10 lines 0 comments Download
M media/audio/audio_output_stream_sink.cc View 2 chunks +3 lines, -6 lines 0 comments Download
M media/audio/clockless_audio_sink.cc View 1 chunk +2 lines, -1 line 0 comments Download
M media/audio/null_audio_sink.cc View 1 chunk +2 lines, -1 line 0 comments Download
M media/audio/win/audio_output_win_unittest.cc View 1 2 3 4 5 6 7 5 chunks +28 lines, -20 lines 0 comments Download
M media/base/audio_bus_perftest.cc View 1 chunk +1 line, -1 line 0 comments Download
M media/base/audio_converter_unittest.cc View 1 chunk +2 lines, -1 line 0 comments Download
M media/base/audio_hash_unittest.cc View 1 chunk +2 lines, -1 line 0 comments Download
M media/base/audio_parameters.h View 1 2 1 chunk +2 lines, -0 lines 0 comments Download
M media/base/audio_renderer_mixer.h View 1 chunk +4 lines, -3 lines 0 comments Download
M media/base/audio_renderer_mixer.cc View 3 chunks +7 lines, -3 lines 0 comments Download
M media/base/audio_renderer_mixer_input.cc View 2 chunks +6 lines, -1 line 0 comments Download
M media/base/audio_renderer_mixer_unittest.cc View 3 chunks +8 lines, -4 lines 0 comments Download
M media/base/audio_renderer_sink.h View 1 chunk +8 lines, -7 lines 0 comments Download
M media/base/fake_audio_render_callback.h View 1 chunk +4 lines, -3 lines 0 comments Download
M media/base/fake_audio_render_callback.cc View 2 chunks +7 lines, -3 lines 0 comments Download
M media/base/fake_audio_renderer_sink.h View 1 chunk +2 lines, -2 lines 0 comments Download
M media/base/fake_audio_renderer_sink.cc View 1 chunk +2 lines, -2 lines 0 comments Download
M media/base/silent_sink_suspender.h View 1 chunk +4 lines, -3 lines 0 comments Download
M media/base/silent_sink_suspender.cc View 4 chunks +9 lines, -7 lines 0 comments Download
M media/base/silent_sink_suspender_unittest.cc View 8 chunks +39 lines, -14 lines 0 comments Download
M media/blink/webaudiosourceprovider_impl.cc View 5 chunks +18 lines, -10 lines 0 comments Download
M media/blink/webaudiosourceprovider_impl_unittest.cc View 2 chunks +6 lines, -3 lines 0 comments Download
M media/renderers/audio_renderer_impl.h View 1 chunk +5 lines, -4 lines 0 comments Download
M media/renderers/audio_renderer_impl.cc View 2 chunks +9 lines, -5 lines 0 comments Download
M media/renderers/audio_renderer_impl_unittest.cc View 5 chunks +9 lines, -9 lines 0 comments Download
M ppapi/shared_impl/ppb_audio_shared.cc View 1 2 3 4 5 1 chunk +11 lines, -8 lines 0 comments Download

Messages

Total messages: 61 (36 generated)
Mikhail
PTAL
4 years, 1 month ago (2016-11-21 14:10:17 UTC) #9
Mikhail
On 2016/11/21 14:10:17, Mikhail wrote: > PTAL The problem with initial patch was so that ...
4 years, 1 month ago (2016-11-21 14:12:37 UTC) #10
miu
PS2 lgtm % a couple concerns: https://codereview.chromium.org/2517503003/diff/40001/content/browser/renderer_host/media/audio_sync_reader.cc File content/browser/renderer_host/media/audio_sync_reader.cc (right): https://codereview.chromium.org/2517503003/diff/40001/content/browser/renderer_host/media/audio_sync_reader.cc#newcode178 content/browser/renderer_host/media/audio_sync_reader.cc:178: return; Is this ...
4 years, 1 month ago (2016-11-21 20:30:53 UTC) #11
Mikhail
Thanks for review! https://codereview.chromium.org/2517503003/diff/40001/content/browser/renderer_host/media/audio_sync_reader.cc File content/browser/renderer_host/media/audio_sync_reader.cc (right): https://codereview.chromium.org/2517503003/diff/40001/content/browser/renderer_host/media/audio_sync_reader.cc#newcode178 content/browser/renderer_host/media/audio_sync_reader.cc:178: return; On 2016/11/21 20:30:53, miu wrote: ...
4 years, 1 month ago (2016-11-22 12:10:40 UTC) #12
chcunningham
https://codereview.chromium.org/2517503003/diff/60001/media/audio/audio_output_device.cc File media/audio/audio_output_device.cc (right): https://codereview.chromium.org/2517503003/diff/60001/media/audio/audio_output_device.cc#newcode452 media/audio/audio_output_device.cc:452: void AudioOutputDevice::AudioThreadCallback::Process(uint32_t pending_data) { Can you rename this to ...
4 years, 1 month ago (2016-11-22 17:36:58 UTC) #13
Mikhail
please take another look https://codereview.chromium.org/2517503003/diff/60001/media/audio/audio_output_device.cc File media/audio/audio_output_device.cc (right): https://codereview.chromium.org/2517503003/diff/60001/media/audio/audio_output_device.cc#newcode452 media/audio/audio_output_device.cc:452: void AudioOutputDevice::AudioThreadCallback::Process(uint32_t pending_data) { On ...
4 years ago (2016-11-23 15:26:01 UTC) #16
chcunningham
lgtm
4 years ago (2016-11-23 19:26:05 UTC) #19
Mikhail
tommi@, could you pls take a look at content/ changes?
4 years ago (2016-11-23 19:48:56 UTC) #20
tommi (sloooow) - chröme
lgtm for content/
4 years ago (2016-11-23 19:52:32 UTC) #21
David Tseng
Not lg for tts. There's noticeable clipping when using tts through Pepper audio. Better than ...
4 years ago (2016-11-23 23:49:33 UTC) #22
Mikhail
On 2016/11/23 23:49:33, David Tseng wrote: > Not lg for tts. There's noticeable clipping when ...
4 years ago (2016-11-25 10:59:25 UTC) #25
Mikhail
bbudge@, raymes@, could you take a look at ppapi/ changes?
4 years ago (2016-11-25 11:01:37 UTC) #27
raymes
On 2016/11/25 11:01:37, Mikhail wrote: > bbudge@, raymes@, could you take a look at ppapi/ ...
4 years ago (2016-11-28 02:19:56 UTC) #31
chcunningham
On 2016/11/28 02:19:56, raymes wrote: > On 2016/11/25 11:01:37, Mikhail wrote: > > bbudge@, raymes@, ...
4 years ago (2016-11-28 22:22:50 UTC) #32
DaleCurtis
https://codereview.chromium.org/2517503003/diff/100001/content/browser/renderer_host/media/audio_sync_reader.cc File content/browser/renderer_host/media/audio_sync_reader.cc (right): https://codereview.chromium.org/2517503003/diff/100001/content/browser/renderer_host/media/audio_sync_reader.cc#newcode155 content/browser/renderer_host/media/audio_sync_reader.cc:155: buffer->params.delay_timestamp Formatting is incorrect here; you're also not supposed ...
4 years ago (2016-11-28 22:55:46 UTC) #33
Mikhail
Thanks for your comments! https://codereview.chromium.org/2517503003/diff/100001/content/browser/renderer_host/media/audio_sync_reader.cc File content/browser/renderer_host/media/audio_sync_reader.cc (right): https://codereview.chromium.org/2517503003/diff/100001/content/browser/renderer_host/media/audio_sync_reader.cc#newcode155 content/browser/renderer_host/media/audio_sync_reader.cc:155: buffer->params.delay_timestamp On 2016/11/28 22:55:46, DaleCurtis ...
4 years ago (2016-11-29 14:54:50 UTC) #34
Mikhail
On 2016/11/28 22:22:50, chcunningham wrote: > On 2016/11/28 02:19:56, raymes wrote: > > On 2016/11/25 ...
4 years ago (2016-11-29 15:03:20 UTC) #35
Mikhail
On 2016/11/29 15:03:20, Mikhail wrote: > As for the test, it indeed needs to be ...
4 years ago (2016-11-30 14:51:21 UTC) #38
chcunningham
lgtm https://codereview.chromium.org/2517503003/diff/140001/media/audio/win/audio_output_win_unittest.cc File media/audio/win/audio_output_win_unittest.cc (right): https://codereview.chromium.org/2517503003/diff/140001/media/audio/win/audio_output_win_unittest.cc#newcode607 media/audio/win/audio_output_win_unittest.cc:607: sine.OnMoreData(delay, base::TimeTicks::Now(), 0, audio_bus.get()); I'd send in the ...
4 years ago (2016-11-30 20:54:28 UTC) #41
DaleCurtis
Just checked over the ASR stuff, defer to chcunningham@ for rest of review. lgtm https://codereview.chromium.org/2517503003/diff/140001/content/browser/renderer_host/media/audio_sync_reader.cc ...
4 years ago (2016-11-30 22:19:05 UTC) #42
raymes
rs lgtm for ppai
4 years ago (2016-11-30 22:45:07 UTC) #43
Mikhail
https://codereview.chromium.org/2517503003/diff/140001/content/browser/renderer_host/media/audio_sync_reader.cc File content/browser/renderer_host/media/audio_sync_reader.cc (right): https://codereview.chromium.org/2517503003/diff/140001/content/browser/renderer_host/media/audio_sync_reader.cc#newcode172 content/browser/renderer_host/media/audio_sync_reader.cc:172: const std::string error_message = "ASW: No room in socket ...
4 years ago (2016-12-01 12:22:30 UTC) #51
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-cq-status.appspot.com/v2/patch-status/codereview.chromium.org/2517503003/180001
4 years ago (2016-12-01 12:36:44 UTC) #56
commit-bot: I haz the power
Committed patchset #8 (id:180001)
4 years ago (2016-12-01 12:41:26 UTC) #59
commit-bot: I haz the power
4 years ago (2016-12-01 12:43:23 UTC) #61
Message was sent while issue was closed.
Patchset 8 (id:??) landed as
https://crrev.com/a6a331af3e247c40a7aa360c0422db4ec4e5b275
Cr-Commit-Position: refs/heads/master@{#435597}

Powered by Google App Engine
This is Rietveld 408576698