Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(174)

Side by Side Diff: content/renderer/media/audio_device.h

Issue 8785008: Simplify AudioRendererImpl by using AudioDevice. (Closed) Base URL: svn://svn.chromium.org/chrome/trunk/src
Patch Set: Update stale comment Created 9 years ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
« no previous file with comments | « no previous file | content/renderer/media/audio_device.cc » ('j') | no next file with comments »
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
1 // Copyright (c) 2011 The Chromium Authors. All rights reserved. 1 // Copyright (c) 2011 The Chromium Authors. All rights reserved.
2 // Use of this source code is governed by a BSD-style license that can be 2 // Use of this source code is governed by a BSD-style license that can be
3 // found in the LICENSE file. 3 // found in the LICENSE file.
4 // 4 //
5 // Low-latency audio rendering unit utilizing audio output stream provided 5 // Low-latency audio rendering unit utilizing audio output stream provided
6 // by browser process through IPC. 6 // by browser process through IPC.
7 // 7 //
8 // Relationship of classes. 8 // Relationship of classes.
9 // 9 //
10 // AudioOutputController AudioDevice 10 // AudioOutputController AudioDevice
11 // ^ ^ 11 // ^ ^
12 // | | 12 // | |
13 // v IPC v 13 // v IPC v
14 // AudioRendererHost <---------> AudioMessageFilter 14 // AudioRendererHost <---------> AudioMessageFilter
15 // 15 //
16 // Transportation of audio samples from the render to the browser process 16 // Transportation of audio samples from the render to the browser process
17 // is done by using shared memory in combination with a sync socket pair 17 // is done by using shared memory in combination with a sync socket pair
18 // to generate a low latency transport. The AudioDevice user registers an 18 // to generate a low latency transport. The AudioDevice user registers an
19 // AudioDevice::RenderCallback at construction and will be polled by the 19 // AudioDevice::RenderCallback at construction and will be polled by the
20 // AudioDevice for audio to be played out by the underlying audio layers. 20 // AudioDevice for audio to be played out by the underlying audio layers.
21 // 21 //
22 // State sequences. 22 // State sequences.
23 // 23 //
24 // Task [IO thread] IPC [IO thread] 24 // Task [IO thread] IPC [IO thread]
25 // 25 //
26 // Start -> InitializeOnIOThread ------> AudioHostMsg_CreateStream --------> 26 // Start -> InitializeOnIOThread ------> AudioHostMsg_CreateStream -------->
27 // <- OnLowLatencyCreated <- AudioMsg_NotifyLowLatencyStreamCreated <- 27 // <- OnLowLatencyCreated <- AudioMsg_NotifyLowLatencyStreamCreated <-
28 // ---> StartOnIOThread -----------> AudioHostMsg_PlayStream --------> 28 // ---> PlayOnIOThread -----------> AudioHostMsg_PlayStream -------->
29 //
30 // Optionally Play() / Pause() sequences may occur:
31 // Play -> PlayOnIOThread --------------> AudioHostMsg_PlayStream --------->
32 // Pause -> PauseOnIOThread ------------> AudioHostMsg_PauseStream -------->
33 // (note that Play() / Pause() sequences before OnLowLatencyCreated are
34 // deferred until OnLowLatencyCreated, with the last valid state being used)
29 // 35 //
30 // AudioDevice::Render => audio transport on audio thread with low latency => 36 // AudioDevice::Render => audio transport on audio thread with low latency =>
31 // | 37 // |
32 // Stop --> ShutDownOnIOThread --------> AudioHostMsg_CloseStream -> Close 38 // Stop --> ShutDownOnIOThread --------> AudioHostMsg_CloseStream -> Close
33 // 39 //
34 // This class utilizes three threads during its lifetime, namely: 40 // This class utilizes several threads during its lifetime, namely:
35 // 1. Creating thread. 41 // 1. Creating thread.
36 // Must be the main render thread. Start and Stop should be called on 42 // Must be the main render thread.
37 // this thread. 43 // 2. Control thread (may be the main render thread or another thread).
38 // 2. IO thread. 44 // The methods: Start(), Stop(), Play(), Pause(), SetVolume()
45 // must be called on the same thread.
46 // 3. IO thread (internal implementation detail - not exposed to public API)
39 // The thread within which this class receives all the IPC messages and 47 // The thread within which this class receives all the IPC messages and
40 // IPC communications can only happen in this thread. 48 // IPC communications can only happen in this thread.
41 // 3. Audio transport thread. 49 // 4. Audio transport thread.
42 // Responsible for calling the RenderCallback and feed audio samples to 50 // Responsible for calling the RenderCallback and feeding audio samples to
43 // the audio layer in the browser process using sync sockets and shared 51 // the audio layer in the browser process using sync sockets and shared
44 // memory. 52 // memory.
45 // 53 //
46 // Implementation notes: 54 // Implementation notes:
47 // 55 //
48 // - Start() is asynchronous/non-blocking. 56 // - Start() is asynchronous/non-blocking.
49 // - Stop() is synchronous/blocking. 57 // - Stop() is synchronous/blocking.
58 // - Play() is asynchronous/non-blocking.
59 // - Pause() is asynchronous/non-blocking.
50 // - The user must call Stop() before deleting the class instance. 60 // - The user must call Stop() before deleting the class instance.
51 61
52 #ifndef CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_ 62 #ifndef CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_
53 #define CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_ 63 #define CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_
54 #pragma once 64 #pragma once
55 65
56 #include <vector> 66 #include <vector>
57 67
58 #include "base/basictypes.h" 68 #include "base/basictypes.h"
59 #include "base/memory/scoped_ptr.h" 69 #include "base/memory/scoped_ptr.h"
60 #include "base/shared_memory.h" 70 #include "base/shared_memory.h"
71 #include "base/synchronization/lock.h"
61 #include "base/threading/simple_thread.h" 72 #include "base/threading/simple_thread.h"
62 #include "content/common/content_export.h" 73 #include "content/common/content_export.h"
63 #include "content/renderer/media/audio_message_filter.h" 74 #include "content/renderer/media/audio_message_filter.h"
64 75 #include "media/audio/audio_parameters.h"
65 struct AudioParameters;
66 76
67 class CONTENT_EXPORT AudioDevice 77 class CONTENT_EXPORT AudioDevice
68 : public AudioMessageFilter::Delegate, 78 : public AudioMessageFilter::Delegate,
69 public base::DelegateSimpleThread::Delegate, 79 public base::DelegateSimpleThread::Delegate,
70 public base::RefCountedThreadSafe<AudioDevice> { 80 public base::RefCountedThreadSafe<AudioDevice> {
71 public: 81 public:
72 class RenderCallback { 82 class RenderCallback {
73 public: 83 public:
74 virtual void Render(const std::vector<float*>& audio_data, 84 virtual void Render(const std::vector<float*>& audio_data,
75 size_t number_of_frames, 85 size_t number_of_frames,
76 size_t audio_delay_milliseconds) = 0; 86 size_t audio_delay_milliseconds) = 0;
77 protected: 87 protected:
78 virtual ~RenderCallback() {} 88 virtual ~RenderCallback() {}
79 }; 89 };
80 90
81 // Methods called on main render thread ------------------------------------- 91 // Methods called on main render thread -------------------------------------
92
93 // Minimal constructor where Initialize() must be called later.
94 AudioDevice();
95
82 AudioDevice(size_t buffer_size, 96 AudioDevice(size_t buffer_size,
83 int channels, 97 int channels,
84 double sample_rate, 98 double sample_rate,
85 RenderCallback* callback); 99 RenderCallback* callback);
86 virtual ~AudioDevice(); 100 virtual ~AudioDevice();
87 101
102 void Initialize(size_t buffer_size,
103 int channels,
104 double sample_rate,
105 AudioParameters::Format latency_format,
106 RenderCallback* callback);
107 bool IsInitialized();
108
88 // Starts audio playback. 109 // Starts audio playback.
89 void Start(); 110 void Start();
90 111
91 // Stops audio playback. 112 // Stops audio playback.
92 void Stop(); 113 void Stop();
93 114
115 // Resumes playback if currently paused.
116 // TODO(crogers): it should be possible to remove the extra complexity
117 // of Play() and Pause() with additional re-factoring work in
118 // AudioRendererImpl.
119 void Play();
120
121 // Pauses playback.
122 // If |flush| is true then any pending audio that is in the pipeline
123 // (has not yet reached the hardware) will be discarded. In this case,
124 // when Play() is later called, no previous pending audio will be
125 // rendered.
126 void Pause(bool flush);
127
94 // Sets the playback volume, with range [0.0, 1.0] inclusive. 128 // Sets the playback volume, with range [0.0, 1.0] inclusive.
95 // Returns |true| on success. 129 // Returns |true| on success.
96 bool SetVolume(double volume); 130 bool SetVolume(double volume);
97 131
98 // Gets the playback volume, with range [0.0, 1.0] inclusive. 132 // Gets the playback volume, with range [0.0, 1.0] inclusive.
99 void GetVolume(double* volume); 133 void GetVolume(double* volume);
100 134
101 double sample_rate() const { return sample_rate_; } 135 double sample_rate() const { return sample_rate_; }
102 size_t buffer_size() const { return buffer_size_; } 136 size_t buffer_size() const { return buffer_size_; }
103 137
104 // Methods called on IO thread ---------------------------------------------- 138 // Methods called on IO thread ----------------------------------------------
105 // AudioMessageFilter::Delegate methods, called by AudioMessageFilter. 139 // AudioMessageFilter::Delegate methods, called by AudioMessageFilter.
106 virtual void OnRequestPacket(AudioBuffersState buffers_state) OVERRIDE; 140 virtual void OnRequestPacket(AudioBuffersState buffers_state) OVERRIDE;
107 virtual void OnStateChanged(AudioStreamState state) OVERRIDE; 141 virtual void OnStateChanged(AudioStreamState state) OVERRIDE;
108 virtual void OnCreated(base::SharedMemoryHandle handle, 142 virtual void OnCreated(base::SharedMemoryHandle handle,
109 uint32 length) OVERRIDE; 143 uint32 length) OVERRIDE;
110 virtual void OnLowLatencyCreated(base::SharedMemoryHandle handle, 144 virtual void OnLowLatencyCreated(base::SharedMemoryHandle handle,
111 base::SyncSocket::Handle socket_handle, 145 base::SyncSocket::Handle socket_handle,
112 uint32 length) OVERRIDE; 146 uint32 length) OVERRIDE;
113 virtual void OnVolume(double volume) OVERRIDE; 147 virtual void OnVolume(double volume) OVERRIDE;
114 148
115 private: 149 private:
116 // Methods called on IO thread ---------------------------------------------- 150 // Methods called on IO thread ----------------------------------------------
117 // The following methods are tasks posted on the IO thread that needs to 151 // The following methods are tasks posted on the IO thread that needs to
118 // be executed on that thread. They interact with AudioMessageFilter and 152 // be executed on that thread. They interact with AudioMessageFilter and
119 // sends IPC messages on that thread. 153 // sends IPC messages on that thread.
120 void InitializeOnIOThread(const AudioParameters& params); 154 void InitializeOnIOThread(const AudioParameters& params);
121 void StartOnIOThread(); 155 void PlayOnIOThread();
156 void PauseOnIOThread(bool flush);
122 void ShutDownOnIOThread(base::WaitableEvent* completion); 157 void ShutDownOnIOThread(base::WaitableEvent* completion);
123 void SetVolumeOnIOThread(double volume); 158 void SetVolumeOnIOThread(double volume);
124 159
125 void Send(IPC::Message* message); 160 void Send(IPC::Message* message);
126 161
127 // Method called on the audio thread (+ one call on the IO thread) ---------- 162 // Method called on the audio thread (+ one call on the IO thread) ----------
128 // Calls the client's callback for rendering audio. There will also be one 163 // Calls the client's callback for rendering audio. There will also be one
129 // initial call on the IO thread before the audio thread has been created. 164 // initial call on the IO thread before the audio thread has been created.
130 void FireRenderCallback(int16* data); 165 void FireRenderCallback(int16* data);
131 166
132 // DelegateSimpleThread::Delegate implementation. 167 // DelegateSimpleThread::Delegate implementation.
133 virtual void Run() OVERRIDE; 168 virtual void Run() OVERRIDE;
134 169
170 // Closes socket and joins with the audio thread.
171 void ShutDownAudioThread();
172
135 // Format 173 // Format
136 size_t buffer_size_; // in sample-frames 174 size_t buffer_size_; // in sample-frames
137 int channels_; 175 int channels_;
138 int bits_per_sample_; 176 int bits_per_sample_;
139 double sample_rate_; 177 double sample_rate_;
178 AudioParameters::Format latency_format_;
140 179
141 RenderCallback* callback_; 180 RenderCallback* callback_;
142 181
143 // The client callback renders audio into here. 182 // The client callback renders audio into here.
144 std::vector<float*> audio_data_; 183 std::vector<float*> audio_data_;
145 184
185 // Set to |true| once Initialize() has been called.
186 bool is_initialized_;
187
146 // The client stores the last reported audio delay in this member. 188 // The client stores the last reported audio delay in this member.
147 // The delay shall reflect the amount of audio which still resides in 189 // The delay shall reflect the amount of audio which still resides in
148 // the output buffer, i.e., the expected audio output delay. 190 // the output buffer, i.e., the expected audio output delay.
149 int audio_delay_milliseconds_; 191 int audio_delay_milliseconds_;
150 192
151 // The current volume scaling [0.0, 1.0] of the audio stream. 193 // The current volume scaling [0.0, 1.0] of the audio stream.
152 double volume_; 194 double volume_;
153 195
154 // Callbacks for rendering audio occur on this thread. 196 // Callbacks for rendering audio occur on this thread.
155 scoped_ptr<base::DelegateSimpleThread> audio_thread_; 197 scoped_ptr<base::DelegateSimpleThread> audio_thread_;
156 198
157 // Cached audio message filter (lives on the main render thread). 199 // Cached audio message filter (lives on the main render thread).
158 scoped_refptr<AudioMessageFilter> filter_; 200 scoped_refptr<AudioMessageFilter> filter_;
159 201
160 // Our stream ID on the message filter. Only accessed on the IO thread. 202 // Our stream ID on the message filter. Only accessed on the IO thread.
161 int32 stream_id_; 203 int32 stream_id_;
162 204
205 // State of Play() / Pause() calls before OnLowLatencyCreated() is called.
206 bool play_on_start_;
207
208 // Set to |true| when OnLowLatencyCreated() is called.
209 // Set to |false| when ShutDownOnIOThread() is called.
210 // This is for use with play_on_start_ to track Play() / Pause() state.
211 bool is_started_;
212
163 // Data transfer between browser and render process uses a combination 213 // Data transfer between browser and render process uses a combination
164 // of sync sockets and shared memory to provide lowest possible latency. 214 // of sync sockets and shared memory to provide lowest possible latency.
165 base::SharedMemoryHandle shared_memory_handle_; 215 base::SharedMemoryHandle shared_memory_handle_;
166 base::SyncSocket::Handle socket_handle_; 216 base::SyncSocket::Handle socket_handle_;
167 int memory_length_; 217 int memory_length_;
168 218
169 DISALLOW_IMPLICIT_CONSTRUCTORS(AudioDevice); 219 // Protects lifetime of:
220 // socket_handle_
221 // audio_thread_
222 base::Lock lock_;
223
224 DISALLOW_COPY_AND_ASSIGN(AudioDevice);
170 }; 225 };
171 226
172 #endif // CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_ 227 #endif // CONTENT_RENDERER_MEDIA_AUDIO_DEVICE_H_
OLDNEW
« no previous file with comments | « no previous file | content/renderer/media/audio_device.cc » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698