Dolby Laboratories Licensing Corporation

Dolby International Ab

Dublin International Ab

Dirk Jeroen Breebaart

Lars Villemoes

Heiko Purnhagen

Kristofer Kjoerling

Alan Jeffrey Seefeldt

Ming Wang

Nicolas R Tsingos

Lie Lu

David Matthew Cooper

Leif Jonas Samuelsson

Rhonda J Wilson

C Phillip Brown

Grant Allen Davidson

Antonio Mateos Sole

Jeroen Koppens

Kuan-Chieh Yen

Joshua Brandon Lando

Giulio Cengarle

Brett Graham Crockett

Mark Franklin Davis

Harald Mundt

Sripal S Mehta

Zhiwei Shuang

Toni Hirvonen

Alexander Stahlmann

Freddie Sanchez

Lianwu Chen

Mingqing Hu

Chunjian Li

Dossym Nurmukhanov

Poppy Anne Carrie Crum

Nicholas Luke Appleton

Mark William Gerrard

Mark David De Burgh

Ziyu Yang

Alex Brandmeyer

McGregor Steele Joyner

Andrea Fanelli

David Mcgrath

Brian George Arnott

Mark Alexander

David S Mcgrath

Jeremy Grant Stoddard

Antonio Mateos Solé

David M Cooper

Leif J Samuelsson

Rhonda Joy Wilson

Phillip C Brown

Samuelsson Leif Jonas

Mark F Davis

Described herein is a method () of rendering an audio signal () for playback in an audio environment () defined by a target loudspeaker system (), the audio signal () including audio data relating to an audio object and associated position data indicative of an object position. Method () includes the initial step () of receiving the audio signal (). At step () loudspeaker layout data for the target loudspeaker system () is received. At step () control data is received that is indicative of a position modification to be applied to the audio object in the audio environment (). At step () in response to the position data, loudspeaker layout data and control data, rendering modification data is generated. Finally, at step () the audio signal () is rendered with the rendering modification data to output the audio signal () with the audio object at a modified object position that is between loudspeakers within the audio environment ().

Spatial audio signal manipulation

A method of audio processing includes performing spatial analysis on a binaural signal to estimate level differences and phase differences characteristic of a binaural filter of the binaural signal, performing object extraction on the binaural audio signal using the estimated level and phase differences to generate a left/right main component signal and a left/right residual component signal. The system may process the left/right main and left/right residual components differently using different object processing parameters for e.g. repositioning, equalization, compression, upmixing, channel remapping or storage to generate a processed binaural signal that provides an improved listening experience. Repositioning may be based on head tracking sensor data.

Binaural signal post-processing

A method for representing a second presentation of audio channels or objects as a data stream, the method comprising the steps of: (a) providing a set of base signals, the base signals representing a first presentation of the audio channels or objects; (b) providing a set of transformation parameters, the transformation parameters intended to transform the first presentation into the second presentation; the transformation parameters further being specified for at least two frequency bands and including a set of multi-tap convolution matrix parameters for at least one of the frequency bands.

Audio decoder and decoding method

Methods and systems for designing binaural room impulse responses (BRIRs) for use in headphone virtualizers, and methods and systems for generating a binaural signal in response to a set of channels of a multi-channel audio signal, including by applying a BRIR to each channel of the set, thereby generating filtered signals, and combining the filtered signals to generate the binaural signal, where each BRIR has been designed in accordance with an embodiment of the design method. Other aspects are audio processing units configured to perform any embodiment of the inventive method. In accordance with some embodiments, BRIR design is formulated as a numerical optimization problem based on a simulation model (which generates candidate BRIRs) and at least one objective function (which evaluates each candidate BRIR), and includes identification of a best one of the candidate BRIRs as indicated by performance metrics determined for the candidate BRIRs by each objective function.

Methods and systems for designing and applying numerically optimized binaural room impulse responses

Methods for dialogue enhancing audio content, comprising providing a first audio signal presentation of the audio components, providing a second audio signal presentation, receiving a set of dialogue estimation parameters configured to enable estimation of dialogue components from the first audio signal presentation, applying said set of dialogue estimation parameters to said first audio signal presentation, to form a dialogue presentation of the dialogue components; and combining the dialogue presentation with said second audio signal presentation to form a dialogue enhanced audio signal presentation for reproduction on the second audio reproduction system, wherein at least one of said first and second audio signal presentation is a binaural audio signal presentation.

Binaural dialogue enhancement

A system and method of modifying a binaural signal using headtracking information. The system calculates a delay, a first filter response, and a second filter response, and applies these to the left and right components of the binaural signal according to the headtracking information. The system may also apply headtracking to parametric binaural signals. In this manner, headtracking may be applied to pre-rendered binaural audio.

Headtracking for pre-rendered binaural audio

Diffuse or spatially large audio objects may be identified for special processing. A decorrelation process may be performed on audio signals corresponding to the large audio objects to produce decorrelated large audio object audio signals. These decorrelated large audio object audio signals may be associated with object locations, which may be stationary or time-varying locations. For example, the decorrelated large audio object audio signals may be rendered to virtual or actual speaker locations. The output of such a rendering process may be input to a scene simplification process. The decorrelation, associating and/or scene simplification processes may be performed prior to a process of encoding the audio data.

Method, apparatus or systems for processing audio objects

Encoding/decoding techniques where multiple transform parameter sets are encoded together with a rendered playback presentation of an input audio content. The multiple transform parameters are used on the decoder side to transform the playback presentation to provide a personalized binaural playback presentation optimized for an individual listener with respect to their hearing profile. This may be achieved by selection or combination of the data present in the metadata streams.

Audio encoding/decoding with transform parameters

Systems and methods for preserving headphone rendering mode (HRM) in object clustering are described. In an embodiment, an object-based audio data processing system includes a processor configured to receive a plurality of audio objects, wherein an audio object of the plurality of audio objects is associated with respective object metadata that indicates respective spatial position information and an HRM; determine a plurality of cluster positions by applying an extended hybrid distance metric to a spatial coding algorithm to calculate a partial loudness for each of the audio objects; render the audio objects to the cluster positions to form a plurality of clusters by applying the extended hybrid distance metric to the spatial coding algorithm to calculate object-to-cluster gains; and transmit the clusters to a spatial reproduction system.

Headphone rendering metadata-preserving spatial coding

Media input audio data corresponding to a media stream and microphone input audio data from at least one microphone may be received. A first level of at least one of a plurality of frequency bands of the media input audio data, as well as a second level of at least one of a plurality of frequency bands of the microphone input audio data, may be determined. Media output audio data and microphone output audio data may be produced by adjusting levels of one or more of the first and second plurality of frequency bands based on the perceived loudness of the microphone input audio data, of the microphone output audio data, of the media output audio data and the media input audio data. One or more processes may be modified upon receipt of a mode-switching indication.

Media-compensated pass-through and mode-switching

A method for encoding an input audio stream including the steps of obtaining a first playback stream presentation of the input audio stream intended for reproduction on a first audio reproduction system, obtaining a second playback stream presentation of the input audio stream intended for reproduction on a second audio reproduction system, determining a set of transform parameters suitable for transforming an intermediate playback stream presentation to an approximation of the second playback stream presentation, wherein the transform parameters are determined by minimization of a measure of a difference between the approximation of the second playback stream presentation and the second playback stream presentation, and encoding the first playback stream presentation and the set of transform parameters for transmission to a decoder.

Audio encoding and decoding using presentation transform parameters

Encoding/decoding an audio signal having one or more audio components, wherein each audio component is associated with a spatial location. A first audio signal presentation (z) of the audio components, a first set of transform parameters (w(f)), and signal level data (β) are encoded and transmitted to the decoder. The decoder uses the first set of transform parameters (w(f)) to form a reconstructed simulation input signal intended for an acoustic environment simulation, and applies a signal level modification (α) to the reconstructed simulation input signal. The signal level modification is based on the signal level data (β) and data (p) related to the acoustic environment simulation. The attenuated reconstructed simulation input signal is then processed in an acoustic environment simulator. With this process, the decoder does not need to determine the signal level of the simulation input signal, thereby reducing processing load.

Acoustic environment simulation

In some embodiments, virtualization methods for generating a binaural signal in response to channels of a multi-channel audio signal, which apply a binaural room impulse response (BRIR) to each channel including by using at least one feedback delay network (FDN) to apply a common late reverberation to a downmix of the channels. In some embodiments, input signal channels are processed in a first processing path to apply to each channel a direct response and early reflection portion of a single-channel BRIR for the channel, and the downmix of the channels is processed in a second processing path including at least one FDN which applies the common late reverberation. Typically, the common late reverberation emulates collective macro attributes of late reverberation portions of at least some of the single-channel BRIRs. Other aspects are headphone virtualizers configured to perform any embodiment of the method.

Generating binaural audio in response to multi-channel audio using at least one feedback delay network

A method for generating mastered audio content, the method comprising obtaining an input audio content comprising a number, M, of audio signals, obtaining rendered presentation of the input audio content, the rendered presentation comprising a number, M, of audio signals, obtaining a mastered presentation generated by mastering the rendered presentation, comparing the mastered presentation with the rendered presentation to determine one or more indications of differences between the mastered presentation and the rendered presentation, modifying one or more of the audio signals of the input audio content based on the indications of differences to generate the mastered audio content. With this approach, conventional, typically stereo, channel-based mastering tools can be used to provide a mastered version of any input audio content, including object-based immersive audio content.

Presentation independent mastering of audio content

Growing community of inventors

Ultimo, Australia

Dirk Jeroen Breebaart