Dts, Inc.

Creative Technology Corporation

Edward Stein

Martin Walsh

Michael M Goodwin

Jean-Marc Jot

Guangji Shi

David Corsello

Zesen Zhuang

Suketu Kamdar

Michael C Kelly

Prashant Velagaleti

Juha Merimaa

Richard J Beaton

Brian Slack

Keun Sup Lee

Aoife Mcdonagh

Robert Demaa

Peter Corcoran

David Cortes Provencio

A method comprises: obtaining a mixed soundtrack that includes dialogue mixed with non-dialogue sound; converting the mixed soundtrack to comparison text; obtaining reference text for the dialogue as a reference for intelligibility of the dialogue; determining a measure of intelligibility of the dialogue of the mixed soundtrack to a listener based on a comparison of the comparison text against the reference text; and reporting the measure of intelligibility of the dialogue.

Method and apparatus for dialogue understandability assessment

A method comprises: receiving an image of a real-world environment; using a machine learning classifier, classifying the image to produce classifications associated with acoustic presets for an acoustic environment simulation, the acoustic presets each including acoustic parameters that represent sound reverberation; and selecting an acoustic preset among the acoustic presets based on the classifications.

Room acoustics simulation using deep learning image analysis

Spatial audio signals can include audio objects that can be respectively encoded and rendered at each of multiple different depths. In an example, a method for encoding a spatial audio signal can include receiving audio scene information from an audio capture source in an environment, and receiving a depth characteristic of a first object in the environment. The depth characteristic can be determined using information from a depth sensor. A correlation can be identified between at least a portion of the audio scene information and the first object. The spatial audio signal can be encoded using the portion of the audio scene and the depth characteristic of the first object.

Spatial audio capture and analysis with depth

Systems and methods discussed herein can change a frame of reference for a first spatial audio signal. The first spatial audio signal can include signal components representing audio information from different depths or directions relative to an audio capture location associated with an audio capture source device with a first frame of reference relative to an environment Changing the frame of reference can include receiving a component of the first spatial audio signal, receiving information about a second frame of reference relative to the same environment, determining a difference between the first and second frames of reference, and, using the determined difference between the first and second frames of reference, determining a first filter to use to generate at least one component of a second spatial audio signal that is based on the first spatial audio signal and is referenced to the second frame of reference.

Non-coincident audio-visual capture system

Embodiments of systems and methods are described for estimating a position of a loudspeaker and notifying a listener if an abnormal condition is detected, such as an incorrect loudspeaker orientation or an obstruction in a path between the loudspeaker and a microphone array. For example, a front component of a multi-channel surround sound system may include the microphone array and a position estimation engine. The position estimation engine may estimate the distance between the loudspeaker and the microphone array. In addition, the position estimation engine may estimate an angle of the loudspeaker using a first technique. The position estimation engine may also estimate an angle of the loudspeaker using a second technique. The two angles can be processed to determine whether the abnormal condition exists. If the abnormal condition exists, a listener can be notified and be provided with suggestions for resolving the issue in a graphical user interface.

System and method for loudspeaker position estimation

A method to decode audio signals is provided that includes: receiving an input spatial audio signal; determining directions of arrival of directional audio sources represented in the received input spatial audio signal; determining one of an active input spatial audio signal component and a passive spatial audio signal input component, based upon the determined directions of arrival; determining the other of the active input spatial audio signal component and the passive input spatial audio signal component based upon the determined one of the active input spatial audio signal component and the passive input spatial audio signal component; decoding the active input spatial audio signal component to a first output format; and decoding the passive input spatial audio signal component to a second output format.

Spatial audio signal decoder

Embodiments of systems and methods are described for reducing undesired leakage energy produced by a non-front-facing speaker in a multi-speaker system. For example, the multi-speaker system can include an array of forward-facing speakers, one or more upward-facing speakers, and/or one or more side-facing speakers. Filters coupled to any two of the speakers in the multi-speaker system can generate audio signals output by the coupled speakers to reduce, attenuate, or cancel a portion of an audio signal output by one or more non-front-facing speakers that acoustically propagates along a direct path from the respective non-front-facing speaker to a listening position in a listening area in front of the multi-speaker system.

Multi-speaker method and apparatus for leakage cancellation

A graphical user interface (GUI) can specify a three-dimensional position. The GUI can include a puck that is user-positionable in two dimensions. A distance between the puck and a reference point on the graphical user interface can determine a radius of the three-dimensional position. An azimuthal orientation of the puck with respect to the reference point can determine an azimuthal angle of the three-dimensional position. The GUI can include an elevation controller, separate from the puck, to specify an elevation of the three-dimensional position. The elevation controller can specify an elevation angle, which can determine a position along the surface of a virtual sphere as a function of elevation angle. In addition, or alternatively, the elevation controller can specify an elevation height, which can determine a position along a line, such as directly upward or downward, as a function of elevation height.

Graphical user interface for specifying 3D position

The present subject matter provides technical solutions to technical problems facing audio virtualization. To reduce the technical complexity and computational intensity facing audio virtualization, a technical solution includes rendering audio objects binaurally with differing quality levels, where the quality level for each audio source may be selected based on their position relative to the user's field of view. In an example, this technical solution reduces technical complexity and computational intensity by reducing the audio quality for audio sources outside of a user's central field of vision. In an example, high quality audio rendering may be applied to sound objects within this strong central visual acuity area. These technical solutions reduce processing over higher complexity systems, and provides potential for much higher quality rendering at a reduced technical and computational cost.

Foveated audio rendering

The method and apparatus described herein make use of multiple sets of head related transfer functions (HRTFs) that have been synthesized or measured at various distances from a reference head, spanning from the near-field to the boundary of the far-field. Additional synthetic or measured transfer functions maybe used to extend to the interior of the head, i.e., for distances closer than near-field. In addition, the relative distance-related gains of each set of HRTFs are normalized to the far-field HRTF gains.

Near-field binaural rendering

A method to decode audio signals is provided that includes: receiving an input spatial audio signal; determining directions of arrival of directional audio sources represented in the received input spatial audio signal; determining one of an active input spatial audio signal component and a passive spatial audio signal input component, based upon the determined directions of arrival; determining the other of the active input spatial audio signal component and the passive input spatial audio signal component, based upon the determined one of the active input spatial audio signal component and the passive input spatial audio signal component; decoding the active input spatial audio signal component to a first output format; and decoding the passive input spatial audio signal component to a second output format.

The systems and methods described herein can be configured to identify, manipulate, and render different audio source components from encoded 3D audio mixes, such as can include content mixed for azimuth, elevation, and/or depth relative to a listener. The systems and methods can be configured to decouple depth encoding and decoding to permit spatial performance to be tailored to a particular playback environment or platform. In an example, the systems and methods improve rendering in applications that involve listener tracking, including tracking over six degrees of freedom (e.g., yaw, pitch, roll orientation, and x, y, z position).

Growing community of inventors

Aptos, CA, United States of America

Edward Stein