Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Sebastià Vicenç Amengual Garí

William Owen Brimijoin, Ii

Henrik Gert Hassager

Philip Robinson

Paul Thomas Calamia

Orchisama Das

Jens Ahrens

Hannes Helmholz

David Lou Alon

A system can include a position sensor configured to output position data of a HWD. The system can include one or more processors configured to identify a first head angle of the HWD using the position sensor, generate an audio signal using the first head angle, identify a second head angle of the HWD using the position sensor, determine an angle error based at least on the first head angle and the second head angle, and apply at least one of a time difference or a level difference to the audio signal based at least on the angle error to adjust the audio signal. The system can include an audio output device configured to output the adjusted audio signal. By adjusting the audio signal using the angle error, the system can correct for long spatial update latencies and reduce the perceptual impact of such latencies for the user.

Systems and methods for spatial update latency compensation for head-tracked audio

A system for dynamically updating a head-related transfer function (HRTF) model that is customized to a user. The system receives one or more images of the user captured by one or more imaging devices. The system determines a pose of the user using the one or more captured images. The pose of the user includes a head-torso orientation of the user. The system updates a HRTF model for the user based on the determined pose including the head-torso orientation. The system generates one or more sound filters using the updated HRTF model and applies the one or more sound filters to audio content to generate spatialized audio content. The system provides the spatialized audio content to the user.

Dynamic customization of head related transfer functions for presentation of audio content

A plurality of modal parameters is estimated for a set of discrete locations within a local area using a set of room impulse responses for the set of discrete locations. The local area includes an audio system. A plurality of acoustic model parameters is generated by fitting the plurality of modal parameters to an acoustic model that accounts for a physical geometry of the local area. The plurality of acoustic model parameters and an indication about the acoustic model are stored for later use by the audio system. The audio system estimates the set of acoustic parameters using the plurality of acoustic model parameters and the indication about the acoustic model, and presents audio content using the set of acoustic parameters.

Estimation of acoustic parameters for audio system based on stored information about acoustic model

An audio system includes an equatorial acoustic sensor array (EASA) that may be coupled to an object. The audio system is configured to detect, via the EASA, signals corresponding to a portion of a sound field in a local area. The detected signals are converted into a plurality of corresponding abstract representations that describe the portion of the sound field. Effects of scattering of the object are removed from the abstract representations to create adjusted abstract representations. A set of spherical harmonic (SH) coefficients is determined using the adjusted abstract representations. The set of SH coefficients describe an entirety of the sound field. And the set of SH coefficients and head related transfer functions of a user are used for binaural rendering of the reconstructed sound field to the user.

Spherical harmonic decomposition of a sound field detected by an equatorial acoustic sensor array

An audio analysis system receives a first recording of a speech signal from an origin audio assembly and a second recording of at least a portion of the speech signal from a receiving audio assembly. The speech signal originates from a speaking user of the origin audio assembly and the second recording is recorded by a receiving audio assembly operated by a different user. Both the origin audio assembly and the receiving audio assembly are located within a room. The audio analysis system selects one or more audio frames in the first recording and one or more audio frames in the second recording that both occur over the same time period. The audio analysis system determines a transfer function for the room based in part on the selected one or more audio frames in the first recording and the selected one or more audio frames in the second recording.

Growing community of inventors

Seattle, WA, United States of America

Sebastià Vicenç Amengual Garí