Facebook Technologies, LLC

Meta Platforms Technologies, LLC

William Owen Brimijoin, Ii

Philip Robinson

Andrew Lovitt

Henrik Gert Hassager

Vamsi Krishna Ithapu

Peter Harty Dodds

Nils Thomas Fritiof Lunner

Ravish Mehra

Nava K Balsam

Sebastià Vicenç Amengual Garí

Michaela Warnecke

Tomasz Rudzki

Antonio John Miller

Morteza Khaleghimeybodi

Scott Phillips Porter

Cesare Valerio Parise

Samuel Clapp

Ryan Rohrer

Kevin Scheumann

Carl Schissler

Sebastià Vicenç Amengual Gari

Sebastiá Vicenç Amengual Gari

Sebastià Vicenç Amegnual Gari

Andrew Francl

Scott Colburn

A system for presenting audio content to a user. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound from a local area. The system further comprises an audio controller integrated into the headset and communicatively coupled to an in-ear device worn by a user. The audio controller identifies one or more sound sources in the local area based on the captured sound. The audio controller further determines a target sound source of the one or more sound sources and determines one or more filters to apply to a sound signal associated with the target sound source in the captured sound. The audio controller further generates an augmented sound signal by applying the one or more filters to the sound signal and provides the augmented sound signal to the in-ear device for presentation to a user.

Audio system for suppressing leakage signal from in-ear device

A system is disclosed for using an audio time and level difference renderer (TLDR) to generate spatialized audio content for multiple channels from an audio signal received at a single channel. The system selects an audio TLDR from a set of audio TLDRs based on received input parameters. The system configures the selected audio TLDR based on received input parameters using a filter parameter model to generate a configured audio TLDR that comprises a set of configured binaural dynamic filters, and a configured delay between the multiple channel. The system applies the configured audio TLDR to an audio signal received at the single channel to generate spatialized multiple channel audio content for each channel of the multiple audio channel and presents the generated spatialized audio content at multiple channels to a user via a headset.

Dynamic time and level difference rendering for audio spatialization

A system can include a position sensor configured to output position data of a HWD. The system can include one or more processors configured to identify a first head angle of the HWD using the position sensor, generate an audio signal using the first head angle, identify a second head angle of the HWD using the position sensor, determine an angle error based at least on the first head angle and the second head angle, and apply at least one of a time difference or a level difference to the audio signal based at least on the angle error to adjust the audio signal. The system can include an audio output device configured to output the adjusted audio signal. By adjusting the audio signal using the angle error, the system can correct for long spatial update latencies and reduce the perceptual impact of such latencies for the user.

Systems and methods for spatial update latency compensation for head-tracked audio

Audio system using individualized sound profiles

Embodiments relate to personalization of a head-related transfer function (HRTF) for a given user. A sound source is spatialized for an initial position using an initial version of a HRTF to obtain an initial spatialized sound source. Upon presentation of the initial spatialized sound source, at least one property of the HRTF is adjusted in an iterative manner based on at least one perceptive response from the user to generate a version of the HRTF customized for the user. Each perceptive response from the user indicates a respective offset between a perceived position and a target position of the sound source. The customized version of the HRTF is applied to one or more audio channels to form spatialized audio content for the perceived position. The spatialized audio content is presented to the user, wherein the offset between the perceived position and the target position is reduced.

Personalization of head-related transfer function

A system includes a headset to capture sound and a visual signal of a local area including one or more sound sources. The system determines a strength of the audio signal and a portion of the visual signal associated with the audio signal, compares the strengths, selects the weaker signal, and augments the weaker signal. The headset accordingly presents augmented audio-visual content to a user, thereby enhancing the user's perception of the weak signal.

Audio visual correspondence based signal augmentation

A method comprising determining a set of position parameters for an inertial measurement unit (IMU) on a headset worn by a user. The set of position parameters includes at least a first yaw measurement and a first roll measurement. The set describes a pointing vector. The method further comprises calculating a drift correction component that describes a rate of correction. The drift correction component is based at least in part on the set of position parameters. The method further comprises applying the drift correction component to one or more subsequent yaw measurements for the IMU. The drift correction component forces an estimated nominal position vector to the pointing vector at the rate of correction.

Biologically-constrained drift correction of an inertial measurement unit

A system receives audio data in a frequency range of 20 Hz-20 kHz. The received audio data is encoded by the system into ultrasonic data in frequencies that are greater than 20 kHz, and transmitted into a local area that is proximal to the transmitting device, i.e., within the transmission range of the transmitting device. An ultrasonic communication device that is located in the transmission range of the transmitting device may receive the ultrasonic data. The received ultrasonic data is decoded by the ultrasonic communication system in the receiving device into audio data in a frequency range of 20 Hz-20 kHz, and subsequently presented to a user of the receiving ultrasonic communication device.

Local auditory display using ultrasonic encoding and decoding

A system creates an audio profile. The audio profile may be stored in a database. For example, the audio profile may be securely stored in a database of a social network and associated with a user account. The audio profile may contain data describing the way in which the specific user hears and interprets sounds. Systems and applications which present sounds to the user may access the audio profile and modify the sounds presented to the user based on the data in the audio profile to enhance the audio experience for the user.

Audio profile for personalized audio enhancement

An audio system generates customized head-related transfer functions (HRTFs) for a user. The audio system receives an initial set of estimated HRTFs. The initial set of HRTFs may have been estimated using a trained machine learning and computer vision system and pictures of the user's ears. The audio system generates a set of test locations using the initial set of HRTFs. The audio system presents test sounds at each of the initial set of test locations using the initial set of HRTFs. The audio system monitors user responses to the test sounds. The audio system uses the monitored responses to generate a new set of estimated HRTFs and a new set of test locations. The process repeats until a threshold accuracy is achieved or until a set period of time expires. The audio system presents audio content to the user using the customized HRTFs.

Selecting spatial locations for audio personalization

A system that uses persistent sound source selection to augment audio content. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound emitted by sound sources in a local area. The system further comprises an audio controller integrated into the headset. The audio controller receives sound signals corresponding to sounds emitted by sound sources in the local area. The audio controller further updates a ranking of the sound sources based on eye tracking information of the user. The audio controller further selectively applies one or more filters to the one or more of the sound signals according to the ranking to generate augmented audio data. The audio controller further provides the augmented audio data to a speaker assembly for presentation to the user.

Growing community of inventors

Kirkland, WA, United States of America

William Owen Brimijoin, Ii