Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Facebook, Inc.

Pablo Francisco Faundez Hoffmann

Morteza Khaleghimeybodi

Antonio John Miller

Chuming Zhao

Sang-Ik Cho

ChuanKeat Kho

Tetsuro Oishi

David Brokenshire

Karol Constantine Hatzilias

Francesco Nesta

Jacob Ryan Donley

Gregory Olegovic Andreev

Vamsi Krishna Ithapu

Peter Harty Dodds

Gongqiang Yu

Alan Ng

Anjali Induchoodan Menon

Majid Mirbagheri

An audio system controls feedback when beamforming an output for production by transducers by generating a beamforming output signal based on audio from a first set and a second set of acoustic sensors. The first set may include acoustic sensors that may experience feedback from the transducers. The second set may exclude the acoustic sensors that cause feedback. The beamforming output from each set are combined as a weighted combination based on a beamforming coefficient that may be dynamically set to increase contribution of the first set until the combined output causes feedback, enabling the total beamforming output to benefit from a larger set of acoustic sensors while avoiding detrimental feedback. The interaural characteristics of the external environment may also be analyzed and the beamforming output modified to increase a difference in the interaural characteristic and thereby increase perception of the beamforming output.

Acoustic-feedback-informed far-field beamforming

Embodiments relate to an audio system that performs equalization of audio signals based on one or more diffuse field head-related transfer functions (HRTFs) and device-specific data. User-specific data and device-specific data (i.e., transducer-specific data) are applied to an acoustic model to predict an acoustic response for a user. An equalization filter is then determined using the acoustic response and the one or more diffuse field HRTFs. The equalization filter is applied to a processed version of an audio signal to create a modified version of the audio signal. The modified version of the audio signal is presented to the user via a transducer array of the audio system. The audio system can further include a microphone assembly that reduces the Helmholtz resonance effect.

Microphone assembly with tapered port

An audio system for spatializing virtual sound sources is described. A microphone array of the audio system is configured to monitor sound in a local area. A controller of the audio system identifies sound sources within the local area using the monitored sound from the microphone array and determines their locations. The controller of the audio system generates a target position for a virtual sound source based on one or more constraints. The one or more constraints include that the target position be at least a threshold distance away from each of the determined locations of the identified sound sources. The controller generates one or more sound filters based in part on the target position to spatialize the virtual sound source. A transducer array of the audio system presents spatialized audio including the virtual sound source content based in part on the one or more sound filters.

Audio system for spatializing virtual sound sources

Equalization based on diffuse field representation of head-related transfer function and transducer-specific data

An in-ear device occludes an ear canal of an ear of a user. The in-ear device is configured to be calibrated such that the user perceives audio content as though the in-ear device is not occluding the ear canal. A transducer of the in-ear device presents audio content, and an inner microphone of the in-ear device detects sound pressure data within the ear canal. A controller of the in-ear device determines a blocked sound pressure at the entrance to the ear canal based on sound pressure data from an outer microphone. The controller generates sound filters custom to the user based in part on the detected sound pressure within the ear canal and the blocked sound pressure at the entrance to the ear canal. The controller adjusts audio content using the sound filter, and the transducer presents the adjusted audio content to the user.

Personalized calibration of an in-ear device

The present disclosure relates to systems, methods, and non-transitory computer-readable media that present spatial audio using the speakers of a wearable audio device and speakers external to the wearable audio device. In particular, in one or more embodiments, the disclosed systems generate spatial audio having a high-frequency component and a low-frequency component. The disclosed systems further generate cross-talk cancellation filters for the low-frequency component of the spatial audio. The disclosed systems can provide the high-frequency component for presentation via speakers of the wearable audio device and the low-frequency component for presentation via the external speakers using the cross-talk cancellation filters. In some cases, the disclosed systems generate the spatial audio or the cross-talk cancellation filters using a personalized interaural display model and/or head-related transfer functions.

Generating spatial audio and cross-talk cancellation for high-frequency glasses playback and low-frequency external playback

An audio signal is enhanced using interaural coherence to control noise reduction and binaural cue preservation. Sounds from a local area are detected via an acoustic array. An interaural coherence is determined using the detected sounds. Sound filters for an audio signal are generated based on the interaural coherence. The sound filters implement a tradeoff between increasing signal-to-noise ratio (SNR) between a target source and an interfering source and preserving of binaural information of the interfering source. The tradeoff is controlled based on the interaural coherence. The sound filters are applied to the audio signal to generate audio content. The audio content is presented via a speaker array.

Signal enhancement and noise reduction with binaural cue preservation control based on interaural coherence

A system reduces sound coloration caused by rendering of a 3D audio signal. The system renders the 3D audio signal including a plurality of channels using the input audio signal. Input spectra data defining spectral information of the input audio signal is computed. 3D spectra data defining spectral information of a single channel representation of the 3D audio signal is computed. The system generates a tonal balance filter based on the input spectral data and the 3D spectral data. The tonal balance filter, when applied to the 3D audio signal, reduces sound coloration caused by the rendering of the 3D audio signal. The tonal balance filter is applied to the 3D audio signal to generate an output audio signal and the output audio signal is presented via a speaker array.

Time-varying always-on compensation for tonally balanced 3D-audio rendering

A method for adjusting sound (e.g., aural) output of a worn audio device includes obtaining orientation or position data that indicates an orientation or a position of the worn audio device. The method also includes determining at least one change in the orientation or position data indicating a change in orientation or position of the worn audio device. The method also includes adjusting or selecting a filter for adjusting aural output produced by the worn audio device using the orientation or position data, and operating the worn audio device to provide the sound output using the filter in response to the at least one change in the orientation or position data.

Wearable device with at-ear calibration

An audio system (e.g., of an artificial reality headset) determines a position of the headset relative to a position of a head of a user wearing the headset. The determination is based in part on an image of a portion of the head from a tracking camera (e.g., eye tracking and/or face tracking) on the headset. The audio system adjusts an acoustic parameter based in part on the determined position of the headset. The audio system performs an action that uses the adjusted acoustic parameter.

Adjusting acoustic parameters based on headset position

A headset comprises a frame and an audio system. The audio system includes a microphone assembly positioned on the frame in a detection region, the detection region external to an ear of a user wearing the headset, and within a threshold distance from an ear canal of the ear, the microphone assembly configured to detect an audio signal emitted from an audio source, wherein the audio signal detected at the detection region is within a threshold degree of similarity of a sound pressure wave at the ear canal of the user, and an audio controller configured to determine a set of head-related transfer functions (HRTFs) based in part on the detected audio signal.

Remote inference of sound frequencies for determination of head-related transfer functions for a user of a headset

An ear-plug assembly presents audio content to an ear canal of a user. The audio content may be based in part on sound in a local area surrounding the user. The ear-plug assembly detects, via one or more acoustic sensors, sound in the area around the user. The sound waves travel through an aperture in a body of the ear-plug assembly and are propagated to a waveguide to the one or more acoustic sensors. The ear-plug assembly processes the detected sound data in a controller, which instructs a speaker assembly to present audio content based in part on the detected sound data. The detected sounds may be amplified, attenuated, filtered, and/or augmented when presented by the speaker assembly.

Ear-plug assembly for hear-through audio systems

A method for generating an individualized audio output response for a headset based on a representation of a user's ear. One or more images of a portion of a user's head including at least the user's ear are received. A representation of the user's ear is generated based in part on the one or more images. A simulation of sound propagation from an audio source to the user's ear is performed based on the representation. An individualized audio output response is generated for the user based on the simulation, the individualized audio output response configured to adjust one or more acoustic parameters of audio content provided to the user by the headset.

Growing community of inventors

Kenmore, WA, United States of America

Pablo Francisco Faundez Hoffmann