Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Meta Platforms, Inc.

Philip Robinson

Andrew Lovitt

William Owen Brimijoin, Ii

Antonio John Miller

Carl Schissler

Scott Selfon

Peter Henry Maresh

Ravish Mehra

Sebastià Vicenç Amengual Gari

Vamsi Krishna Ithapu

Cesare Valerio Parise

Morteza Khaleghimeybodi

Peter Harty Dodds

Sebastiá Vicenç Amengual Gari

Jacob Ryan Donley

Scott Phillips Porter

Nils Thomas Fritiof Lunner

Henrik Gert Hassager

Peter Gottlieb

Scott Phillip Selfon

Sebastià Vicenç Amengual Garí

Paul Thomas Calamia

Sebastian Elliot Chafe

David Lou Alon

Maria Cuevas Rodriguez

Vladimir Tourbabin

Pablo Francisco Faundez Hoffmann

Tetsuro Oishi

Michaela Warnecke

Kristen Lorraine Grauman

Pablo Francisco Faundez Hoffman

Abhinav Gupta

Sebastia Vicenc Amengual Gari

Senthil Purushwalkam Shiva Prakash

Sebastian-Teodor Prepeliţǎ

Scott Colburn

Sebastiá Vicenc̨ Amengual Gari

Sebastiá Vicenç Amengual Garí

Orchisama Das

William Owen Ii Brimijoin

An audio system includes a plurality of transducers, one or more acoustic sensors, and a controller. The plurality of transducers transmits an ultrasonic beam towards an ear of a user. The one or more acoustic sensors detect a reflected signal generated by an interaction of the ultrasonic beam with the ear. The controller updates a three-dimensional geometry of the ear based on the reflected signal. The controller determines a head-related transfer function (HRTF) for the user based in part on the three-dimensional geometry of the ear.

Head-related transfer function determination using reflected ultrasonic signal

The disclosed computer-implemented method may include applying, via a sound reproduction system, sound cancellation that reduces an amplitude of various sound signals. The method further includes identifying, among the sound signals, an external sound whose amplitude is to be reduced by the sound cancellation. The method then includes analyzing the identified external sound to determine whether the identified external sound is to be made audible to a user and, upon determining that the external sound is to be made audible to the user, the method includes modifying the sound cancellation so that the identified external sound is made audible to the user. Various other methods, systems, and computer-readable media are also disclosed.

Adaptive ANC based on environmental triggers

A system for presenting audio content to a user. The system comprises one or more microphones coupled to a frame of a headset. The one or more microphones capture sound from a local area. The system further comprises an audio controller integrated into the headset and communicatively coupled to an in-ear device worn by a user. The audio controller identifies one or more sound sources in the local area based on the captured sound. The audio controller further determines a target sound source of the one or more sound sources and determines one or more filters to apply to a sound signal associated with the target sound source in the captured sound. The audio controller further generates an augmented sound signal by applying the one or more filters to the sound signal and provides the augmented sound signal to the in-ear device for presentation to a user.

Audio system for suppressing leakage signal from in-ear device

An audio system presents enhanced audio content to a user of a headset. The audio system detects sounds from the local area, at least a portion of which originate from a human sound source. The audio system obtains a voice profile of an identifies human sound source that generates at least the portion of the detected sounds. Based in part on the voice profile, the audio system enhances the portion of the detected sounds that are generated by the human sound source to obtain enhanced audio. The audio system presents the enhanced audio to the user.

Social network based voice enhancement system

Audio system using individualized sound profiles

Embodiments relate to binaural spatialization of more than two sound sources on two audio channels of an audio system. Sound signals each emitted from a corresponding sound source are collected, and a respective virtual position within an angular range of a sound scene is assigned to each sound source. Multi-source audio signals are generated by panning each sound signal according to the respective virtual position. A first multi-source audio signal is spatialized to a first direction to generate a first left signal and a first right signal. A second multi-source audio signal is spatialized to a second direction to generate a second left signal and a second right signal. A binaural signal is generated using the first left signal, the second left signal, the first right signal, and the second right signal. The binaural signal is such that each sound source appears to originate from its respective virtual position.

Discrete binaural spatialization of sound sources on two audio channels

The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing multiple modalities to generate accurate two-dimensional floorplans based on sparse digital videos depicting three-dimensional space. In particular, in one or more embodiments, the disclosed systems extract both visual and audio information from sparse digital video coverage of portions of a three-dimensional space and utilize the extracted visual and audio information to generate a two-dimensional floorplan representing both viewed and unviewed portions of the three-dimensional space. For example, the disclosed systems utilize self-attention layers of a specialized machine learning model to maintain and leverage bi-directional relationships among sequences of visual and audio features to generate floorplan predictions associated with the three-dimensional space. The disclosed systems then combine the predictions to generate the two-dimensional floorplan including a geometric layout and one or more semantic room labels.

Generating digital floorplans from sparse digital video utilizing an audio-visual floorplan reconstruction machine learning model

The disclosed computer-implemented method may include capturing, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment. The method may include detecting a pose of the speaker within the artificial reality environment and determining a position of the speaker relative to a position of the listener within the artificial reality environment. The method may further include processing, based on the pose and the relative position of the speaker within the artificial reality environment, the voice input to create a directivity-attuned voice signal for the listener, and delivering the directivity-attuned voice signal to an artificial reality device of the listener. Various other methods, systems, and computer-readable media are also disclosed.

Dynamic speech directivity reproduction

An audio system presented herein includes a transducer array, sensor array, and a controller. The controller control tactile content imparted to a user via actuation of at least one transducer in the transducer array while presenting audio content to the user. The transducer array presents the audio content with the tactile content to the user. The audio system can be part of a headset.

Methods and system for controlling tactile content

A system includes a headset to capture sound and a visual signal of a local area including one or more sound sources. The system determines a strength of the audio signal and a portion of the visual signal associated with the audio signal, compares the strengths, selects the weaker signal, and augments the weaker signal. The headset accordingly presents augmented audio-visual content to a user, thereby enhancing the user's perception of the weak signal.

Audio visual correspondence based signal augmentation

A system receives audio data in a frequency range of 20 Hz-20 kHz. The received audio data is encoded by the system into ultrasonic data in frequencies that are greater than 20 kHz, and transmitted into a local area that is proximal to the transmitting device, i.e., within the transmission range of the transmitting device. An ultrasonic communication device that is located in the transmission range of the transmitting device may receive the ultrasonic data. The received ultrasonic data is decoded by the ultrasonic communication system in the receiving device into audio data in a frequency range of 20 Hz-20 kHz, and subsequently presented to a user of the receiving ultrasonic communication device.

Local auditory display using ultrasonic encoding and decoding

A plurality of modal parameters is estimated for a set of discrete locations within a local area using a set of room impulse responses for the set of discrete locations. The local area includes an audio system. A plurality of acoustic model parameters is generated by fitting the plurality of modal parameters to an acoustic model that accounts for a physical geometry of the local area. The plurality of acoustic model parameters and an indication about the acoustic model are stored for later use by the audio system. The audio system estimates the set of acoustic parameters using the plurality of acoustic model parameters and the indication about the acoustic model, and presents audio content using the set of acoustic parameters.

Estimation of acoustic parameters for audio system based on stored information about acoustic model

A system creates an audio profile. The audio profile may be stored in a database. For example, the audio profile may be securely stored in a database of a social network and associated with a user account. The audio profile may contain data describing the way in which the specific user hears and interprets sounds. Systems and applications which present sounds to the user may access the audio profile and modify the sounds presented to the user based on the data in the audio profile to enhance the audio experience for the user.

Audio profile for personalized audio enhancement

Growing community of inventors

Seattle, WA, United States of America

Philip Robinson