Facebook Technologies, LLC

Sebastià Vicenç Amengual Gari

Philip Robinson

Carl Schissler

Andrew Lovitt

Peter Henry Maresh

William Owen Brimijoin, Ii

Jacob Ryan Donley

Henrik Gert Hassager

A system for dynamically updating a head-related transfer function (HRTF) model that is customized to a user. The system receives one or more images of the user captured by one or more imaging devices. The system determines a pose of the user using the one or more captured images. The pose of the user includes a head-torso orientation of the user. The system updates a HRTF model for the user based on the determined pose including the head-torso orientation. The system generates one or more sound filters using the updated HRTF model and applies the one or more sound filters to audio content to generate spatialized audio content. The system provides the spatialized audio content to the user.

Dynamic customization of head related transfer functions for presentation of audio content

Determination of an acoustic filter for incorporating local effects of room modes within a target area is presented herein. A model of the target area is determined based in part on a three-dimensional virtual representation of the target area. In some embodiments, the model is selected from a group of candidate models. Room modes of the target area are determined based on a shape and/or dimensions of the model. The room mode parameters are determined based on at least one of the room modes and the position of a user within the target area. The room mode parameters describe an acoustic filter that as applied to audio content, simulates acoustic distortion at the position of the user and at frequencies associated with the at least one room mode. The acoustic filter is generated at a headset based on the room mode parameter and is used to present audio content.

Determination of an acoustic filter for incorporating local effects of room modes

Determination of a set of acoustic parameters for a headset is presented herein. The set of acoustic parameters can be determined based on a virtual model of physical locations stored at a mapping server. The virtual model describes a plurality of spaces and acoustic properties of those spaces, wherein the location in the virtual model corresponds to a physical location of the headset. A location in the virtual model for the headset is determined based on information describing at least a portion of the local area received from the headset. The set of acoustic parameters associated with the physical location of the headset is determined based in part on the determined location in the virtual model and any acoustic parameters associated with the determined location. The headset presents audio content using the set of acoustic parameters received from the mapping server.

Determination of acoustic parameters for a headset using a mapping server

A headset generates an output audio signal to provide a virtual sound source for an object or virtual object by using a room impulse response generated by a simulation using a model of a room generated from image data. The headset may include processing circuitry that obtains the model of the room determined based on the image data. The image data includes depth image data from a depth camera assembly and color image data from a color camera. The model includes surfaces of the room and acoustic absorptions of the surfaces. The processing circuitry adjusts audio content presented by the headset based on a room impulse response determined based on one or more simulations of sound propagation between a target position of an object and a position of the headset within the room using the surfaces of the room and the acoustic absorptions of the surfaces.

Room acoustic characterization using sensors

A computing device, such as a headset, provides for selective sound level reduction or sound level amplification for sounds made in a local area. The computing device includes a speaker assembly and a controller. The controller receives an audio signal from a second computing device, such as a second headset, via a wireless connection with the computing device. The audio signal describes a sound made by a user of the second computing device. The audio signal arrives at the computing device prior to the sound. The controller determines an audio filter to selectively adjust an amplitude of the sound and applies the audio filter to the audio signal to generate audio content. The controller presents, via the speaker assembly, the audio content to a user such that the presented audio content combines with the sound to selectively adjust the amplitude of the sound.

Sound level reduction and amplification

An audio system on a headset presents, to a user, audio content simulating a target artificial reality environment. The system receives audio content from an environment and analyzes the audio content to determine a set of acoustic properties associated with the environment. The audio content may be user generated or ambient sound. After receiving a set of target acoustic properties for a target environment, the system determines a transfer function by comparing the set of acoustic properties and the target environment's acoustic properties. The system adjusts the audio content based on the transfer function and presents the adjusted audio content to the user. The presented adjusted audio content includes one or more of the target acoustic properties for the target environment.

Audio system for artificial reality environment

An audio analysis system receives a first recording of a speech signal from an origin audio assembly and a second recording of at least a portion of the speech signal from a receiving audio assembly. The speech signal originates from a speaking user of the origin audio assembly and the second recording is recorded by a receiving audio assembly operated by a different user. Both the origin audio assembly and the receiving audio assembly are located within a room. The audio analysis system selects one or more audio frames in the first recording and one or more audio frames in the second recording that both occur over the same time period. The audio analysis system determines a transfer function for the room based in part on the selected one or more audio frames in the first recording and the selected one or more audio frames in the second recording.

Growing community of inventors

Seattle, WA, United States of America

Sebastià Vicenç Amengual Gari