Microsoft Technology Licensing, LLC

Meta Platforms Technologies, LLC

Syavosh Zadissa

Andrew Lovitt

Nava K Balsam

Scott Phillip Selfon

Taher Shahbazi Mirzahasanloo

Brian Eugene Mouncer

Sean Allyn Coffin

A method for audio beam steering, tracking, and audio effects for an immersive reality application is provided. The method includes receiving, from an immersive reality application, a first audio waveform from a first acoustic source to provide to a user of a headset, identifying a perceived direction for the first acoustic source relative to the headset based on a location of the first acoustic source, and providing, to a first speaker in a client device, an audio signal including the first audio waveform, wherein the audio signal includes a time delay and an amplitude of the first audio waveform based on the perceived direction. A non-transitory, computer-readable medium storing instructions which, when executed by a processor, cause a system to perform the above method, and the system, are also provided.

Audio beam steering, tracking and audio effects for AR/VR applications

Audio receive beamforming is performed by a computing system. A set of audio signals are obtained via a microphone array and a set of inertial signals are obtained via a set of inertial sensors of a mobile device. A location of a targeted object to beamform is identified within a camera feed captured via a set of one or more cameras imagining an environment of the mobile device. A parameter of a beamforming function is determined that defines a beamforming region containing the targeted object based on the set of inertial signals and the location of the targeted object. The beamforming function is applied to the set of audio signals using the parameter to obtain a set of processed audio signals that increases a signal-to-noise ratio of an audio source within the beamforming region relative to the set of audio signals.

Mobile audio beamforming using sensor fusion

Growing community of inventors

Bothell, WA, United States of America

Syavosh Zadissa