The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 23, 2024

Filed:

Sep. 03, 2021
Applicant:

Google Llc, Mountain View, CA (US);

Inventors:

Ruofei Du, San Francisco, CA (US);

Hendrik Wagenaar, Santa Clara, CA (US);

Alex Olwal, Santa Cruz, CA (US);

Assignee:

Google LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 3/01 (2006.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 40/16 (2022.01); G06V 40/19 (2022.01); G10L 15/22 (2006.01); G10L 15/25 (2013.01); G10L 15/26 (2006.01); G10L 21/10 (2013.01); G10L 21/18 (2013.01); H04R 1/08 (2006.01); H04R 1/40 (2006.01); H04R 3/00 (2006.01);
U.S. Cl.
CPC ...
G10L 21/10 (2013.01); G06F 3/013 (2013.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06V 40/171 (2022.01); G06V 40/19 (2022.01); G10L 15/22 (2013.01); G10L 15/25 (2013.01); G10L 15/26 (2013.01); G10L 21/18 (2013.01); H04R 1/08 (2013.01); H04R 1/406 (2013.01); H04R 3/005 (2013.01); G06T 2207/30201 (2013.01); H04R 2201/401 (2013.01);
Abstract

An augmented reality (AR) device, such as AR glasses, may include a microphone array. The sensitivity of the microphone array can be directed to a target by beamforming, which includes combining the audio of each microphone of the array in a particular way based on a location of the target. The present disclosure describes systems and methods to determine the location of the target based on a gaze of a user and beamform the audio accordingly. This eye-tracked beamforming (i.e., foveated beamforming) can be used by AR applications to enhance sounds from a gaze direction and to suppress sounds from other directions. Additionally, the gaze information can be used to help visualize the results of an AR application, such as speech-to-text.


Find Patent Forward Citations

Loading…