The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 08, 2016

Filed:

May. 10, 2013
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Daniel McCulloch, Kirkland, WA (US);

Abby Lin Lee, Seattle, WA (US);

Adam Benjamin Smith-Kipnis, Seattle, WA (US);

Jonathan William Plumb, Seattle, WA (US);

Alexandre David, Seattle, WA (US);

Michael O Hale, Bellevue, WA (US);

Jeff Cole, Seattle, WA (US);

Hendrik Mark Langerak, Bellevue, WA (US);

Assignee:
Attorneys:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G10L 15/00 (2013.01); G10L 15/26 (2006.01); G06F 1/16 (2006.01);
U.S. Cl.
CPC ...
G10L 15/26 (2013.01); G06F 1/163 (2013.01);
Abstract

Embodiments that relate to converting audio inputs from an environment into text are disclosed. For example, in one disclosed embodiment a speech conversion program receives audio inputs from a microphone array of a head-mounted display device. Image data is captured from the environment, and one or more possible faces are detected from image data. Eye-tracking data is used to determine a target face on which a user is focused. A beamforming technique is applied to at least a portion of the audio inputs to identify target audio inputs that are associated with the target face. The target audio inputs are converted into text that is displayed via a transparent display of the head-mounted display device.


Find Patent Forward Citations

Loading…