The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 06, 2021

Filed:

Jan. 02, 2020
Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Willie L Scott, II, Austin, TX (US);

Seema Nagar, Bangalare, IN;

Charu Pandhi, Round Rock, TX (US);

Kuntal Dey, Vasant Kunj, IN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G10L 15/22 (2006.01); G10L 13/027 (2013.01); G06N 20/00 (2019.01); G06T 7/13 (2017.01); G06T 7/73 (2017.01); G06F 3/01 (2006.01); G10L 15/26 (2006.01);
U.S. Cl.
CPC ...
G06K 9/00671 (2013.01); G06F 3/013 (2013.01); G06N 20/00 (2019.01); G06T 7/13 (2017.01); G06T 7/74 (2017.01); G10L 13/027 (2013.01); G10L 15/26 (2013.01); G06T 2210/12 (2013.01);
Abstract

Embodiments herein provide an augmented reality (AR) system that uses sound localization to identify sounds that may be of interest to a user and generates an audio description of the source of the sound as well as AR content that can be magnified and displayed to the user. In one embodiment, an AR device captures images that have the source of the sound within their field of view. Using machine learning (ML) techniques, the AR device can identify the object creating the sound (i.e., the sound source). A description of the sound source and its actions can outputted to the user. In parallel, the AR device can also generate AR content for the sound source. For example, the AR device can magnify the sound source to a size that is viewable to the user and create AR content that is then superimposed onto a display.


Find Patent Forward Citations

Loading…