logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 12633101 B1

PDFFull Text
Date of Patent:
May. 19, 2026

Filed:

May. 17, 2023

Information processing apparatus, information processing method, learning method and moving object for predicting a region in an image corresponding to utterance

Applicants:

Honda Motor Co., Ltd., Tokyo, JP;

Keio University, Tokyo, JP;

Inventors:

Naoki Hosomi, Wako, JP;

Teruhisa Misu, San Jose, CA (US);

Shumpei Hatanaka, Yokohama, JP;

Wei Yang, Yokohama, JP;

Komei Sugiura, Yokohama, JP;

Assignees:

HONDA MOTOR CO., LTD., Tokyo, JP;

KEIO UNIVERSITY, Tokyo, JP;

Attorney:

THOMAS | HORSTEMEYER, LLP

Primary Examiner:

Charlotte M Baker

Int. Cl.
CPC ...
G06V 10/80 (2022.01); G06T 7/11 (2017.01); G06V 10/764 (2022.01); G06V 10/77 (2022.01); G06V 10/774 (2022.01); G06V 10/82 (2022.01); G06V 10/94 (2022.01); G06V 20/70 (2022.01); G10L 15/02 (2006.01); G10L 15/16 (2006.01); G10L 15/22 (2006.01);
U.S. Cl.
CPC ...
G06V 10/806 (2022.01); G06T 7/11 (2017.01); G06V 10/764 (2022.01); G06V 10/7715 (2022.01); G06V 10/774 (2022.01); G06V 10/82 (2022.01); G06V 10/945 (2022.01); G06V 20/70 (2022.01); G10L 15/02 (2013.01); G10L 15/16 (2013.01); G10L 15/22 (2013.01); G06T 2207/20021 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20092 (2013.01); G06T 2207/30252 (2013.01);
Abstract

An information processing apparatus in embodiments performs at least one trained machine learning model that includes an encoder and a decoder. The encoder receives inputs of text information including designation of a place, a first image that is an image captured by an image capturing apparatus and that includes the place, and a second image obtained by dividing a region for every identical object in the first image, and outputs tri-modal features that have been generated to include visual features of the first image that has been captured, visual features of the second image obtained by dividing the region, and language features of the text information. The decoder outputs a region on the first image corresponding to the designation of the place in the text information, by using the tri-modal features.

Find Patent Forward Citations

Hosomi, Naoki. (2026). Information processing apparatus, information processing method, learning method and moving object for predicting a region in an image corresponding to utterance (U.S. Patent No. 12633101). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12633101

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…