The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 15, 2022

Filed:

Oct. 30, 2019
Applicant:

Nec Laboratories America, Inc., Princeton, NJ (US);

Inventors:

Farley Lai, Plainsboro, NJ (US);

Asim Kadav, Jersey City, NJ (US);

Ning Xie, Fairborn, OH (US);

Assignee:
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06K 9/62 (2022.01); G06N 3/04 (2006.01); G06N 3/08 (2006.01); G06K 9/46 (2006.01); G06K 9/72 (2006.01); G06K 9/32 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6267 (2013.01); G06K 9/3233 (2013.01); G06K 9/46 (2013.01); G06K 9/6262 (2013.01); G06K 9/726 (2013.01); G06N 3/0445 (2013.01); G06N 3/08 (2013.01);
Abstract

A method is provided for determining entailment between an input premise and an input hypothesis of different modalities. The method includes extracting features from the input hypothesis and an entirety of and regions of interest in the input premise. The method further includes deriving intra-modal relevant information while suppressing intra-modal irrelevant information, based on intra-modal interactions between elementary ones of the features of the input hypothesis and between elementary ones of the features of the input premise. The method also includes attaching cross-modal relevant information to the features from the input premise to the features from the input hypothesis to form a cross-modal representation, based on cross-modal interactions between pairs of different elementary features from different modalities. The method additionally includes classifying a relationship between the input premise and the input hypothesis using a label selected from the group consisting of entailment, neutral, and contradiction based on the cross-modal representation.


Find Patent Forward Citations

Loading…