The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 09, 2021
Filed:
Nov. 30, 2018
International Business Machines Corporation, Armonk, NY (US);
Priscilla Santos Moraes, Pflugerville, TX (US);
Shunguo Yan, Austin, TX (US);
International Business Machines Corporation, Armonk, NY (US);
Abstract
To augment an image caption, a caption graph containing entity nodes corresponding to entities contained in the image and relationship edges between entity nodes corresponding to relationships between entities as illustrated in the image is generated. In addition, a contextual graph containing one or more of entity nodes corresponding to entities contained in the image and described in text associated with the image, textual entity nodes corresponding to textual entities described in text associated with the image and textual relationship edges between entity node pairs, textual entity node pairs and entity node and textual entity node pairs is generated. The textual relationship edges correspond to relationships described in the text associated with the image between entity pairs, textual entity pairs or entity and textual entity pairs. From the contextual graph, an augmented caption graph containing entity nodes, relationship edges, textual entities and textual relationship edges is generated.