The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 04, 2022

Filed:

Mar. 24, 2020
Applicant:

Salesforce.com, Inc., San Francisco, CA (US);

Inventors:

Keld Lundgaard, Cambridge, MA (US);

Cameron Wolfe, Austin, TX (US);

Assignee:

Salesforce, Inc., San Francisco, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2022.01); G06F 40/151 (2020.01); G06F 17/18 (2006.01); G06N 3/08 (2006.01); G06K 9/62 (2022.01); G06N 20/10 (2019.01); G06N 3/04 (2006.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G06F 40/151 (2020.01); G06F 17/18 (2013.01); G06K 9/628 (2013.01); G06K 9/6256 (2013.01); G06K 9/6289 (2013.01); G06N 3/04 (2013.01); G06N 3/08 (2013.01); G06N 20/10 (2019.01); G06N 20/00 (2019.01);
Abstract

Systems and methods are provided for generating textual embeddings by tokenizing text data and generating vectors to be provided to a transformer system, where the textual embeddings are vector representations of semantic meanings of text that is part of the text data. The vectors may be averaged for every token of the generated textual embeddings and concatenating average output activations of two layers of the transformer system. Image embeddings may be generated with a convolutional neural network (CNN) from image data, wherein the image embeddings are vector representations of the images that are part of the image data. The textual embeddings and image embeddings may be combined to form combined embeddings to be provided to the transformer system.


Find Patent Forward Citations

Loading…