The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Dec. 09, 2025

Filed:

Dec. 28, 2022
Applicant:

Mohamed Bin Zayed University of Artificial Intelligence, Abu Dhabi, AE;

Inventors:

Muhammad Uzair Khattak, Abu Dhabi, AE;

Hanoona Abdul Rasheed Bangalath, Abu Dhabi, AE;

Muhammad Maaz, Abu Dhabi, AE;

Salman Khan, Abu Dhabi, AE;

Fahad Shahbaz Khan, Abu Dhabi, AE;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 40/284 (2020.01); G06F 40/126 (2020.01);
U.S. Cl.
CPC ...
G06F 40/284 (2020.01); G06F 40/126 (2020.01);
Abstract

A method and system for multi-modal prompt learning of vision-language models. Encodings of image-text pairs can be combined with image prompts and text prompts before being input into an image encoder and text encoder of a vision-language model respectively. The image prompt can be generated using the text prompt using a vision-language coupling function to encourage synergy between the two prompts. The combination of encodings and prompts can be fed through the transformer layers of the encoders, and the output of each layer can be combined with a new prompt before entering the next layer, up until a specific depth. The subsequent transformer layers can process the output and generate a final representation for the image and text which can then be used for downstream tasks.


Find Patent Forward Citations

Loading…