Salesforce, Inc.

Anthony Meng Huat Tiong

Chu Hong Hoi

Junnan Li

Embodiments described herein provide a zero-shot visual question answering (VQA) framework, which conjoins foundation network models with zero additional training. A first image and a question relating to the first image are received. The first image is divided into a plurality of image patches. A plurality of relevant image patches that are relevant to the question are determined, using a first neural network model, from the plurality of image patches. A plurality of image captions are generated, using a second neural network model, based on the plurality of relevant image patches. An answer to the question is generated based on the plurality of image captions.

Growing community of inventors

Singapore, Singapore

Anthony Meng Huat Tiong