Microsoft Technology Licensing, LLC

Barun Patra

Bradley Moore Abrams

Owais Khan Mohammed

Kamal Ginotra

Michael Lawrence Valenzuela

Vishrav Chaudhary

The disclosure describes utilizing an image query system to improve response accuracy and reduce computational steps resources in responding to natural language queries of input images. In various implementations, the image query system utilizes grounding information from one or more sources to determine accurate information for an input image. For example, the image query system uses a single comprehensive image prompt to obtain extensive visual image grounding information for the input image from a visual-based large generative model. Additionally, or in alternative implementations, the image query system obtains reverse image search grounding information for the input image. The image query system then cleverly utilizes the grounding information with a large generative language model to generate text query responses to image-based queries of the input image more accurately and efficiently.

Growing community of inventors

Vancouver, Canada

Barun Patra