The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 01, 2025
Filed:
Apr. 25, 2023
Google Llc, Mountain View, CA (US);
Harshit Kharbanda, Pleasanton, CA (US);
Belinda Luna Zeng, Cupertino, CA (US);
Viviana Caso Corella, San Francisco, CA (US);
Christopher James Kelley, Orinda, CA (US);
Jessica Lee, Brooklyn, NY (US);
Pendar Yousefi, Sunnyvale, CA (US);
Dounia Berrada, Saratoga, CA (US);
Sundeep Vaddadi, Los Gatos, CA (US);
Kai Yu, San Francisco, CA (US);
Balint Miklos, Zürich, CH;
Severin Heiniger, Zürich, CH;
Louis Wang, San Francisco, CA (US);
GOOGLE LLC, Mountain View, CA (US);
Abstract
A multimodal search system is described. The system can receive image data captured by a camera of a user device. Additionally, the system can receive audio data associated with the image data. The audio data can be captured by a microphone of the user device. Moreover, the system can process the image data to generate visual features. Furthermore, the system can process the audio data to generate a plurality of words. The system can generate a plurality of search terms based on the plurality of words and the visual features. Subsequently, the system can determine one or more search results associated with the plurality of search terms and provide the one or more search results as an output.