Google Inc.

Sundeep Vaddadi

Matthias Grundmann

Cheng Yong Yang

Harshit Kharbanda

Balint Miklos

Christopher Kelley

Louis Wang

Keir Banks Mierle

Jianing Wei

Belinda Zeng

Jessica Lee

Bryan Woods

Pendar Yousefi

Viviana Caso Corella

Severin Heiniger

Keith Schaefer

Kai Yu

Dounia Berrada

Konstantine Tsotsos

Leon Wong

A multimodal search system is described. The system can receive image data captured by a camera of a user device. Additionally, the system can receive audio data associated with the image data. The audio data can be captured by a microphone of the user device. Moreover, the system can process the image data to generate visual features. Furthermore, the system can process the audio data to generate a plurality of words. The system can generate a plurality of search terms based on the plurality of words and the visual features. Subsequently, the system can determine one or more search results associated with the plurality of search terms and provide the one or more search results as an output.

Visual and audio multimodal searching system

In a general aspect, a method can include receiving data defining an augmented reality (AR) environment including a representation of a physical environment, and changing tracking of an AR object within the AR environment between region-tracking mode and plane-tracking mode.

Hybrid placement of objects in an augmented reality environment

Growing community of inventors

Mountain View, CA, United States of America

Sundeep Vaddadi