Google Inc.

Jose Pascoal

Onur Gonen Guleryuz

Jonathan Tilton Barron

Shahram Izadi

Neal Wadhwa

Adarsh Prakash Murthy Kowdle

Sean Ryan Francesco Fanello

Vladimir Tankovich

Christoph Rhemann

Ambrus Csaszar

Konstantine Nicholas John Tsotsos

Michael John Schoenberg

Mirko Schmidt

Sameh Khamis

Eric Turner

Vivek Verma

Julien Valentin

Ivan Dryanovski

Maksym Dzitsiuk

Mira Leung

João Manuel Castro Afonso

A handheld user device includes a monocular camera to capture a feed of images of a local scene and a processor to select, from the feed, a keyframe and perform, for a first image from the feed, stereo matching using the first image, the keyframe, and a relative pose based on a pose associated with the first image and a pose associated with the keyframe to generate a sparse disparity map representing disparities between the first image and the keyframe. The processor further is to determine a dense depth map from the disparity map using a bilateral solver algorithm, and process a viewfinder image generated from a second image of the feed with occlusion rendering based on the depth map to incorporate one or more virtual objects into the viewfinder image to generate an AR viewfinder image. Further, the processor is to provide the AR viewfinder image for display.

Depth from motion for augmented reality for handheld user devices

Growing community of inventors

Lisbon, Portugal

Jose Pascoal