Apple Inc.

Johan V Hedberg

Ross W Anderson

Gunnar Martin Byrod

Jan H Bockert

Zachery Webster Kennedy

Ryan David Shelby

Sean P O'Brien

YunJae Kim

Ryan W Apuy

Giovanni S Luis

William Andreas Viglakis

Sebastian A Araya

Kyle L Simek

Eric Trepanier

Corentin Cheron

Mukul Sati

Various implementations disclosed herein include devices, systems, and methods that adjusts operating modes for generating three-dimensional (3D) representations of a physical environment. For example, an example process may include acquiring sensor data by the one or more sensors in a physical environment and operating the device according to a first operating mode and a second operating mode during different periods of time. In the first operating mode (e.g., discovery mode), the device generates a 3D representation of the physical environment based on the sensor data and the device monitors one or more conditions to switch to the second operating mode. In the second operating mode (e.g., monitoring mode), the device monitors the one or more conditions to switch to the first operating mode and generates the 3D representation differently than the first operating mode.

Toggling operating modes for generating 3D representations

In some implementations, a computing device can simulate a virtual parallax to create three dimensional effects. For example, the computing device can obtain an image captured at a particular location. The captured two-dimensional image can be applied as texture to a three-dimensional model of the capture location. To give the two-dimensional image a three-dimensional look and feel, the computing device can simulate moving the camera used to capture the two-dimensional image to different locations around the image capture location to generate different perspectives of the textured three-dimensional model as if captured by multiple different cameras. Thus, a virtual parallax can be introduced into the generated imagery for the capture location. When presented to the user on a display of the computing device, the generated imagery may have a three-dimensional look and feel even though generated from a single two-dimensional image.

Generating an image from a perspective of an intermediate location between first and second image capture points

Image composition based on comparing pixel quality scores of first and second pixels

In some implementations, a computing device can present a dynamic street scene overlay when presenting a map view on a display of the computing device. The dynamic street scene overlay can be presented such that a user can clearly view both the dynamic street scene and the map view. The dynamic street scene can be dynamically adjusted in response to the user manipulating the map view to a different location. The dynamic street scene can be presented such that the objects in the images of the dynamic street scene have a three-dimensional look and feel. The dynamic street scene can be presented such that the dynamic street scene does not prevent the user from viewing and interacting with the map view.

Dynamic street scene overlay

Virtual parallax to create three-dimensional appearance

Growing community of inventors

Foster City, CA, United States of America

Johan V Hedberg