Apple Inc.

Tobias Holl

Daniel R Kurz

Sawyer Isaac Cohen

Benjamin B Lyon

Mark Rober

Holly Gerhard

Jeffrey M Riepling

Peter Meier

Gowri Somanath

Peter Georg Meier

A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

Immersive virtual display

Various implementations disclosed herein include devices, systems, and methods that use light probes to facilitate the display of virtual objects in 3D environments. A light probe provides lighting information that describes light incident on a point in space in a 3D environment. For example, a light probe may describe such incident light using an environment map. Such lighting information can be used to provide realistic appearances for objects placed at or near light probe locations in the 3D environment. Implementations disclosed herein determine the light probe locations in real-time or other 3D environments that are generated based on a live physical environment. A digital representation of the live physical environment is used to determine where to position the light probes, how many light probes to use, and/or various light probe attributes.

Light probe placement for displaying objects in 3D environments on electronic devices

Various implementations disclosed herein include devices, systems, and methods that render a reflective surface of a computer-generated reality ('CGR') object based on synthesis in a CGR environment. In order to render a reflective surface of the CGR object, one exemplary implementation involves synthesizing an environment map of a CGR environment representing a portion of a physical scene based on observed characteristics of the physical scene. In an implementation, generation of a complete environment map includes identifying pixels of the environment map with no corresponding texture and generating synthesized texture based on textural information associated with one or more camera images of the physical scene. In an implementation, a CGR object is rendered in the CGR environment, wherein an appearance of a reflective surface of the CGR object is determined based on the complete environment map of the CGR environment.

Environment synthesis for lighting an object

Various implementations disclosed herein include devices, systems, and methods that complete content for a missing part of an image of an environment. For example, an example process may include obtaining an image including defined content and missing parts for which content is undefined, determining a spatial image transformation for the image based on the defined content and the missing parts of the image, altering the image by applying the spatial image transformation, and completing the altered image.

Partial image completion

Immersive display of motion-synchronized virtual content

Various implementations disclosed herein render virtual content with noise that is similar to or that otherwise better matches the noise found in the images with which the virtual content is combined. Some implementations involve identifying noise data for an image, creating a parameterized noise model based on the noise data, generating a noise pattern approximating noise of the image or another image using the parameterized noise model, and rendering content that includes the image and virtual content with noise added based on the noise pattern.

Rendering objects to match camera noise

A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.

Growing community of inventors

Sunnyvale, CA, United States of America

Tobias Holl