Magic Leap, Inc.

Michael Harold Liebenow

Robert Blake Taylor

Reza Nourai

Fahri Yaras

Robert Wyatt

Gilles Cadet

John Carl Paulus, Jr

Samuel A Miller

Ashwin Swaminathan

Ali Shahrokni

Anush Mohan

Eran Guendelman

Xuan Zhao

Prateek Singhal

Rafael Domingos Torres

Daniel Olshansky

Jehangir Tajik

Lomesh Agarwal

Christian Ivan Robert Moore

Joel David Holder

Hélder Toshiro Suzuki

Siddharth Choudhary

Jeremy Dwayne Miranda

Hiral Honar Barot

Hirai Honar Barot

Examples of the disclosure describe systems and methods for recording augmented reality and mixed reality experiences. In an example method, an image of a real environment is received via a camera of a wearable head device. A pose of the wearable head device is estimated, and a first image of a virtual environment is generated based on the pose. A second image of the virtual environment is generated based on the pose, wherein the second image of the virtual environment comprises a larger field of view than a field of view of the first image of the virtual environment. A combined image is generated based on the second image of the virtual environment and the image of the real environment.

Non-uniform stereo rendering

A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.

Mixed reality system with virtual content warping and method of generating virtual content using same

A computer implemented method for warping multi-field color virtual content for sequential projection includes obtaining first and second color fields having different first and second colors. The method also includes determining a first time for projection of a warped first color field. The method further includes determining a second time for projection of a warped second color field. Moreover, the method includes predicting a first pose at the first time and predicting a second pose at the second time. In addition, the method includes generating the warped first color field by warping the first color field based on the first pose. The method also includes generating the warped second color field by warping the second color field based on the second pose.

Mixed reality system with color virtual content warping and method of generating virtual content using same

An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.

Cross reality system

Disclosed is an improved approach for generated recordings from augmented reality systems from the perspective of a camera within the system. Instead of re-using rendered virtual content from the perspective of the user's eyes for AR recordings, additional virtual content is rendered from an additional perspective specifically for the AR recording. That additional virtual content is combined with image frames generated by a camera to form the AR recording.

Technique for recording augmented reality data

Mixed reality system with color virtual content warping and method of generating virtual con tent using same

Disclosed is an approach for constructing a new frame using rendered content and non-rendered content from a previous perspective. Points of visible surfaces of a first set of objects from a first perspective are rendered. Both rendered content and non-rendered content from the first perspective are stored. The new frame from the second perspective is generated using the rendered content and the non-rendered content from the first perspective.

Generating a new frame using rendered content and non-rendered content from a previous perspective

Growing community of inventors

Loxahatchee, FL, United States of America

Michael Harold Liebenow