Magic Leap, Inc.

Mohan Babu Kandra

David Geoffrey Molyneaux

Daniel Olshansky

Rafael Domingos Torres

Frank Thomas Steinbrücker

Yilun Cao

David Paul Pena

Frank Thomas Steinbruecker

Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object, upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.

Cross reality system for large scale environment reconstruction

Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object. upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.

Various techniques pertaining to methods, systems, and computer program products identify, for a first portable device at a first location in a three-dimensional (3D) physical environment, a first sparse map, the first portable device connected to a remote computing system for accessing sharable world data of the 3D physical environment that comprises a physical object, wherein the plurality electronic devices include the plurality of portable devices having respective sparse maps installed thereupon. A second sparse map is identified for a second portable device connected to the remote computing system for accessing the sharable world data. The second portable device performs content persistence for a virtual content relative to the physical object at least by using a merged map determined by merging a version of the first sparse map and a version of the second sparse map based at least in part upon one or more persistence coordinate frames.

A method to efficiently update and manage outputs of real time or offline 3D reconstruction and scanning in a mobile device having limited resource and connection to the Internet is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data, in either single user applications or multi-user applications sharing and updating the same 3D reconstruction data. The method includes a block-based 3D data representation that allows local update and maintains neighbor consistency at the same time, and a multi-layer caching mechanism that retrieves, prefetches, and stores 3D data efficiently for XR applications. Between sessions of an XR device, blocks may be persisted on the device or in remote storage in one or more cache layers. The device may, upon starting a new session, selectively use the blocks from one or more layers of the cache.

Caching and updating of dense 3D reconstruction data

An extended or cross reality system includes a computing device communicably connected to a plurality of portable electronic devices via a network component, a repository accessible by the computing device and the plurality of portable electronic devices, and a dense map merge component. The extended or cross reality system determines a representation for multiple portions of a 3D environment based at least in part upon on a set of dense maps received from the plurality of portable devices, wherein the set of dense maps is grouped into multiple subgroups based at least in part upon pose data pertaining to the set of dense maps or surface information in the set of dense maps. The extended or cross reality system storing the representation as at least a portion of a shared persistent dense map.

Growing community of inventors

San Ramon, CA, United States of America

Mohan Babu Kandra