Magic Leap, Inc.

Google Inc.

Griffith Buckley Hazen

Amy Dedonato

Ali Shahrokni

Ben Weisbih

Vinayram Balakumar

Lorena Pazmino

Karen Stolzenberg

Jason Parks

Austin Robison

Jordan Alexander Cazamias

Rodrigo Cano

James Cameron Petty

Daniel Stephen Speelman

Fred Quintana

Kara Lauren Gundersen

An augmented reality device may communicate with a map server via an API interface to provide mapping data that may be implemented into a canonical map, and may also receive map data from the map server. A visualization of map quality, including quality indicators for multiple cells of the environment, may be provided to the user as an overlay to the current real-world environment seen through the AR device. These visualizations may include, for example, a map quality minimap and/or a map quality overlay. The visualizations provide guidance to the user that allows more efficient updates to the map, thereby improving map quality and localization of users into the map.

Augmented reality map curation

A mixed reality (MR) device can allow a user to switch between input modes to allow interactions with a virtual environment via devices such as a six degrees of freedom (6DoF) handheld controller and a touchpad input device. A default input mode for interacting with virtual content may rely on the user's head pose, which may be difficult to use in selecting virtual objects that are far away in the virtual environment. Thus, the system may be configured to allow the user to use a 6DoF cursor, and a visual ray that extends from the handheld controller to the cursor, to enable precise targeting. Input via a touchpad input device (e.g., that allows three degrees of freedom movements) may also be used in conjunction with the 6DoF cursor.

Modes of user interaction

An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate or identify a user's location. The AR device can project graphics at designated locations within the user's environment to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to explore the user's environment.

Mapping and localization of a passable world

Methods and systems are provided related to synchronized networks. A synchronized network can include a node and additional nodes. The node can receive a packet including information. The node can determine whether the packet is from the synchronized network. After determining that the packet is from the synchronized network, the node can: send the packet to at least one of the additional nodes, determine whether a synchronized network interface (SNI) is on the node and is associated with the packet, where the SNI includes software executable on the node. After determining that the SNI is on the node and is associated with the packet, the node can generate a view of data in the synchronized network by: determining a user interface (UI) layout associated with the SNI, generating the view based on the UI layout and on the information using the SNI, and provide the view.

Synchronized distributed networks with frictionless application installation

A node of a synchronized network can receive a triggering input. The triggering input can be an input related to: receiving a packet from the synchronized network, sending a packet using the synchronized network, utilizing an application of the node, a sensor associated with the node, a user interface associated with the node, a location associated with the node, and/or a status of the node. The node can determine a synchronized network interface (SNI) that is associated with the triggering input and is configured with software for utilizing the synchronized network. The node can determine whether the software of the SNI is uninstalled on the node. After determining that the software of the SNI is uninstalled on the node, the node can receive, install, and execute the software of the SNI to utilize the synchronized network.

Growing community of inventors

San Francisco, CA, United States of America

Griffith Buckley Hazen