Magic Leap, Inc.

Marc Alan McCall

Karen Stolzenberg

Cole Parker Heiner

Frank Alexander Hamilton, Iv

John Austin Day

Eric Norman Yiskis

Brett Shipes

A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.

Gaze timer based augmentation of functionality of a user input device

Examples of systems and methods for interacting with content and updating the location and orientation of that content using a single controller. The system may allow a user to use the same controller for moving content around the room and interacting with that content by tracking a range of the motion of the controller.

Content movement and interaction using a single controller

A user may interact and select positions in three-dimensional space arbitrarily through conversion of a two-dimensional positional input into a three-dimensional point in space. The system may allow a user to use one or more user input devices for pointing, annotating, or drawing on virtual objects, real objects or empty space in reference to the location of the three-dimensional point in space within an augmented reality or mixed reality session.

Converting a 2D positional input into a 3D point in space

Examples of the disclosure describe systems and methods for sharing perspective views of virtual content. In an example method, a virtual object is presented, via a display, to a first user. A first perspective view of the virtual object is determined, wherein the first perspective view is based on a position of the virtual object and a position of the first user. The virtual object is presented, via a display, to a second user, wherein the virtual object is presented to the second user according to the first perspective view. A second perspective view of the virtual object is determined, wherein the second perspective view is based on an input from the first user. The virtual object is presented, via a display, to the second user, wherein presenting the virtual object to the second user comprises presenting a transition from the first perspective view to the second perspective view.

Systems and methods for presenting perspective views of augmented reality virtual object

A method of viewing image data of local content is disclosed. An augmented reality view is created by storing a first device coordinate frame (DCF), moving a first registration marker to select a first feature point (FP1) and a second feature point (FP2) on at least one real-word object viewable by the user through a display. A uniform coordinate system (UCS) alignment module stores locations of the registration marker when selecting the FP1 and the FP2, determines a user coordinate frame (UCF) based on the locations of the first registration marker when selecting the FP1 and the FP2, transforms the DCF to the UCF and displays image data of local content received on a first data source with a projector through the display to the user based on the transformation from the first DCF to the first UCF.

Registration of local content between first and second augmented reality viewers

Examples of the disclosure describe systems and methods for sharing perspective views of virtual content. In an example method, a virtual object is presented, via a display, to a first user. A first perspective view of the virtual object is determined based on a position of the virtual object and a first position of the first user. The virtual object is presented, via a display, to a second user according to the first perspective view. An input is received from the first user. A second perspective view of the virtual object is determined based on the input from the first user. The virtual object is presented, via a display, to the second user, wherein presenting the virtual object to the second user comprises presenting a transition from the first perspective view to the second perspective view.

Examples of the disclosure describe systems and methods for decomposing and sharing 3D models. In an example method, a first version of a virtual three-dimensional model is displayed via a display of a wearable head device. A request is made to a host device for data associated with a second version of the virtual three-dimensional model, wherein the second version of the virtual three-dimensional model comprises a constituent part. It is determined whether the first version of the virtual three-dimensional model comprises the constituent part. In accordance with a determination that the first version of the virtual three-dimensional model does not comprise the constituent part, a request is made to the host device for data associated with the constituent part. The second version of the virtual three-dimensional model is displayed, via the display of the wearable head device. In accordance with a determination that the first version of the virtual three-dimensional model comprises the constituent part, a request is not made to the host device for data associated with the constituent part.

Methods and systems for three-dimensional model sharing

An augmented reality system includes left and right transparent eyepieces through which a user can view the real world and which serve to couple imagewise modulated light into the user's eyes in order to display virtual content components of a mixed reality experience. The system further includes left and right speakers and a facility for user spatial manipulation of virtual objects. The system produces spatialized audio that has a virtual sound source position fixed to one or more virtual objects that are spatially manipulated by the user. Thus the system provides more realistic visual and auditory presentation of virtual components of a mixed reality experience.

Growing community of inventors

Plantation, FL, United States of America

Marc Alan McCall