Magic Leap, Inc.

Daniel Stephen Speelman

Lorena Pazmino

Kara Lauren Gundersen

Rodrigo Cano

Griffith Buckley Hazen

Robert David Berkebile

Steven Maesen

Patrik Goorts

Steven Robb Dobos

A mixed reality (MR) device can allow a user to switch between input modes to allow interactions with a virtual environment via devices such as a six degrees of freedom (6DoF) handheld controller and a touchpad input device. A default input mode for interacting with virtual content may rely on the user's head pose, which may be difficult to use in selecting virtual objects that are far away in the virtual environment. Thus, the system may be configured to allow the user to use a 6DoF cursor, and a visual ray that extends from the handheld controller to the cursor, to enable precise targeting. Input via a touchpad input device (e.g., that allows three degrees of freedom movements) may also be used in conjunction with the 6DoF cursor.

Modes of user interaction

Image processing techniques for rendering holographic images are described. Image data captured from cameras can be converted into a triangle mesh. The triangle mesh may be processed by determining the location of edges, normals, and edge distances in the mesh. Mesh and edge smoothing can be performed on the mesh to reduce noise and jagged edges. Additional mesh cleanup and simplification can be performed to reduce the number of vertices and triangles and enhance the qualify of the mesh. Data from the resulting mesh can be transmitted to a receiving device where the mesh data is used to reproduce a holographic image of the image data captured by the depth sensors.

Edge detection and smoothing for virtual object presentation

Portion of a display screen with animated ray

Growing community of inventors

Fairview, PA, United States of America

Daniel Stephen Speelman