Magic Leap, Inc.

James M Powderly

Savannah Niles

Lorena Pazmino

Marshal Ainsworth Fontaine

Paul Armistead Hoover

Cole Parker Heiner

Christopher David Nesladek

Gregory Minh Tran

Haney Awad

Isioma Osagbemwenorue Azu

William Adams

Alysha Naples

Andrea Isabel Montoya

Tim Zurmoehle

Brian Schwab

Timothy Michael Stutts

Frank Hamilton

Shigeru G Natsume

Amy DeDonato

William Wheeler

John Austin Day

Robert John Cummings MacDonald

James Cameron Petty

Rony Abovitz

Brian Everett Meaney

Yan Xu

Marc Coleman Shelton

Dylan Nathan

Li Chin Lin

Frank Alexander Hamilton, Iv

Jonathan Lawrence Mann

Brian Edward Oliver Bucknor

Chris Sorrell

Craig Erickson

Ian Michener Bradley

Karen Stolzenberg

Bradley Fraser

Jeffrey Scott Sommers

Sumanth Murali

Adam Charles Carlson

Praveen Babu J D

Jennifer M R Devine

Nicole Elizabeth Samec

Mark Baerenrodt

Christopher M Harrises

Nastasja U Robaina

Brian Keith Smith

Richard St Clair Bailey

Carlos A Rivera Cintron

Tucker Spofford

Ali Amirhooshmand

Megan Ann Geiman

Sarah Machicado

Josh Anon

Anthony Robert Sheeder

Richard St Claire Bailey

Nari Choi

Spencer Davis

Kenneth Kian Ann Tay

Jonathan David Garn

Daryl Francis Tanghe

Ajoy Savio Fernandes

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

Selecting virtual objects in a three-dimensional space

A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Interactions with 3D virtual objects using poses and multiple-dof controllers

A light-emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light-emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light-emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Light-emitting user input device for calibration or pairing

A light emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Interactions with 3D virtual objects using poses and multiple-DOF controllers

Examples of systems and methods for a wearable system to automatically select or filter available user interface interactions or virtual objects are disclosed. The wearable system can select a group of virtual objects for user interaction based on contextual information associated with the user, the user's environment, physical or virtual objects in the user's environment, or the user's physiological or psychological state.

Contextual awareness of user interface menus

Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The multiple inputs can also be used by the wearable system to permit a user to interact with text, such as, e.g., composing, selecting, or editing text.

Multimodal task execution and text editing for a wearable system

Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. The focus indicator may be emphasized in directions closer to the cursor and deemphasized in directions farther from the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The cursor and focus indicator can provide the user with positional feedback and help the user navigate among objects in the environment.

Eclipse cursor for mixed reality displays

Totem controller having an illumination region

User interfaces for virtual reality, augmented reality, and mixed reality display systems are disclosed. The user interfaces may be virtual or physical keyboards. Techniques are described for displaying, configuring, and/or interacting with the user interfaces.

Keyboards for virtual, augmented, and mixed reality display systems

Embodiments of a wearable device can include a head-mounted display (HMD) which can be configured to display virtual content. While the user is interacting with visual or audible virtual content, the user of the wearable may encounter a triggering event such as, for example, an emergency condition or an unsafe condition, detecting one or more triggering objects in an environment, or determining characteristics of the user's environment (e.g., home or office). Embodiments of the wearable device can automatically detect the triggering event and automatically control the HMD to deemphasize, block, or stop displaying the virtual content. The HMD may include a button that can be actuated by the user to manually deemphasize, block, or stop displaying the virtual content.

Automatic control of wearable display device based on external conditions

Growing community of inventors

Ft. Lauderdale, FL, United States of America

James M Powderly