Magic Leap, Inc.

Brian Edward Oliver Bucknor

James M Powderly

Haney Awad

William Wheeler

Savannah Niles

Christopher David Nesladek

Brian Schwab

Marshal Ainsworth Fontaine

Isioma Osagbemwenorue Azu

Samuel A Miller

Martin Georg Zahnert

Zachary C Nienstedt

Dominik Michael Kasper

Nathan Yuki Baumli

Emily Elizabeth Mount

Nikola Stan

Andrea Lampart

Rafa Gomez-Jordana Manas

Daniel Roberts

Wearable systems and method for operation thereof incorporating headset and controller localization using headset cameras and controller fiducials are disclosed. A wearable system may include a headset and a controller. The wearable system may alternate between performing headset tracking and performing controller tracking by repeatedly capturing images using a headset camera of the headset during headset tracking frames and controller tracking frames. The wearable system may cause the headset camera to capture a first exposure image an exposure above a threshold and cause the headset camera to capture a second exposure image having an exposure below the threshold. The wearable system may determine a fiducial interval during which fiducials of the controller are to flash at a fiducial frequency and a fiducial period. The wearable system may cause the fiducials to flash during the fiducial interval in accordance with the fiducial frequency and the fiducial period.

Wearable system with controller localization using headset cameras and controller fiducials

A light-emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light-emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light-emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Light-emitting user input device for calibration or pairing

A light emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Light-emitting user input device

Growing community of inventors

Miramar, FL, United States of America

Brian Edward Oliver Bucknor