Magic Leap, Inc.

Daniel Roberts

Samuel A Miller

Martin Georg Zahnert

Zachary C Nienstedt

Dominik Michael Kasper

Brian Edward Oliver Bucknor

Nathan Yuki Baumli

Emily Elizabeth Mount

Nikola Stan

Andrea Lampart

Rafa Gomez-Jordana Manas

Wearable systems and method for operation thereof incorporating headset and controller localization using headset cameras and controller fiducials are disclosed. A wearable system may include a headset and a controller. The wearable system may alternate between performing headset tracking and performing controller tracking by repeatedly capturing images using a headset camera of the headset during headset tracking frames and controller tracking frames. The wearable system may cause the headset camera to capture a first exposure image an exposure above a threshold and cause the headset camera to capture a second exposure image having an exposure below the threshold. The wearable system may determine a fiducial interval during which fiducials of the controller are to flash at a fiducial frequency and a fiducial period. The wearable system may cause the fiducials to flash during the fiducial interval in accordance with the fiducial frequency and the fiducial period.

Wearable system with controller localization using headset cameras and controller fiducials

Growing community of inventors

Davie, FL, United States of America

Daniel Roberts