Magic Leap, Inc.

Lee Jonathon Nau

Yuh-Lin Eugene Chang

Ameet Jain

Peter Andreas Klinkmueller

Techniques for fusing hand pose data associated with a user's hand with handheld device pose data associated with a handheld device. In some embodiments, both of a user's hands are utilized in embodiments described herein. The hand pose data including a position of the hand within a reference frame is captured using a hand pose sensor. The handheld device pose data including a position of the handheld device within the reference frame is captured using a handheld device pose sensor. A pose discrepancy between the hand pose data and the handheld device pose data is determined, the pose discrepancy including at least a position discrepancy between the position of the hand and the position of the handheld device. A fusion operation is performed based on the pose discrepancy.

Growing community of inventors

San Jose, CA, United States of America

Lee Jonathon Nau