Magic Leap, Inc.

Meta Platforms Technologies, LLC

Yuh-Lin Eugene Chang

Jiangtao Kuang

Yazhu Ling

Zhenqiang Ying

Ameet Jain

Lee Jonathon Nau

Peter Andreas Klinkmueller

Sung Ho Hong

Hao Xie

A distributed image signal processing (ISP) system for a head-mounted device reduces the power load on the battery of the head-mounted device. The distributed ISP system includes a Bayer image processing engine, an RGB image processing engine, and a YUV image processing engine. The Bayer image processing engine is operated by, for example, processing logic of the head-mounted device. The Bayer image processing engine provides Bayer image data from raw image data. The YUV image processing engine is operated by, for example, processing logic of a (companion) computing device (e.g., a phone, tablet, laptop, compute puck, personal computer). The computing device is communicatively coupled (e.g., wired or wirelessly) to the head-mounted device to receive image data. The RGB image processing engine may be operated by the head-mounted device or the computing device.

Distributed image signal processor (ISP) system for a head-mounted device

Techniques for fusing hand pose data associated with a user's hand with handheld device pose data associated with a handheld device. In some embodiments, both of a user's hands are utilized in embodiments described herein. The hand pose data including a position of the hand within a reference frame is captured using a hand pose sensor. The handheld device pose data including a position of the handheld device within the reference frame is captured using a handheld device pose sensor. A pose discrepancy between the hand pose data and the handheld device pose data is determined, the pose discrepancy including at least a position discrepancy between the position of the hand and the position of the handheld device. A fusion operation is performed based on the pose discrepancy.

Hand and totem input fusion for wearable systems

Growing community of inventors

Fremont, CA, United States of America

Yuh-Lin Eugene Chang