Meta Platforms Technologies, LLC

Haowen Ruan

Francesco Marsili

A tracking device monitors a portion of a user's skin to infer a pose or gesture made by a body part of a user that engages the portion of the user's skin as the pose or gesture is made. For example, the tracking device monitors a portion of skin on a user's forearm to infer a pose or gesture made by the user's hand. The tracking device may include an illumination source that illuminates the portion of the user's skin. An optical sensor of the tracking device may capture images of the illuminated portion of skin. A controller of the tracking device infers a pose or gesture of the body part based in part on a model (e.g., a machine-learned model) and the captured images. The model may map various configurations of the user's skin to different poses or gestures of the body part.

Growing community of inventors

Menlo Park, CA, United States of America

Haowen Ruan