Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Mason Remaley

Adam L Berenzweig

Michael Astolfi

Daniel Z Wetmore

Tudor Giurgica-Tiron

Christopher Osborn

Lana Awad

Attila Maczak

Arielle Susu-Mago

Method and apparatus for rendering a visual representation based on a musculoskeletal representation. The method comprises updating the musculoskeletal representation based, at least in part, on a plurality of neuromuscular signals recorded from a user, wherein the musculoskeletal representation is updated based at least in part on: position information describing a spatial relationship between two or more connected segments of the musculoskeletal representation, and force information describing a force exerted by at least one segment of the musculoskeletal representation, and rendering, via a user interface, the visual representation based on the updated musculoskeletal representation, wherein the visual representation includes a visual indication of the position information and a visual indication of the force information.

Visualization of reconstructed handstate information

Computerized systems, methods, kits, and computer-readable media storing code for implementing the methods are provided for interacting with a physical object in an augmented reality (AR) environment generated by an AR system. One such system includes: a plurality of neuromuscular sensors able to sense a plurality of neuromuscular signals from a user, and at least one computer processor. The neuromuscular sensors are arranged on one or more wearable devices worn by the user to sense the neuromuscular signals. The at least one computer processor is or are programmed to: determine, based at least in part, on the neuromuscular signals sensed by the neuromuscular sensors, information about an interaction of the user with the physical object in the AR environment generated by the AR system; and instruct the AR system to provide feedback based, at least in part, on the information about the interaction of the user with the physical object.

Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment

Growing community of inventors

Santa Cruz, CA, United States of America

Mason Remaley