Facebook Technologies, LLC

Thync Global, Inc.

Meta Platforms Technologies, LLC

Thync, Inc.

Cerevast Medical, Inc.

Leland Stanford Junior University

Sheepdog Sciences, Inc.

Newdin Contents Co., Ltd.

Thyne Global, Inc.

Daniel Z Wetmore

Isy Goldwasser

Sumon K Pal

William J Tyler

Jonathan D Charlesworth

Adam L Berenzweig

Patrick Kaifosh

Alexandre Barachant

Remi Demers

Philip S Lamb

Raymond Louis Gradwohl

Wing Law

Rafal Piersiak

Douglas Jeffery

Jason Egnal

Anil Thakur

Tomokazu Sato

Christopher Voss

Christopher Osborn

Jay F Hamlin

Alyssa M Boasso

Christopher Anderson

Robert Muratore

Hailey M Mortimore

H Craig Heller

Jason Reisman

Thomas Reardon

Craig C Garner

Han-Ting Chang

Steven B Cook

Tudor Giurgica-Tiron

Adam Al-natsheh

Ning Guo

Jeffrey Scott Seely

Jonathan Reid

Alan Huan Du

Robert Cochran

Nitzan Bartov

Brett Jurman

Naor Brown

Joshua Duyan

Qiushi Mao

Scott Draves

Damien Colas

Todd O Anderson

Robert J Barretto

Alexander F A Butterwick

Michael Astolfi

Mason Remaley

Jasmine Stone

Robert John DiMaiolo

Anthony D Moschella

Michael Isaac Mandel

Nadine Hussami

Carlos Xavier Hernández

Tomo Sato

Alexander Opitz

Lia Siebert

Ran Rubin

Lana Awad

Faizan Muhammad

Akshay Yembarwar

Arielle Susu-Mago

Jonathan Charlesworth

Jay Hamlin

Jay Frederick Hamlin

Douglas Jeffrey

Jonathan Chalresworth

Raymond L Gradwohl

Portable transdermal electrical stimulation (TES) applicators for modifying a subject's cognitive state by applying stimulation to the subject's skin. One or more electrode may be on the subject's mastoid, and/or on or near the back of the subject's neck. The portable applicators are configured and adapted to be lightweight and may be wearable, and to deliver a high-intensity TES able to evoke or enhance a predetermined cognitive effect to stimulate either the trigeminal, facial and/or cervical plexus. These TES applicators may include a pair of electrodes and a TES control module comprising a processor, a timer and a waveform generator.

Apparatuses and methods for transdermal electrical stimulation of nerves to modify or induce a cognitive state

Methods and systems for reducing electromagnetic interference in analog circuit of a control device for an augmented reality (AR) or virtual reality (VR) system are described. An analog circuit associated with the control device may include at least one amplifier and an analog-to-digital converter coupled to an amplifier by one or more electrical conductors. Electromagnetic interference induced in the one or more electrical conductors by an external AC magnetic field may be reduced using at least one component of the control device configured to reduce the electromagnetic interference.

Electromagnetic interference reduction in extended reality environments

Computerized systems, methods, apparatuses, and computer-readable storage media are provided for generating a 3D map of an environment and/or for utilizing the 3D map to enable a user to control smart devices in the environment and/or to interact with a person in the environment. To generate the 3D map, perform the control, and/or interact with the person, a plurality of neuromuscular sensors may be worn by the user. The sensors may be arranged on a carrier worn by the user, and may be configured to sense neuromuscular signals from the user. A camera configured to capture information about the environment may be arranged on the carrier worn by the user. The sensors and the camera provide data to a computer processor coupled to a memory.

Systems and methods for contextualized interactions with an environment

Methods and systems for providing input to an augmented reality system or an extended reality system based, at least in part, on neuromuscular signals. The methods and systems comprise detecting, using one or more neuromuscular sensors arranged on one or more wearable devices, neuromuscular signals from a user; determining that a computerized system is in a mode configured to provide input including text to the augmented reality system; identifying based, at least in part, on the neuromuscular signals and/or information based on the neuromuscular signals, the input, wherein the input is further identified based, at least in part, on the mode; and providing the identified input to the augmented reality system.

Neuromuscular text entry, writing and drawing in augmented reality systems

The disclosed computer-implemented method may include presenting, via a user interface, a sensory cue, and receiving, from neuromuscular sensors of a wearable device, various neuromuscular signals generated by a user wearing the wearable device, where the user generates the neuromuscular signals in response to the sensory cue being presented to the user via the user interface. The method may also include interpreting the received neuromuscular signals as input commands with respect to the sensory cue provided by the user interface, such that the input commands initiate performance of specified tasks within the user interface. The method may also include performing the specified tasks within the user interface according to the interpreted input commands. Various other methods, systems, and computer-readable media are also disclosed.

Systems, methods, and interfaces for performing inputs based on neuromuscular control

The disclosed human computer interface (HCI) system may include (1) at least one processor, (2) a plurality of sensors that detect one or more neuromuscular signals from a forearm or wrist of a user, and (3) memory that stores (A) one or more trained inferential models that determine an amount of force associated with the one or more neuromuscular signals and (B) computer-executable instructions that, when executed by the at least one processor, cause the at least one processor to (I) identify the amount of force determined by the one or more trained inferential models, (II) determine that the amount of force satisfies a threshold force value, and in accordance with the determination that the amount of force satisfies the threshold force value, (III) generate a first input command for the HCI system. Various other devices, systems, and methods are also disclosed.

Devices, systems, and methods for controlling computing devices via neuromuscular signals of users

Example systems may include a head-mounted device configured to present an artificial reality view to a user, a control device including a plurality of electromyography (EMG) sensors, and at least one physical processor programmed to receive EMG data based on signals detected by the EMG sensors, detect EMG signals corresponding to user gestures within the EMG data, classify the EMG signals to identify gesture types, and provide control signals based on the gesture types, wherein the control signal triggers the head-mounted device to modify the artificial reality view. Various other methods, systems, and computer-readable media are also disclosed.

Methods and apparatus for gesture detection and classification

The disclosed systems and methods are generally directed to interpreting neuromuscular signals. The system includes (A) a plurality of neuromuscular sensors that detect a plurality of neuromuscular signals from a user and (B) at least one multiplexer in communication with the plurality of neuromuscular sensors and that is capable of dynamically adjusting neuromuscular sensor processing based on neuromuscular signal characteristics. A computer processor is programmed to (i) receive a set of neuromuscular signals from the plurality of neuromuscular sensors, (ii) determine, via a real-time system, at least one signal characteristic included in a neuromuscular signal, where the neuromuscular signal is associated with a first neuromuscular sensor included in the plurality of neuromuscular sensors; and (iii) dynamically reconfigure the processing of neuromuscular signals from the plurality of neuromuscular sensors based on an output from the multiplexer. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for mitigating neuromuscular signal artifacts

The disclosed method may include receiving neuromuscular activity data over a first time series from a first sensor on a wearable device donned by a user receiving ground truth data over a second time series from a second sensor that indicates a body part state of a body part of the user, generating one or more training datasets by time-shifting at least a portion of the neuromuscular activity data over the first time series relative to the second time series, to associate the neuromuscular activity data with at least a portion of the ground truth data, and training one or more inferential models based on the one or more training datasets. Various other related methods and systems are also disclosed.

Methods and apparatuses for low latency body state prediction based on neuromuscular data

The disclosed systems and methods are generally directed to providing a musculoskeletal representation of a hand. The system comprises one or more neuromuscular sensors configured to record a plurality of neuromuscular signals from a user and at least one computer processor. The computer processor is programmed to provide the plurality of neuromuscular signals as input to one or more trained inference models. The one or more trained inference models may include a smoothing function such as a loss function, such as a total variation loss function, a finite difference loss function, or another suitable loss function, to generate a temporally smooth output based on the processed neuromuscular signals. The computer processor is further programmed to determine the musculoskeletal representation of the hand based on the temporally smooth output. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for improving handstate representation model estimates

Methods and apparatus for substantially real-time detection of spike events in neuromuscular data. The method comprises receiving a plurality of neuromuscular signals from a plurality of neuromuscular sensors arranged on one or more wearable devices worn by a user, detecting, based on the plurality of neuromuscular signals or information derived from the plurality of neuromuscular signals, at least one spike event corresponding to firing of an action potential in at least one motor unit, determining, based on the plurality of neuromuscular signals or the information derived from the plurality of neuromuscular signals, a biological source of the detected at least one spike event, and generating at least one output based, at least in part, on the detected at least one spike event and/or the determined biological source of the detected at least one spike event.

Real-time spike detection and identification

Computerized systems, methods, kits, and computer-readable media storing code for implementing the methods are provided for interacting with a physical object in an augmented reality (AR) environment generated by an AR system. One such system includes: a plurality of neuromuscular sensors able to sense a plurality of neuromuscular signals from a user, and at least one computer processor. The neuromuscular sensors are arranged on one or more wearable devices worn by the user to sense the neuromuscular signals. The at least one computer processor is or are programmed to: determine, based at least in part, on the neuromuscular signals sensed by the neuromuscular sensors, information about an interaction of the user with the physical object in the AR environment generated by the AR system; and instruct the AR system to provide feedback based, at least in part, on the information about the interaction of the user with the physical object.

Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment

Methods and apparatus for authenticating a user based on neuromuscular signals. The method comprises recording, using a plurality of neuromuscular sensors arranged on one or more wearable devices, a plurality of neuromuscular signals from a user; deriving a neuromuscular signature for the user from the plurality of neuromuscular signals and/or information based on the plurality of neuromuscular signals, wherein the neuromuscular signature is indicative of at least one personal characteristic of the user detected in the plurality of neuromuscular signals; and authenticating the user based on the derived neuromuscular signature.

User identification and authentication with neuromuscular signatures

Growing community of inventors

San Francisco, CA, United States of America

Daniel Z Wetmore