Apple Inc.

University of Pittsburgh

Erdrin Azemi

Joseph Yitan Cheng

Kaan Emre Dogrusoz

Ali Moin

Hanlin Goh

Christoph Horst Krah

Mohammad Yeke Yazdandoost

Daniel A Podhajny

Benjamin J Grena

Xinyan Cui

Cuneyt Oncel Tuzel

Lia Mieko Uesato

Noah Snyder

Joseph Y Cheng

Carl F Lagenaur

The present application relates to apparatus, systems, and methods to perform subject-aware self-supervised learning of a machine-learning model for classification of data, such as classification of biosignals.

Subject-aware contrastive learning for biosignals

Aspects of the subject technology relate to gesture-control inputs to an electronic device for controlling one or more other devices. The electronic device can efficiently provide gesture control for multiple other devices by mapping a finite set of user gestures to a specific set of gesture-control elements for each of the multiple other devices. In this way a single gesture can be detected for potentially controlling various different functions of various different devices. Prior to gesture control, the electronic device may receive a selection of a particular one of the multiple other devices for control, and obtain the specific set of gesture-control elements for gesture control of that selected device.

Multi-device gesture control

A head-mounted device having a plurality of electrodes configured to detect optical events such as the movement of one or more eyes or coarse eye gestures is disclosed. In some examples, the one or more electrodes can be coupled to dielectric elastomer materials whose shape can be changed to vary contact between a user of the head-mounted device and the one or more electrodes to ensure sufficient contact and electrode signal quality. In some examples, the one or more electrodes can be coupled to pressure sensors and control circuitry to monitor and adjust the applied pressure. In some examples, the optical events can be used as triggers for operating the device, including transitioning between operational power modes. In some examples, the triggers can invoke higher resolution sensing capabilities of the head-mounted device. In some examples, the electrodes can be used as an on-head detector to wake-up and/or unlock the device.

Eye detection methods and devices

Techniques are disclosed for defining a training data set to include biosignals and categorical labels representative of a context. For example, a categorical label may indicate whether a user was performing a difficult or easy mental task while the biosignal was being recorded. A set of first layers in a neural network can be trained using a portion of the training data set associated with a first set of users and at least one second layer can be trained using a portion of the training data set associated with a particular other user. The neural network can then be used to process other biosignals from the particular other user to generate predicted categorical context labels.

Machine learning configurations modeled using contextual categorical labels for biosignals

Electrodes that can be formed in a flexible band of a wrist-worn device to detect hand gestures are disclosed. Multiple rows of electrodes can be configured to detect electromyography (EMG) signals produced by activity of muscles and tendons. The band can include removable electrical connections (e.g., pogo pins) to enable the electrode signals to be routed to processing circuitry in the housing of the wrist-worn device. Measurements between signals from the active electrodes and one or more reference electrodes can be obtained to capture EMG signals at a number of locations on the band. The measurement method and mode of operation (lower power coarse detection or higher power fine detection) can determine the location and number of electrodes to be measured. These EMG signals can be processed to identify hand movements and recognize gestures associated with those hand movements.

Electrodes for gesture recognition

Disclosed herein are neural probes comprising an L1 polypeptide functional fragment thereof on the exterior surface of the probe, devices including such electrodes, and methods of their use. The disclosed embodiments are useful, for example, for in methods of recording and/or stimulating neural signals in a subject.

Growing community of inventors

Sunnyvale, CA, United States of America

Erdrin Azemi