Meta Platforms Technologies, LLC

Szeyin Lee

Willy Huang

Adam L Berenzweig

Chengyuan Yan

Jason Reisman

Sheng Shen

Christopher Anderson

Joseph Davis Greer

Paulo Jose Telo Coelho

Zaina Edelson

Austin Ha

Austin Lee

Jason Lowell Reisman

Rajinder Sodhi

Andre Levi

Jonathan Lim

Luke O'Connor

Andrew Morrison

Edith Comas

Shaker Islam

Eric Whitmire

Luke O'CONNOR

A method includes, while presenting an artificial-reality environment that includes a virtual object and a representation of a physical object, detecting, based on data from a first group of sensors of a wrist-wearable device, that the wrist-wearable device is within a first distance of an electronic device responsive to user gestures and within another threshold distance of the virtual object. The electronic device is represented within the artificial-reality environment. The method includes, while the wrist-wearable device is within the first activation-threshold distance of the electronic device and is also within a second activation-threshold distance of the virtual object, determining, based on data from a second set of sensors of the wrist-wearable device, that a gesture corresponds to an operation at the electronic device. And the method includes, based on determining that the user gesture corresponds to the operation, causing the physical electronic device to perform the operation.

Systems for detecting gestures performed within activation-threshold distances of artificial-reality objects to cause operations at physical electronic devices, and methods of use thereof

The various implementations described herein include methods and systems for using hand gestures detected at a wearable device to navigate a user interface. An example method includes receiving, via one or more neuromuscular-signal sensors of a wrist-wearable device worn by a user, data generated during performance of an in-air wrist movement by a wrist of the user. The method also includes moving a point of focus on the user interface in accordance with the in-air wrist movement; and receiving, via the one or more neuromuscular-signal sensors, additional data generated during performance of an in-air gesture by the user. The method further includes determining that the in-air gesture is an execution gesture; and executing a command corresponding to the execution gesture.

Navigating a user interface using in-air gestures detected via neuromuscular-signal sensors of a wearable device, and systems and methods of use thereof

Methods and systems for coordinating operation of a head-wearable device and an electronic device to assist a user in interacting with the electronic device are disclosed. A method includes, while a user interface is displayed on a display of an electronic device associated with a user, receiving sensor data from one or more sensors of the electronic device or from a head-wearable device worn by the user that is in communication with the electronic device. The method includes determining, based at least in part on the sensor data from the one or more sensors, whether an augmented-display criterion is satisfied for the electronic device, and, in accordance with a determination that the augmented-display criterion is satisfied, causing presentation, via a display of the head-wearable device, of an augmented representation of the user interface.

Systems and methods for coordinating operation of a head-wearable device and an electronic device to assist a user in interacting with the electronic device

Methods of interpreting in-air hand gestures based on orientations of a wrist-wearable device are provided. The method includes receiving, from sensors of a wrist-wearable device, data associated with performance of an in-air hand gesture during a first period of time. The method includes, when determining the data indicates that the wrist-wearable device had a first orientation when the in-air hand gesture was performed during the first period of time, causing performance of a first operation. The method includes receiving, from sensors of the wrist-wearable device, new data associated with performance of the in-air hand gesture during a second period of time, the second period of time being after the first period of time. The method includes, when determining that the new data indicates that the wrist-wearable device had a second orientation when the in-air hand gesture was performed during the second period of time, causing performance of a second operation.

Systems for interpreting thumb movements of in-air hand gestures for controlling user interfaces based on spatial orientations of a user's hand, and method of use thereof

Growing community of inventors

Seattle, WA, United States of America

Szeyin Lee