Facebook Technologies, LLC

Nvidia Corporation

Meta Platforms Technologies, LLC

Microsoft Technology Licensing, LLC

Eric Michael Whitmire

Hrvoje Benko

Wolf Kienzle

David R Perek

Jan Kautz

David Patrick Luebke

Michael Stengel

Kaan Aksit

Ben Boudaoud

Laura Cristina Trutoiu

Eyal Ofek

Michael Jack Sinclair

Robert Dale Cavin

Christian Holz

Brian Michael Scally

Inrak Choi

Rajinder Sodhi

Andre Levi

Austin Lee

Farshid Salemi Parizi

A artificial-reality system, including an optional head-wearable device to display an artificial-reality environment and a wrist-wearable device, identifies and detects shapes of surfaces, and, optionally, the distances of surfaces from the wrist-wearable device, and makes operations, including haptic events, available to users by detecting gestures performed by the user, causing respective operations to be performed based on the type of gestures, and optionally, the distance of the wrist-wearable device from surfaces during performance of the gestures. For example, the wrist-wearable device can be configured to cause performance of a first set of operations corresponding to in-air gestures, which are performed within an in-air threshold distance of a surface, a second set of operations corresponding to near-surface gestures performed within a surface threshold distance of a surface. The operations can, for example, update the display at the optional head-wearable device, control device properties at other electronic devices, or respond to messages.

Systems for detecting in-air and surface gestures available for use in an artificial-reality environment using sensors at a wrist-wearable device, and methods of use thereof

A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.

Systems and methods for electric discharge-based sensing via wearables donned by users of artificial reality systems

A gaze tracking system for use by the driver of a vehicle includes an opaque frame circumferentially enclosing a transparent field of view of the driver, light emitting diodes coupled to the opaque frame for emitting infrared light onto various regions of the driver's eye gazing through the transparent field of view, and diodes for sensing intensity of infrared light reflected off of various regions of the driver's eye.

Driver gaze tracking system for use in vehicles

An apparatus for directional acoustic sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The wearable may include a signal generator that propagates an acoustic wave via a body of the user toward a specific body part. The wearable may also include an acoustic sensor that detects an acoustic reflection of the acoustic wave propagated by the signal generator. The wearable may further include at least one processing device that is communicatively coupled to the acoustic sensor. The processing device may determine that the specific body part has made physical contact with an object based at least in part on the acoustic reflection. In response, the processing device may generate an input command for the artificial reality system that accounts for the specific body part making physical contact with the object. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for directional acoustic sensing via wearables donned by users of artificial reality systems

The disclosed wrist-tracking apparatus includes (1) a wristband dimensioned to be donned on a wrist of a user of an artificial reality system and (2) a set of Time of Flight (ToF) sensors coupled to the wristband, wherein each of the ToF sensors comprises (A) an emitter that emits a modulated pulse of energy, (B) a receiver that facilitates detecting a reflection of the modulated pulse of energy, and (C) a processing circuit communicatively coupled to the emitter and the receiver, wherein the processing circuit calculates a time of flight for the modulated pulse of energy based at least in part on the modulated pulse of energy and the reflection. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for wrist tracking and gesture detection via time of flight sensors

A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface within an environment occupied by the user. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface within the environment. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.

A gaze tracking system for use in head mounted displays includes an eyepiece having an opaque frame circumferentially enclosing a transparent field of view, light emitting diodes coupled to the opaque frame for emitting infrared light onto various regions of an eye gazing through the transparent field of view, and diodes for sensing intensity of infrared light reflected off of various regions of the eye.

Gaze tracking system for use in head mounted displays

A system for subvocalized speech recognition includes a plurality of sensors, a controller and a processor. The sensors are coupled to a near-eye display (NED) and configured to capture non-audible and subvocalized commands provided by a user wearing the NED. The controller interfaced with the plurality of sensors is configured to combine data acquired by each of the plurality of sensors. The processor coupled to the controller is configured to extract one or more features from the combined data, compare the one or more extracted features with a pre-determined set of commands, and determine a command of the user based on the comparison.

Subvocalized speech recognition

A controller is provided that can provide haptic feedback to a user by controlling a separation of a stationary portion and a moveable portion, such as a moveable arm, which can include one or more mounts for one or more of a user's fingers. A sensor can be included on the stationary portion to sense whether the user's thumb is proximate a thumb rest. Different haptic interaction modes can be set depending on whether the user's thumb is not proximate the sensor, such as a touch mode, or is proximate the sensor, such as a grasping or trigger mode. When grasping and trigger modes are provided, they can be determined based on the nature of a virtual object grasped by a user. Additional haptic sensations can be provided, such as to a user's fingertip, such as by a vibratory component or a rotatable object of one or more haptic elements.

Controller with haptic feedback

A wearable eye tracking system includes a pair of looping coils in a Helmholtz configuration and an additional looping coil. In one configuration, areas enclosed by the pair of looping coils in the Helmholtz configuration are in parallel with each other, while an area enclosed by the additional looping coil is offset from (i.e., not parallel with) the areas enclosed by the pair of looping coils. In this configuration, the pair of looping coils generates uniform magnetic fields between the two areas of the pair of looping coils in a first direction orthogonal to the areas of the pair of looping coils, and the additional looping coil generates additional non-uniform (or divergent) magnetic fields in a second direction transversal to the first direction.

Growing community of inventors

Seattle, WA, United States of America

Eric Michael Whitmire