Microsoft Technology Licensing, LLC

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Other

University of California

Hrvoje Benko

Andrew David Wilson

Kenneth Paul Hinckley

Wolf Kienzle

Shahram Izadi

Eyal Ofek

David R Perek

Aakar Gupta

Stephen Edward Hodges

Tristan Thomas Trutna

Daniel John Wigdor

Yanjun Ma

Sean Jason Keller

David Alexander Butler

Meredith June Morris

Steven Nabil Bathiche

Michael Jack Sinclair

Patrick Markus Baudisch

Michel Pahud

Nicolas Villar

Christian Holz

Daniel Allen Rosenfeld

John Helmes

Eric Michael Whitmire

William Ben Kunz

Tanya Renee Jonker

Eric J Horvitz

Desney S Tan

Daniel Chaim Robbins

Raymond King

Shiu Sang Ng

Ian Sands

Zhengyou Zhang

Tovi Samuel Grossman

Philip Andrew Chou

Billy P Chen

Paul Henry Dietz

Neil Scott Fishman

Ravin Balakrishnan

Sean Edwin Trowbridge

Pourang Polad Irani

Francois Guimbretiere

John Lawrence Miller

Donald Marcus Gillett

Shawn R LeProwse

Ken Hinckley

Majed Jamal Samad

Yon Visell

Marcello Giordano

Stephanie Santosa

Rorik Henrikson

Yitian Shao

Bharat Dandu

Neil Weiss

Yu-Te Wang

Björn U Hartmann

Stephen G Latta

Anoop Gupta

Kevin Geisner

Jonathan Westhues

Kurt Jenkins

Andreas Georg Nowatzyk

Christopher Harry Stoumbos

Ali Israr

F David Jones

Nicholas Colonnese

Michael Glueck

Xiang Cao

Edward Bryan Cutrell

Andrew Stanley

Priyanshu Agarwal

Ting Zhang

Chris Harrison

V Kevin Russ

Peter John Ansell

Robert W Young

Bo Robert Xiao

Massimiliano Di Luca

Timothy Scott Saponas

Evan Matthew Pezent

Shea Jonathan Robinson

Paul Armistead Hoover

Julia Schwarz

John C Tang

Richard Malcolm Banks

Gina Danielle Venolia

Daniel Morris

Aleksandar Uzelac

Sasa Junuzovic

Weidong Zhao

Vivek Pradeep

Gavin Jancke

Benjamin LaFreniere

David Alan Stevens

Kori Inkpen Quinn

Jay P Kapur

Aaron C Hoff

Inrak Choi

Joseph Davis Greer

Jarrod Knibbe

The disclosed computer-implemented method may include capturing, by a computing device, a current position of a wearable device and a current position of user eye gaze at a current time. The method may also include determining that a user eye gaze is at a fixation position based on a speed of gaze movement. Additionally, the method may include calculating a direction of cursor movement by comparing a current cursor position with a previous cursor position at a previous time. Furthermore, the method may include calculating a likelihood of the fixation position being a target cursor position based on a difference between the direction of cursor movement and a direction from the current cursor position to the fixation position. Finally, the method may include increasing a speed of cursor movement toward the fixation position based on the likelihood. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for gaze-assisted gesture control

The disclosed system may include (1) a processor that generates an artificial environment that includes a virtual object, (2) a display that presents the artificial environment, (3) an input subsystem that detects tracks positioning of a body, and (4) a plurality of haptic actuators that are arranged to apply haptic feedback to a first plurality of locations on the body, where the processor (a) determines, based on the positioning of the body, a virtual contact of one of a second plurality of locations on the body with the virtual object, where the second plurality of locations is different from the first plurality of locations, and (b) activates, in response to the virtual contact, at least one of the plurality of haptic actuators based on a mapping of the second plurality of locations to the plurality of haptic actuators. Various other systems and methods are also disclosed.

Spatially offset haptic feedback

The disclosed system may include a support structure dimensioned for a user's hand. The system may also include transmitting electrodes coupled to a first finger portion of the support structure and may further include receiving electrodes coupled to a second, different finger portion of the support structure. The system may also include a controller that is coupled to the support structure and that is communicatively connected to the transmitting and receiving electrodes. The controller may also be configured to cause the transmitting electrodes to transmit a signal, detect at least some of the transmitted signal at the receiving electrodes and, based on the detected signal, determine that at least two fingers of the user's hand are touching each other. Various other methods, systems, and computer-readable media are also disclosed.

Finger pinch detection

The disclosed computer-implemented method may include (1) receiving information associated with a real-time output of a recognition model adapted to recognize at least one behavior of a user, (2) determining, based on the information, a level of uncertainty associated with the real-time output, (3) modulating at least one attribute of feedback based on the level of uncertainty, and (4) presenting the feedback to the user substantially contemporaneous with the real-time output of the recognition model. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for communicating recognition-model uncertainty to users

An electronic device tracks, for a user performing a target acquisition movement within a 3D space, movement parameters of a plurality of input devices of the user. The electronic device predicts, for the user, a region of interest within the 3D space, based on the movement parameters. The region of interest includes a plurality of targets in close proximity. The electronic device predicts an endpoint of the target acquisition movement, within the region of interest. In some embodiments, the plurality of input devices includes an eye tracking input device, each input device corresponds to a predefined input device type, and the movement parameters include gaze data from the eye tracking input device. In some embodiments, input devices includes an eye tracking input device, a head-mounted display, and a hand-held controller, and the user's eye, hand, and head movements are coordinated.

Multimodal kinematic template matching and regression modeling for ray pointing prediction in virtual reality

A system for vibration-driven sensing may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include a vibration sensor that is incorporated into the wearable and generates an electrical response that corresponds to a vibration detected at the wearable. The system may further include at least one processing device communicatively coupled to the vibration sensor. The processing device may determine, based at least in part on the electrical response generated by the vibration sensor, that the user has made a specific gesture with at least one body part. In response to this determination, the processing device may generate an input command for the artificial reality system based at least in part on the specific gesture made by the user. Various other systems and methods are also disclosed.

Systems and methods for sensing gestures via vibration-sensitive wearables donned by users of artificial reality systems

The disclosed computer-implemented method may include detecting, by a computing system, a gesture that appears to be intended to trigger a response by the computing system, identifying, by the computing system, a context in which the gesture was performed, and adjusting, based at least on the context in which the gesture was performed, a threshold for determining whether to trigger the response to the gesture in a manner that causes the computing system to perform an action that is based on the detected gesture.

Systems and methods for adaptive input thresholding

A system may include a wearable dimensioned to be donned by a user of an artificial reality system. The system may also include an energy measuring device incorporated into the wearable. The energy measuring device may measure an electrical energy differential between a body of the user and a surface. The system may further include at least one processing device communicatively coupled to the energy measuring device. The processing device may detect, based at least in part on the electrical energy differential measured by the energy measuring device, an interaction between the user and the surface. In response to this detection, the processing device may generate an input command for the artificial reality system based at least in part on the interaction detected between the user and the surface. Various other systems and methods are also disclosed.

Systems and methods for electric discharge-based sensing via wearables donned by users of artificial reality systems

The disclosed wearable may include (1) a plurality of electrodes dimensioned to interface with a skin surface of a user of an artificial reality system, wherein the electrodes are spaced a known distance from one another, (2) a signal generator communicatively coupled to one of the electrodes, wherein the signal generator injects a test signal into the skin surface of the user via the one of the electrodes, (3) at least one sensor communicatively coupled to another one of the electrodes, wherein the sensor measures the test signal as received by the another one of the electrodes, and (4) at least one processing device communicatively coupled to the sensor, wherein the processing device determines a current impedance of the skin surface based at least in part on the known distance and the measurement of the test signal. Various other systems and methods are also disclosed.

Systems and methods for calibrating wearables based on impedance levels of users' skin surfaces

An example method of identifying a touch gesture on a user is provided. The method includes receiving, by one or more transducers of a wearable device, a set of signals that establish a signal pathway to the wearable device. The method also includes, while receiving the set of signals, determining baseline characteristics for the signal pathway, and sensing a change in the baseline characteristics caused by user interaction with an affordance of a user interface projected or perceived on the user's appendage. The method further includes, in accordance with a determination that the sensed change in the baseline characteristics satisfies a contact criterion, reporting a candidate touch event on the user's appendage to a separate electronic device that creates the user interface or is in communication with another electronic device that creates the user interface.

Methods, devices, and systems for displaying a user interface on a user and detecting touch gestures

A method creates haptic stimulations on a user of an artificial reality system. The system includes a head-mounted display (HMD) and a wearable device. The HMD includes a display and speakers. The wearable device includes a plurality of transducers that can each generate waves to provide haptic feedback to a user. The system displays media content on the display and, in accordance with the displayed media content, determines a virtual object location in the displayed media content corresponding to a physical object location. The system provides, to the user, audio directed to the virtual object location. The system activates one or more transducers to provide haptic feedback at a target location on the user, distinct from the physical object location, to produce haptic feedback whose perceptual interpretation is at the physical object location based on a combination of the displayed media, the provided audio, and the haptic feedback.

Methods, devices, and systems for modifying perceived haptic stimulations on a user

A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.

Wearable device and user input system for computing devices and artificial reality environments

A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.

Apparatus for use in a virtual reality system

Growing community of inventors

Seattle, WA, United States of America

Hrvoje Benko