Valve Corporation

Scott Douglas Nietfeld

Jeffrey George Leinbaugh

Jeremy Slocum

Jeffrey Walter Mucha

Eric James Hope

Scott Richard Britt

Lawrence Yuan Yang

Philip Bryan

Carl Conlee

Claire Michelle Gottschalk

Keith Bradner

Jeffrey Peter Bellinghausen

Scott Dalton

Ian Campbell

Cheang Tad Yoo

Joe Van Den Heuvel

Michael Baseflug

Carl Samuel Conlee, Iv

Walter Petersen

Eric Judson VanWyk

Evan Fletcher

Calibration for eye tracking calibration in a head-mounted display can refined during use by tracking head rotation of a user during a time period while the head-mounted display is worn by the user, tracking eye rotation of the user during the time period, comparing the eye rotation of the user to the head rotation of the user during the time period, and refining a calibration state of eye tracking for the head-mounted display based on comparing the eye rotation of the user to the head rotation of the user during the time period.

Eye tracking

Techniques and devices for determining how to present the release of the virtual object based at least in part on received sensor data is described herein. For example, when the hardware and/or software determines that the virtual object is to be released, the hardware and/or software may calculate one or more of a velocity of the object (e.g., speed and direction), a position at which the virtual object is to be released, a trajectory of the virtual object from the position of release to the landing point of the virtual object, a landing location of the virtual object, and/or the like. The hardware and/or software may then present the virtual object being released according to this determined information.

Holding and releasing virtual objects

A method including receiving at least one of touch data or force data representing a touch input received at the controller, determining one or more model(s), generating image data using the one or more models, the image data representing at least a hand gesture corresponding to the touch input received at the controller, and transmitting the image data to a virtual reality (VR) environment for display.

Virtual reality hand gesture generation

The logic of a handheld controller system may use a clustering algorithm to determine which sensors of a touch sensor array, such as capacitive pads, to assign to individual fingers of a user's hand. The clustering algorithm disclosed herein allows for dynamically determining the controller configuration on-the-fly for a given user. An example process includes receiving data generated by a plurality of sensors of a touch sensor array of the handheld controller, generating a covariance matrix that indicates correlations between pairs of sensors, determining a plurality of feature vectors based at least in part on the covariance matrix, each feature vector corresponding to an individual sensor and describing that sensor's correlation(s) with one or more other sensors, clustering the feature vectors using a clustering algorithm, and configuring the touch sensor array according to a controller configuration that assigns sensors to respective fingers of a hand.

Cluster-based sensor assignment

A method including determining a range of values for a proximity sensor, receiving proximity data from the proximity sensor, decaying a limit associated with a maximum value, decaying a limit associated with a minimum value, determining a range of values detected by the proximity sensor, and determining an updated scale factor for the proximity sensor.

Continuous controller calibration

A controller for an electronic system includes a tracking member fixed to a controller body. The controller body has a head that adjoins a handle at a neck region, and that includes at least one thumb-operated control. The controller includes a hand retainer that in a closed position is configured to physically bias the user's palm against an outer surface of the handle. The hand retainer includes a resilient member that biases the hand retainer towards an open position. The resilient member is attached to an anchor that is attached to the head by an adjustment mechanism that permits the resilient member to be moved towards or away from the user's purlicue. The tracking member includes transducers that are coupled to the electronic system by electromagnetic radiation. Proximity sensors, spatially distributed on the handle, are responsive to a proximity of the user's fingers to the outer surface of the handle.

Electronic controller with finger sensing and an adjustable hand retainer

Techniques and devices for holding and releasing virtual objects on a display based on input received from one or more handheld controllers are described herein. In some instances, a handheld controller includes one or more sensors, such as proximity sensors, force sensors (e.g., force resisting sensors, etc.), accelerometers, and/or other types of sensors configured to receive input from a hand of a user gripping the handheld controller. Hardware, software, and/or firmware on the controller and/or on a device coupled to the controller (e.g., a game console, a server, etc.) may receive data from these sensors and generate a representation of a corresponding gesture on a display, such as a monitor, a virtual-reality system, and/or the like.

Logic of a handheld controller can implement sensor fusion algorithms based on force data provided by a force sensing resistor (FSR) in combination with touch data or proximity data provided by a touch sensor or an array of proximity sensors, respectively. An example sensor fusion algorithm can be used to re-calibrate the FSR when an object contacts an associated control, as detected by the touch sensor. Another example sensor fusion algorithm can be used to ignore spurious inputs detected by the FSR when an object is in contact with an adjacent control. Another example sensor fusion algorithm can be used to detect a hand size of a hand grasping a handle of the controller, as detected by the array of proximity sensors, and to adjust the threshold force to register a FSR input event at the FSR according to the hand size.

Sensor fusion algorithms for a handheld controller that includes a force sensing resistor (FSR)

A controller for an electronic system includes a controller body having a handle portion, a tracking arc that is fixed to the controller body, and a hand retainer configured to physically bias a user's palm against an outside surface of the handle portion. A plurality of tracking sensors is disposed in the tracking arc, and are responsive to electromagnetic radiation emitted by the electronic system. An array of proximity sensors are spatially distributed around the outer surface of the handle portion, and are responsive to a proximity of the user's fingers to the outside surface of the handle portion.

Electronic controller with hand retainer and finger motion sensing

A method including receiving data corresponding to one or more objects in proximity to the controller, determining scores for controller configurations of the controller, ranking the scores of controller configurations, selecting a controller configuration among the controller configurations, and configuring a touch sensor of the controller according to a selected controller configuration.

Dynamic sensor assignment

An electronic controller includes a controller body having a head that adjoins a handle at a neck region, and that includes at least one thumb-operated control. The controller includes a hand retainer that in a closed position is configured to physically bias the user's palm against an outer surface of the handle. The hand retainer includes a resilient member that biases the hand retainer towards an open position. An adjustment mechanism couples the resilient member to the head and permits the resilient member to be adjusted betweena plurality of discrete positions to adjust the resilient member towards or away from the user's purlicue. The adjustment mechanism may include an anchor that is movable peripherally about the head between the plurality of discrete positions and is pivotably attached to the resilient member with a two-part fastener, with a friction member interposed between the resilient member and the anchor.

Growing community of inventors

Bellevue, WA, United States of America

Scott Douglas Nietfeld