Huawei Technologies Co., Limited

Sean Brian Braley

Roeland Petrus Hubertus Vertegaal

Calvin John Rubens

Roel Vertegaal

Hisham El-halabi

A method of interacting with digital objects in a database associated with physical objects in an external environment includes tracking, by a camera on the headset, a gaze of a user in the external environment. identifying a gaze condition in response to determining the gaze of the user is directed to a physical object of interest in the external environment for at least a predetermined dwell-time, receiving a user input associated with the headset, and activating a digital interaction in response to identifying the gaze condition and receiving the user input, wherein the digital interaction relates to the physical object of interest in the database. Systems for performing the method may include a head mounted frame including a headset camera and a microphone as well as a processing unit. A unit for communicating with other computing resources may also be included.

Methods and systems for interacting with digital objects using a gaze tracking-enabled headset

A computer implemented method and system for gaze-assisted input that includes displaying a plurality of display elements in a display space, tracking a user's point of gaze within the display space, receiving a speech input, identifying one of the plurality of display elements as a subject display element for the speech input based on the tracking, and automatically performing an action based on the subject display element and the speech input.

Gaze assisted input for an electronic device

Methods and devices are described that enable user interactions using a combination of gaze input and touch input. During display of interactive elements on a display of an electronic device, an estimated gaze location of a gaze input is determined. A target interactive element is identified based on the estimated gaze location. Touch input is detected that traverses a first distance in a first direction. A preview of information related to the target interactive element is displayed, where an amount of the information displayed in the preview is based on the first distance traversed by the touch input.

Methods and devices for interactions using combination gaze and touch inputs

Devices, methods, and processor-readable media for eye tracking using statistically derived linear functions are described. Two simple linear functions may be identified, one for the horizontal and one for the vertical, with two parameters each, that fully correct for horizontal and vertical estimation bias error in a cross-ratio gaze estimation method. An implicit calibration step may be performed that finds the parameters of said linear functions statistically based on undirected user point of gaze measurements that indicate the extremities of the error between gaze vectors and glint vectors. Various hardware devices are described that may implement the novel eye tracking techniques.

Systems, methods, and media for eye tracking using statistically derived linear functions

Methods and systems are described for estimating an optimal pupil binarization threshold using adaptive binarization thresholding. The disclosed methods and systems are designed to determine a pupil binarization threshold from a histogram of an eye image. An eye image is obtained and an eye image histogram is computed from the eye image. A pupil region and an iris region are identified in the eye image histogram and the second derivative of the eye image histogram is computed. The pupil binarization threshold is determined based on the second derivative of the eye image histogram, the identified pupil region and the identified iris region and then used to generate a binarized eye image. A pupil contour may be determined from the binarized eye image. The disclosed system may help to overcome challenges associated with robust and precise detection of a pupil contour, for example, in images of varying quality.

Growing community of inventors

Orillia, Canada

Sean Brian Braley