Queen's University at Kingston

Other

Huawei Technologies Co., Limited

Roel Vertegaal

Jeffrey S Shell

Changuk Sohn

Daniel Cheng

Victor MacFarlane

Zheng Liu

Jin Tang

Yuanhao Yu

Yang Wang

Sean Brian Braley

Rasoul Mohammadi Nasiri

David Holman

Hisham El-halabi

Aneesh Pradyumna Tarun

Paul Strohmeier

Hisham Elhalabi

Conner Dickie

Zhenhao Li

Devices, methods, and processor-readable media for eye tracking using statistically derived linear functions are described. Two simple linear functions may be identified, one for the horizontal and one for the vertical, with two parameters each, that fully correct for horizontal and vertical estimation bias error in a cross-ratio gaze estimation method. An implicit calibration step may be performed that finds the parameters of said linear functions statistically based on undirected user point of gaze measurements that indicate the extremities of the error between gaze vectors and glint vectors. Various hardware devices are described that may implement the novel eye tracking techniques.

Systems, methods, and media for eye tracking using statistically derived linear functions

A system and a method for performing 2D on-screen user gaze estimation using an input facial image of a user captured using a camera associated to a processing device having a display. The method and system allow automated user calibration through automatic recording of calibration samples each including a calibration facial image of the user and an interaction point corresponding to a point on the display where an occurrence of a user interaction was detected when the corresponding calibration image was captured. The system and method also optimize user-specific parameters using the calibration samples by iteratively minimizing a total difference between the interaction points of a plurality of the calibration samples and corresponding 2D gaze estimation results and convert an estimated 3D gaze direction into a 2D gaze estimation result corresponding to a point on the display, by applying the users-specific parameters.

System, method and storage medium for 2D on-screen user gaze estimation

This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.

Method and apparatus for communication between humans and devices

A flexible computing device with bend input and active haptic feedback that provides vibro-tactile sensations such as friction and resistance to a user. The sensations include vibrations that simulate a physical affordance of content displayed on the flexible computing device. In one embodiment the device is a smartphone.

Haptic rendering for a flexible computing device

Apparatus for displaying a plurality of electronic documents to a user. The apparatus comprising a desk having a plurality of proximity zones which comprise at least a first proximity zone which is close to a user of the apparatus and at least a second proximity zone which is further away from said user; at least one display device comprising a display for displaying one of said plurality of electronic documents and at least one sensing device for determining the proximity zone within which said at least one display device is located. The functionality of said display device is determined by the proximity zone within which it is located.

Computing apparatus for displaying a plurality of electronic documents to a user

The invention relates to a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system.

Interaction techniques for flexible displays

This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.

A method and apparatus for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries, or tracking of a cursor image on a screen by the subject through a known trajectory. One embodiment provides a method for tracking a user's eye gaze at a surface, object, or visual scene, comprising: providing an imaging device for acquiring images of at least one of the user's eves: modeling, measuring, estimating, and/or calibrating for the user's head position: providing one or more markers associated with the surface, object, or visual scene for producing corresponding glints or reflections in the user's eyes; analyzing the images to find said glints or reflections and/or the pupil: and determining eye gaze of the user upon a said one or more marker as indicative of the user's eye gaze at the surface, object, or visual scene.

Method and apparatus for calibration-free eye tracking

Apparatus and method for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries or the tracking of a cursor image on a screen by the subject through a known trajectory. One embodiment includes one uncalibrated camera for acquiring video images of the subject's eye(s) and optionally having an on-axis illuminator, and a surface, object, or visual scene with embedded off-axis illuminator markers. The off-axis markers are reflected on the corneal surface of the subject's eyes as glints. The glints indicate the distance between the point of gaze in the surface, object, or visual scene and the corresponding marker on the surface, object, or visual scene.

Growing community of inventors

Battersea, Canada

Roel Vertegaal