Apple Inc.

Sensomotoric Instruments Gesellschaft Fur Innovative Sensorik Mbh

Aplle Inc.

Tom Sengelaub

Jan Hoffmann

Denis Williams

Eberhard Schmidt

Martin Haller

Hua Gao

Emanuele Mandelli

Qiong Huang

Edward Allen Valko

Keenan Molner

Hao Qin

Christian Villwock

Julia Benndorf

Walter Nistico

Branko Petljanski

Matthias Nieser

Andrei Nikiforov

Arnd Rose

Marvin Vogel

A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

Method and an apparatus for determining a gaze point on a three-dimensional object

The invention relates to a system and method to control a workflow comprising at least one task to be performed by a person (P), wherein information is provided about at least one certain object () related to the at least one task of the workflow, eye data () are captured of at least one eye of the person (P), and in dependency of the eye data () and the information about the at least one certain object () it is checked whether at least one task condition consisting in whether the task had been performed and/or whether the task is allowed to be performed is fulfilled. The invention also relates to a system and method for providing a set of task-specific control parameters (CP).

Method and system to control a workflow and method and system for providing a set of task-specific control parameters

Method for subsequently displaying a stream of images in a display area of a display device, wherein a first area within the display area is determined around a point of regard. A first image of the stream of images is displayed in the display area such that a first part of the first image, which is displayed in the first area, is displayed according to a first parameter value of at least one parameter and a second part of the first image, which is displayed in at least one second area outside the first area, is displayed according to a second parameter value of the at least one parameter. Moreover, the determining of the point of regard is performed as predicting the point of regard for a certain future point of time, at which the first image is displayed.

System and method for displaying a stream of images

Methods and apparatus for using polarized light (e.g., infrared (IR) light) to improve eye-related functions such as iris recognition. An eye camera system includes one or more IR cameras that capture images of the user's eyes that are processed to perform iris recognition, gaze tracking, or other functions. At least one polarizing element may be located in the path of the light which is used to capture images of the user's eye. The user's eye may be illuminated by IR light emitted by one or more LEDs. At least one of the LEDs may be an LED with a polarizing filter. Instead or in addition, at least one polarizer may be located at the eye camera sensor, in the eye camera optics, or as or in an additional optical element located on the light path between the eye camera and the user's eye.

Eye camera systems with polarized light

Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include eye tracking cameras and eye odometers that may reduce power consumption of the system. The eye odometers may be used as a low-power component to track relative movement of the user's eyes with respect to the HMD between frames captured by the eye tracking cameras, which may allow the frame rate of the eye tracking cameras to be reduced.

Eye tracking using eye odometers

Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.

Sensor fusion eye tracking

Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include eye tracking cameras. The eye tracking cameras may be used to capture low-resolution frames between capturing high-resolution frames, for example by binning pixels on the camera sensor or by capturing horizontal and vertical stripes or lines of pixels on the camera sensor rather than entire frames. This low-resolution information may be used to track relative movement of the user's eyes with respect to the device in intervals between the processing of full, high-resolution frames captured by the eye tracking cameras.

Eye tracking using low resolution images

Methods and apparatus for fabricating light-emitting diodes (LEDs) that include polarizing or wavefront-altering optical components are described in which additional optical components are added to the LED package to filter or modify the polarization of the emitted photons. Packaged LEDs that include polarizing or wavefront-altering optical components are also described. The packaged LEDs may emit infrared light that is polarized or otherwise altered by the optical components added during the fabrication process.

Light-emitting diodes with optical filters

Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include head odometers, eye odometers, or both head odometers and eye odometers to reduce power consumption of the system. Head odometers may be used to detect movement of the device with respect to the user's eyes, which may allow 3D reconstruction to generate 3D models of the user's eyes used in eye tracking to be performed only when movement of the device with respect to the user's eyes has been detected. Eye odometers may be used as a low-power component to track relative movement of the user's eyes with respect to the device between frames captured by the eye tracking cameras, which may allow the frame rate of the eye tracking cameras to be reduced.

Growing community of inventors

Berlin, Germany

Tom Sengelaub