Apple Inc.

Nicolas Pierre Marie Frederic Bonnier

Can Jin

Andrew B Watson

Jiaying Wu

Yashas Rai Kurlethimar

Hao Pan

Chaohao Wang

Peter F Holland

Mahesh B Chappalli

Yang Li

Alexandre Chapiro

Mehmet N Agaoglu

Yi-Pai Huang

Vincent Z Young

Pretesh A Mascarenhas

An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

Recovery from eye-tracking loss in foveated displays

In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.

Peripheral luminance or color remapping for power saving

An electronic device may include a display panel with pixels that present an image based on image data and an application processor that generates the image data. The electronic device may include a display pipeline coupled to the electronic display and the application processor. The display pipeline may receive first image data from the application processor corresponding to a first color space used by the application processor. The display pipeline may apply a color mapping relationship to the first image data to generate second image data. The color mapping relationship may define a transform to apply to the first image data to generate the second image data corresponding to a second color space used by the electronic display. The display pipeline may transmit the second image data to a display driver that operates the electronic display to emit light according to the second image data.

Efficient color mapping systems and methods

A multi-layer low-pass filter is used to filter a first frame of video data representing at least a portion of an environment of an individual. A first layer of the filter has a first filtering resolution setting for a first subset of the first frame, while a second layer of the filter has a second filtering resolution setting for a second subset. The first subset includes a data element positioned along a direction of a gaze of the individual, and the second subset of the frame surrounds the first subset. A result of the filtering is compressed and transmitted via a network to a video processing engine configured to generate a modified visual representation of the environment.

Gaze direction-based adaptive pre-filtering of video data

Growing community of inventors

Campbell, CA, United States of America

Nicolas Pierre Marie Frederic Bonnier