Dolby Laboratories Licensing Corporation

Apple Inc.

Meta Platforms Technologies, LLC

Alexandre Chapiro

Robin Atkins

Scott J Daly

Ajit Ninan

Nicolas P Bonnier

Chun Chi Wan

Chaitanya Atluru

Haricharan Lakshman

Jonathan C Moisant-Thompson

Shane Mario Ruggieri

William Rozzi

Chaohao Wang

Yang Li

Jaclyn Anne Pytlarz

David Andrew Doyle

Andrew B Watson

Ove Lyngnes

Bennett S Wilburn

Mehmet N Agaoglu

Yi-Pai Huang

Nicolas Pierre Marie Frederic Bonnier

Elizabeth G Pieri

Pretesh A Mascarenhas

Seth E Hunter

Guillaume Lestoquoy

Jackson K Roland

Jean-Charles Bazin

One or more media contents are received. A viewer's light adaptive states are predicted as a function of time as if the viewer is watching display mapped images derived from the one or more media contents. The viewer's light adaptive states are used to detect an excessive change in luminance in a specific media content portion of the one or more media contents. The excessive change in luminance in the specific media content portion of the one or more media contents is caused to be reduced while the viewer is watching one or more corresponding display mapped images derived from the specific media content portion of the one or more media contents.

Luminance adaption to minimize discomfort and improve visibility

In holographic calling, it is difficult to capture the eyes of a caller due to lighting effects on an artificial reality (XR) headset. However, it can be important to capture the eyes when rendering the caller as they can show emotion, gaze, physical characteristics, etc., that aid in natural communication. Thus, implementations can capture the eyes of the caller using an external image capture device by briefly turning off the lighting effects on the XR headset. Some implementations can trigger the image capture device to capture an image of the eyes by temporal multiplexing in which timers on both the image capture device and the XR headset are synchronized. In other implementations, the image capture device can be an event-based camera that is automatically triggered to capture an image of the eyes based on a detected pixel change caused by deactivation of the lighting effects on the XR headset.

Authentic eye region capture through artificial reality headset

An eye tracking technique obtains a more precise estimate of a gaze location on an image by determining the vergence location of a user's eyes. The more precise estimate of the gaze location may be obtained by using multiple inputs, including a coarse estimate of the gaze location using a camera that receives non-visible light reflected from the eyes, discrete probabilities of gaze locations for each eye, depth information for objects contained in the image, and saliency information for objects contained in the image.

Eye tracking based on vergence

In an embodiment, an electronic device includes a display and an eye tracker. The display includes one or more foveated areas. In the embodiment, the eye tracker is configured to collect eye tracking data regarding a gaze of one or more eyes of a user on the display. The electronic device also includes processing circuitry operatively coupled to the display. In the embodiment, the processing circuitry is configured to receive an indication of a motion associated with the gaze from the eye tracker. The processing circuitry is also configured to determine a previous location associated with the gaze during a previous frame and a target position associated with the gaze during a target frame. In the embodiment, the processing circuitry is configured to expand one or more foveated areas of the display adjacent a previous position of the gaze of the user.

Peripheral luminance or color remapping for power saving

Eyewear such as sunglasses may include display-optimized lenses. The lenses may be optimized for viewing an external display and/or for viewing a display in the head-mounted device while also providing sun protection for the user's eyes. The lenses may include a polarizer and a color filter that are designed for a given target display. Lenses that are optimized for a display that emits linearly polarized light may include a linear polarizer. Lenses that are optimized for a display that emits circularly polarized light may include a circular polarizer. The circular polarizer may include a quarter wave plate and a linear polarizer. The color filter may have a transmission spectrum curve with peaks corresponding to the primary colors of the target display so that the color and brightness of display light is preserved while the brightness of sunlight is reduced.

Eyewear with display-optimized lenses

An electronic device such as a watch may include a display and a light sensor located behind the display. The light sensor may be used to measure the color of external objects. During color sampling operations, the display may emit light towards the external object in front of the display while the light sensor gathers color measurements. The display may emit light of different colors and the light sensor may detect an amount of reflected light for each color, which in turn may be used to determine the color of the external object. The control circuitry may use a watch-band-specific algorithm to determine the color of watch bands and may use a clothing-specific algorithm to determine the color of clothing. The control circuitry may display the color on the display so that the face of the watch matches the user's clothing or matches the user's watch band.

Electronic devices with color sampling sensors

Peripheral-vision expanded images are streamed to a video streaming client. The peripheral-vision expanded images are generated from source images in reference to view directions of the viewer at respective time points. View direction data is collected and received in real time while the viewer is viewing display images derived from the peripheral-vision expanded images. A second peripheral-vision expanded image is generated from a second source image in reference to a second view direction of the viewer at a second time point. The second peripheral-vision expanded image has a focal-vision image portion covering the second view direction of the viewer and a peripheral-vision image portion outside the focal-vision image portion. The second peripheral-vision expanded image is transmitted to the video streaming client.

Virtual reality cinema-immersive movie watching for headmounted displays

Methods for encoding and decoding high-dynamic range signals are presented. The signals are encoded in a high frame rate and are accompanied by frame-rate conversion metadata defining a preferred set of frame-rate down-conversion parameters, which are determined according to the maximum luminance of a target display, display playback priority modes, or judder control modes. A decoder uses the frame-rate conversion metadata to apply frame-rate down-conversion to the input high-frame-rate signal according to at least the maximum luminance of the target display and/or the characteristics of the signal itself. Frame-based and pixel-based frame-rate conversions, and judder models for judder control via metadata are also discussed.

Frame rate conversion metadata

Growing community of inventors

Sunnyvale, CA, United States of America

Alexandre Chapiro