Apple Inc.

Teun R Baar

Alan C Dye

Nicolas P Bonnier

Jiaying Wu

Marc Albrecht

Ramin Samadani

Mahesh B Chappalli

Tobias Jung

Adria Fores Herranz

Paul Stephen Drzaic

Graham R Clarke

Andre Souza Dos Santos

Behkish J Manzari

Ian C Hendry

Paul M Hubel

Garrett M Johnson

Mani Amini

ByoungSuk Kim

Nathaniel C Begeman

Yifan Zhang

Sean C Chang

David S Zalatimo

Samir Gehani

Tae-Wook Koh

Christina G Gambacorta

Gregory B Abbas

Zuo Xia

Victor M De Araujo Oliveira

André Souza Dos Santos

Johnnie Behkish Manzari

The present disclosure generally relates to user interfaces for displaying representations of media (an image, video).

User interfaces for managing media

Systems, methods, and devices are provided to reduce a likelihood of image burn-in on an electronic display. Such an electronic device may include image processing circuitry and an electronic display. The image processing circuitry may receive image data and analyze the image data for risk of image burn-in and, based at least in part on the analysis of the image data, reduce a risk of image burn-in at least in part by reducing a local maximum pixel luminance value in at least one of a plurality of regions of the image data over time or by reducing a dynamic range headroom of the image data. The electronic display may display the image data with a reduced risk of image burn-in on the pixels of the electronic display.

Electronic display burn-in detection and mitigation

Aspects of the subject technology relate to display circuitry for displaying both standard dynamic range (SDR) and high dynamic range (HDR) content with an HDR display. The subject technology provides a headroom-based transfer function that maintains the contrast of the SDR content whether the display is operated in the SDR or HDR mode.

Standard and high dynamic range display systems and methods for high dynamic range displays

An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.

Electronic device with adaptive display

An electronic device may be provided with a display. A content generator such as a camera may capture images in high dynamic range mode or standard dynamic range mode. The images may have associated image metadata such as face detection information, camera settings, color and luminance histograms, and image classification information. Control circuitry in the electronic device may determine tone mapping parameters for the captured images based on the image metadata. The tone mapping parameters for a given image may be stored with the image in the metadata file. When it is desired to display the image, the control circuitry may apply a tone mapping process to the image according to the stored tone mapping parameters. The algorithm that is used to determine tone mapping parameters based on image metadata may be based on user preference data gathered from a population of users.

Tone mapping techniques for increased dynamic range

An electronic device may be provided with a display. Standard and high dynamic range content may be produced by content generators operating on control circuitry. Standard dynamic range content and high dynamic range content may be simultaneously displayed. Tone mapping parameters may be produced by a tone mapping engine for use in displaying the standard and high dynamic range content. The tone mapping parameters may be selected based on factors such as ambient light level, user brightness setting, content statistics, display characteristics, point of gaze information, power consumption information, and per-window information. Tone mapping parameters may be selected to accommodate simultaneous display of standard and high dynamic range content. Tone mapping parameters may be temporarily modified in response to a user's point of gaze switching between standard dynamic range content and high dynamic range content.

Electronic devices with dynamic control of standard dynamic range and high dynamic range content

An electronic device may be provided with a display. A content generator may generate frames of image data to be displayed on the display. Control circuitry in the electronic device may be used in implementing a tone mapping engine. The tone mapping engine may display content from the content generator on the display in accordance with a content-luminance-to-display luminance mapping. The content-luminance-to-display-luminance mapping is characterized by tone mapping parameters such as a black level, a reference white level, and a specular white level. The tone mapping engine may adjust the tone mapping parameters based on ambient light levels, user brightness settings, content statistics, and display characteristics.

Electronic devices with tone mapping engines

An electronic device may be provided with a display. The display may include a backlight having an array of locally dimmable light sources. Control circuitry may provide control signals to the backlight to produce light at different brightness levels. When the brightness level is below a threshold, the control circuitry may use pulse-width-modulation control signals to control the light sources in the backlight. When the brightness level is above the brightness threshold, the control circuitry may use analog control signals to control the light sources in the backlight. The control circuitry may adjust the threshold to achieve different dimming ranges for different brightness settings. A low brightness setting, for example, may have a lower threshold and lower dimming range than a high brightness setting, which may help produce darker darks when the display operates in a low brightness setting.

Backlights with dynamic dimming ranges

An electronic device may be provided with a display. Standard and high dynamic range content may be produced by content generators operating on control circuitry. In a first mode of operation, standard dynamic range content is displayed. In a second mode of operation, high dynamic range content is displayed. In a third mode of operation, standard dynamic range content and high dynamic range content are simultaneously displayed. Tone mapping parameters may be produced by a tone mapping engine for use in displaying the standard and high dynamic range content. The tone mapping parameters may be selected based on factors such as ambient light level, user brightness setting, content statistics, and display characteristics. Tone mapping parameters may be selected to accommodate simultaneous display of standard and high dynamic range content and to accommodate transitions between standard and high dynamic range content.

Electronic devices with tone mapping to accommodate simultaneous display of standard dynamic range and high dynamic range content

Systems, methods, and computer readable media to improve the operation of electronic display systems. Techniques for inverse tone mapping operations for selected standard dynamic range (SDR) images are described. The converted images may be presented on high dynamic range (HDR) displays so as to increase a user's viewing experience (through an expanded dynamic range) while preserving the artistic content of the displayed information. Techniques disclosed herein selectively transform SDR images to HDR images by determining if the SDR images were created from HDR images (e.g., through the fusion of multiple SDR images) and if their quality is such as to permit the conversion without introducing unwanted visual artifacts. The proposed techniques apply a sigmoidal inverse tone mapping function configured to provide a perceptual-based tone mapping. Values for the function's tuning parameters may be set based on what may be determined about the original HDR-to-SDR mapping operation.

Perceptual tone mapping of SDR images for an HDR display

Growing community of inventors

San Francisco, CA, United States of America

Teun R Baar