Apple Inc.

Columbia University

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Tdone, LLC

Zhang Jia

Christopher S Erickson

Ioannis Kymissis

James Joseph Dudley

Nadia Pervez

Kenichi Nakajima

Ramesh Raskar

Matthew S Rogers

Naoto Matsuyuki

Jiaying Wu

Serhan O Isikman

Ahmad Byagowi

Marshall Cox

Farnaz Agahian

Chunji Li

Cheng Kai Chen

Brian Richards Land

James R Wilson

Kurt Jenkins

Shizhe Shen

David W Ritter

Ligang Wang

Zhen Zhang

Dong Zheng

Fabio Carta

Haomiao Jiang

Jiangtao Kuang

Tianbo Sun

Agnes Lee

Venkata Siva Sunil Kumar Reddy Bommu

Katherine Spriggs

William A Tashman

Giovanni Corradini

Amy M Winkler

Xiaobo Tian

Yongmin Park

Xueping Cheng

Embodiments of the present disclosure relate to a display assembly with color calibration for improving accuracy of displayed colors under thermal shifts. A data processing circuit of the display assembly determines color compensation coefficients corresponding to an operating temperature of a display panel, each color compensation coefficient accounting for a thermal shift of a respective color component at the operating temperature. The data processing circuit applies the color compensation coefficients to color transform elements corresponding to an initial temperature to determine a corrected version of the color transform elements corresponding to the operating temperature. The data processing circuit processes pixel values of color components in a first format associated with the display panel at the operating temperature by applying the corrected version of the color transform elements to generate corrected pixel values of the color components in a second format for presentation on the display panel at the operating temperature.

Real-time color conversion in display panels under thermal shifts

Systems and methods for an ambient light sensor (ALS) disposed under a display layer. In some implementations, an ALS reading is adjusted by compensating for light leakage in a display environment. In some aspects, a display leakage component may be determined based on image content driven onto a display pixel array during the ALS reading. An ambient light measurement may be generated by subtracting the display leakage component from the ALS reading and then adjusting a display brightness of the display pixel array in response to the ambient light measurement.

Systems and methods for ambient light sensor disposed under display layer

One embodiment includes a sequential spectral imaging system with a color filter disposed over imaging sensor. The color filter includes zones of multiple color elements of discrete or continuous spectra. The color filter is configured to have multiple cycles of wavelength bands along diagonal lines of the imaging sensor, each cycle of wavelength bands includes a full spectra from red to blue. Another embodiment combines an imaging sensor of a wide FOV with pixelated color filters and a spectra sensor of smaller FOV. A calibration technique acquires imaging sensor's spectral response. The sequential spectral imaging system acquires a sequence of continuous frames of spatial and spectral data during recording an object moving relatively to the camera. Multiple frames of the moving object are tracked sequentially. Image processing to correct distortion and extract features enables identification and tracking of the object. The object's full spectra is established by connecting different frames.

Sequential spectral imaging

An electronic device may be provided with one or more light-sensing components such as a camera and a color ambient light sensor. Optical structures such as camera lenses or a light pipe may be used to convey light from a window in an electronic device to a light-sensing component. One or more infrared-light-blocking-and-visible-light transmitting light filters may be interposed between a light-receiving window in an electronic device and a light-sensing component. The light filters may include infrared-light-blocking glass substrates, silver or other infrared-light-blocking thin films, and/or thin-film interference filters formed from stacks of dielectric layers that serve as infrared light-blocking layers.

Electronic devices with infrared blocking filters

An electronic device may have a housing in which a display is mounted. The display may have an active area in which images are displayed by an array of pixels and an inactive area that is free of pixels. A color ambient light sensor may make color and luminance measurements on ambient light received through an ambient light sensor window in the inactive area of the display or elsewhere in the electronic device. The color ambient light sensor may have color ambient light sensor elements of different colors. The ambient light sensor elements may extend in a row along an edge of the display or may have other configurations. Analog-to-digital converter circuitry and switching circuitry may gather color ambient light sensor measurements and measurements indicative of whether or not the color ambient light sensor has been obscured by an external object from the light sensor elements.

Electronic device with obstruction-sensing color ambient light sensor

An electronic device may have a display with a transparent layer such as a cover layer. An ambient light sensor may be aligned with an ambient light sensor window formed from an opening in a masking layer on the transparent layer in an inactive portion of the display. To help mask the ambient light sensor window from view, the ambient light sensor window may be provided with a black coating that matches the appearance of surrounding masking layer material while allowing light to reach the ambient light sensor. The black coating may include multiple pigments and may have a flat spectrum to enhance color ambient light measurements made with the ambient light sensor. The black coating may include a polymer binder or other binder that contains multiple pigments. The pigments may include a black pigment, a blue pigment, and an infrared-light-transparent pigment and/or other pigments.

Color-insensitive window coatings for ambient light sensors

A near-eye display (NED) comprises an electronic display, an optical assembly, a scanning assembly, and a controller. The controller generates display instructions based in part on content. The display instructions describe a resolution within an adjustable range of resolutions and a frame rate within adjustable range of frame rates. The electronic display emits a plurality of light rays at the frame rate based on the display instructions. The scanning assembly shifts a direction of at least one of the plurality of light rays in accordance with the display instructions. The optical assembly controls a field of view at an eye box and directs the plurality of light rays including the at least one shifted light ray toward the eye box. The plurality of light rays form a virtual display that displays the content at the resolution and the frame rate.

Near-eye display assembly with adjustable resolution and frame rate

A Fresnel optical element includes a Fresnel surface formed in a material. The Fresnel surface includes a plurality of Fresnel feature that include an active surface and a draft surface. A light absorptive layer is selectively disposed over the draft surface of the Fresnel features. The light absorptive surface is configured to absorb a majority of visible light encountering the light absorptive layer.

Selective coating for fresnel surface

An electronic device may have a display with a cover layer. An ambient light sensor may be aligned with an ambient light sensor window formed from an opening in a masking layer on the cover layer in an inactive portion of the display. To help mask the ambient light sensor window from view, the ambient light sensor window may be provided with a black coating that matches the appearance of surrounding masking layer material while allowing light to reach the ambient light sensor. The black coating may be formed from a black physical vapor deposition thin-film inorganic layer with a high index of refraction. An antireflection layer formed from a stack of dielectric layers may be interposed between the black thin-film inorganic layer and the display cover layer.

Ambient light sensor window coatings for electronic devices

An electronic device may be provided with a color sensing ambient light sensor. The color sensing ambient light sensor may measure the color of ambient light. Control circuitry in the electronic device may use information from the color sensing ambient light sensor in adjusting a display in the electronic device or taking other action. The color sensing ambient light sensor may have light detectors with different spectral responses. A test system may be used to calibrate the color sensing light sensor. The test system may have a tunable light source with light-emitting diodes that are turned on in sequence while gathering measured responses from the detectors. Numerical optimization techniques may be used to produce final versions of the spectral responses for the light detectors from the measured responses and corresponding calibration data that is stored in the electronic device.

Methods for color sensing ambient light sensor calibration

An electronic device may be provided with a display mounted in a housing. A color sensing ambient light sensor may measure the color of ambient light. The color sensing ambient light sensor may be mounted in alignment with an ambient light sensor window formed in an inactive area of the display. The color sensing ambient light sensor may be formed from detectors on a semiconductor substrate. The detectors may include detectors that have spectral sensitivity profiles matching those of color matching functions. The color sensing ambient light sensor may include an infrared light detector. Light redirecting structures such as a diffuser, prism film, negative lens film, or privacy film may be used in directing light into the ambient light sensor. The color sensing ambient light sensor may be calibrated by exposing the sensor to light sources of different types.

Electronic device with color sensing ambient light sensor

An electronic device may be provided with a display mounted in a housing. An ambient light sensor may measure the color of ambient light through an ambient light sensor window in the display. The ambient light sensor may have an array of light detectors on a semiconductor die. The light detectors may include color matching function light detectors that have spectral sensitivity profiles that match standard observer color matching functions and may include spectral sensing light detectors. The spectral sensing light detectors may have narrower full width at half maximum bandwidths than the color matching function light detectors and may be used with the color matching function light detectors to measure an ambient light spectrum. The color matching function light detectors may be used to measure the color of ambient light.

Light sensor with spectral sensing and color matching function channels

An electronic device may be provided with light sensors. The electronic device may have an electronic device housing in which a display is mounted. The display may have a transparent layer such as a transparent display cover layer, a thin-film transistor layer, or a color filter layer. An opaque masking layer such as a layer of black ink may be used to cover an inner surface of the transparent layer in an inactive area of the display. Sensor window openings may be formed in the black ink layer. A layer of ink may be formed in each sensor window opening. Each layer of ink may have a diffuse reflectivity that is matched to that of the black ink. A diffuser layer such as a polymer coating layer with light-scattering particles may be coated on the inner surface of the layer of ink in a sensor window opening.

Light sensor windows for electronic devices

Growing community of inventors

Santa Clara, CA, United States of America

Zhang Jia