Apple Inc.

Qualcomm Incorporated

Contextlogic, Inc.

Sheng Zhang

Chaohao Wang

Paolo Sacchetto

Yunhui Hou

Yingying Tang

Giovanni Carbone

Shengchang Cai

Jim Chen Chou

Guy Cote

Arthur Yasheng Zhang

Hasan Akyol

Enkhamgalan Dorjgotov

Yue Ma

Lingtao Wang

Wei Hsin Yao

Hopil Bae

Derek Keith Shaeffer

Mahdi Farrokh Baroughi

Henry C Jen

Shingo Hatanaka

Shereef Shehata

Avi Bar-Zeev

Chun-Yao Huang

Hao Pan

Geoffrey Grant Stahl

Gurjeet S Saund

Ray Ling Chang

Timothy Robert Oriol

Graham Butler Myhre

ByoungSuk Kim

Yi Huang

Koorosh Aflatooni

Tobias Eble

Justin A Hensley

Cheuk Chi Lo

Ping-Yen Chou

Ling Su

Cheng Kai Chen

Jun Qi

Peter F Holland

Moinul H Khan

Mahesh B Chappalli

Yang Li

Aleksandr M Movshovich

Hao Chen

Shih-Chyuan Fan Jiang

Gokhan Avkarogullari

Xiaokai Li

Igor Stamenov

Chengrui Le

Yung-Chin Chen

Michael Slootsky

Juan He

Yi-Pai Huang

Fu-Chung Huang

Xuebei Yang

Chih-Wei Yeh

Adam Adjiwibawa

Scott R Johnston

Paul Stephen Drzaic

Wei Chen

Hung Sheng Lin

Hyunwoo Nho

Marc Albrecht

Jiaying Wu

Jun Li

Ankit Srivastava

Jin Li

Tong Zhu

David W Lum

Pierre-Yves Emelie

Yifan Zhang

Yury Anatolievich Petrov

Felipe Bacim De Araujo E Silva

Paul V Johnson

Yingkan Lin

Howard H Tang

Ivan Knez

Myung-Je Cho

Mark F Flynn

Tae-Wook Koh

John T Wetherell

Tobias Jung

Matthew David Sienko

Jingxue Lu

Pavel V Dudrenov

Patrick B Bennett

Chun-Ming Tang

Bennett S Wilburn

Ahmad Rahmati

Young Don Bae

Lingyu Hong

Johan L Piper

Piotr Szulczewski

Lingyu Zhu

Wei-Liang Hsu

Jack Z Xie

Karol E Czaradzki

An electronic device may have a display panel. Light from the display panel may be focused by a lens assembly towards a viewer. Optical crosstalk, off-axis color shift, and/or the presence of the lens assembly may cause color non-uniformity in images viewed through the lens assembly. To obtain color calibration information, first information may be used to simulate the color of the display panel when viewed through a lens assembly from a first number of points. The first information may include an average display panel color emission profile and a map of correlation between pixel locations and incident angles and corresponding pupil locations and gaze directions. The color of the display panel through the lens assembly may be measured at the first number of points to extract a lens non-uniformity contribution. The lens non-uniformity contribution may then be used to simulate color at a second, larger number of points.

Method of obtaining color calibration information for an electronic device

Systems and methods are provided for using an optical crosstalk compensation (OXTC) block to compensate for optical crosstalk resulted from a combination of viewing angle change across field of view (FoV), color filter (CF) crosstalk, and the OLED various angle color shift (VACS) of a foveated electronic display. One or more two-dimensional (2D) OXTC factor maps are used to determine OXTC factors for input image data of the OXTC block, and the OXTC factors are updated on a per frame basis. Offset values are determined using a parallel architecture and used to determine the OXTC factors. Compensation weights are used to determine weighted OXTC factors to improve processing efficiency. Output image data are obtained by applying the weighted OXTC factors to the input image data.

Optical crosstalk compensation for foveated display

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. A plurality of lenticular lenses may extend across the length of the display. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. Crosstalk between viewing zones and disparity between images received from different viewing zones may result in disparity-caused shifts in images perceived by viewer of the lenticular display. To mitigate these disparity-caused shifts, compensation circuitry may be included in the display pipeline circuitry. The compensation circuitry may include stored disparity-caused shift calibration information that is used for the compensation. The stored disparity-caused shift calibration information may be a polynomial function that outputs a magnitude of disparity-caused shift for a given pixel location.

Displays with disparity-caused shift compensation

An electronic device uses a leader synchronize signal generator to synchronize clock signal generators used by multiple components in the electronic device to a common time-base. A processor core complex of the electronic device sends per-frame configuration to a timing controller for frames to be displayed on an electronic display before a corresponding frame begins.

Two-way communication to allow consistent per-frame configuration update

An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

Electronic device with coordinated camera and display operation

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may initially generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. Pre-processing circuitry may subsequently anisotropically resize each two-dimensional image. Pixel mapping circuitry may then be used to map the resized two-dimensional images to the array of pixels in the lenticular display.

Pre-processing in a display pipeline

An electronic device may include a display and an optical sensor formed underneath the display. The electronic device may include a plurality of transparent windows that overlap the optical sensor. The resolution of the display panel may be reduced in some areas due to the presence of the transparent windows. To prevent a visible border between the reduced resolution areas of the display and full resolution areas of the display, uniformity compensation circuitry may be used to compensate pixel data. The uniformity compensation circuitry may output compensated pixel data for the display using one or more compensation maps that include compensation factors associated with pixel locations. The uniformity compensation circuitry may also use region-specific gamma look-up tables to apply different gamma curves to pixels in different regions of the display. The uniformity compensation circuitry may also be used to form a transition region between different regions of the display.

Devices with displays having transparent openings and uniformity correction

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. To mitigate jaggedness in a curved edge of the active area, control circuitry may modify input pixel data for the display using dimming factors. Each brightness value of the pixel data may be multiplied by a corresponding dimming factor such that the curved edge has a smooth appearance. Each physical pixel in the display may have an associated perceived pixel that is based on an appearance of that physical pixel through the lenticular lens film. The perceived pixel may have a different footprint than its corresponding physical pixel. The dimming factors for boundary smoothing in the curved edges may be based on the perceived pixels.

Boundary smoothing in a display

A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

Video pipeline

Systems and methods may reduce or eliminate image artifacts due to a defective pixel of an electronic display. An electronic display may include pixels that respectively include a self-emissive element, pixel drive circuitry that supplies a pixel drive current to drive the self-emissive element, and signal routing circuitry that reduces or eliminates a visual artifact due to a defective pixel among the pixels. The signal routing circuitry may do this by turning off the self-emissive element, supplying image data from the pixel drive circuitry to a first adjacent pixel, or receiving image data from other pixel drive circuitry from the first adjacent pixel or a second adjacent pixel.

Pixel screening and repair

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may initially generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. The two-dimensional images may be processed by per-view processing circuitry. Pixel mapping circuitry may be used to map the two-dimensional images to the array of pixels in the lenticular display. After pixel mapping, additional panel-level processing may be performed.

Content processing in a display pipeline

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. Pixel mapping circuitry may be used to map the two-dimensional images to the array of pixels in the lenticular display. The array of pixels may have a diagonal layout. An offset map may be used by the pixel mapping circuitry to account for the diagonal layout.

Pixel mapping in a display pipeline

A compensation system includes a processor configured to determine compensated data for display on a sub-pixel of the display device. The processor may receive image data configured to be displayed on the sub-pixel, convert the gray level data to first voltage data; fetch, from a memory, compressed 1×1 sub-pixel uniformity compensation data for the sub-pixel, and decompress the compressed 1×1 sub-pixel uniformity compensation data via a decompressor. The decompressed data comprises the 1×1 sub-pixel uniformity compensation data for the sub-pixel. The processor may also determine a voltage compensation offset value associated with the sub-pixel based on the second voltage data, generate compensated voltage data based in part on the voltage compensation offset value and the first voltage data, convert the compensated voltage data to compensated gray level data; and transmit the compensated gray level data to pixel driving circuitry associated with the sub-pixel.

Compensation schemes for 1x1 sub-pixel uniformity compensation

Growing community of inventors

Milpitas, CA, United States of America

Sheng Zhang