Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Pixtronix, Incorporated

Snaptrack Incorporated

E Ink Corporation

Other

Sharp Corporation

Edward Buckley

Fahri Yaras

Romain Bachy

Michael Yee

William Thomas Blank

Ilias Pappas

Thomas Scott Murdison

Stephen J Telfer

Kenneth R Crounse

Jignesh Gandhi

Sunil Krishna Sainis

Sapna A Shroff

Barry David Silverstein

Larry Seiler

Timothy J Brosnihan

Warren Andrew Hunt

Bennett S Wilburn

Bo Zhang

Javier Villarreal

Jiangtao Kuang

Honghong Peng

Mark Douglas Halfman

Pravin Rao

Brian Finkel

Nathaniel Smith

Mark A Horowitz

James Ronald Bonar

Richard S Payne

Alan G Lewis

Gareth John Valentine

John Fijol

Mark B Andersson

Chih-Hsiang Ho

Eugene E Fike, Iii

Robert H Myers

Christophe Antoine Hurni

Jianru Shi

Kavitha Ratnam

Shuang Wang

James Eakin

Cameron Maehara Lee

Pin-Chieh Huang

John Paul Beck

Eugene Fike

Nakano Taketoshi

A system for rendering color images on an electro-optic display when the electro-optic display has a color gamut with a limited palette of primary colors, and/or the gamut is poorly structured (i.e., not a spheroid or obloid). The system uses an iterative process to identify the best color for a given pixel from a palette that is modified to diffuse the color error over the entire electro-optic display. The system additionally accounts for variations in color that are caused by cross-talk between nearby pixels.

Method for rendering color images

In one embodiment, a computing system may access a first value associated with a first pixel of the first color channel from a first bitmap associated with a first color channel. The system may select a first mask comprising a plurality of first scaling factors based on the first value of the first bitmap. The system may access a second value associated with a second pixel of the second color channel from a second bitmap associated with a second color channel. The system may select a second mask comprising a plurality of second scaling factors based on the second value of the second bitmap. The system may modify each of first and second component values of the corresponding color channel using the corresponding plurality of scaling factors of the corresponding mask. The system may output the modified first and second component values to a display.

Display non-uniformity correction

A display device and a calibration method for the display device are provided. The calibration method includes obtaining calibration coefficients, from which a compressed approximation is determined. The display device obtains the compressed approximation data including basis vectors and reconstruction coefficients, and determines calibration data to at least partially offset a dependence of an optical throughput of the display device on a beam angle and a beam coordinate at the eyebox.

Display with compressed calibration data

In one embodiment, a computing system may determine, determine an estimated distance of an eye of a user to a display plane of a display. The system may access correction maps corresponding to a number of reference distances to the display plane of the display. The system may select a first reference distance and a second reference distance based on the estimated distance. The system may generate a custom correction map for the user based on an interpolation of a first correction map corresponding to the first reference distance and a second correction map corresponding to the second reference distance. The system may adjust an image to be displayed on the display using the custom correction map. The custom correction map may correct non-uniformity of the display as viewed from the eye of the user. The system may display the image adjusted using the custom correction map on the display.

In one embodiment, a computing system may determine, for a current frame, that a current eye position of a viewer with respect to a display is inside and within a first threshold distance to an outer edge of the display. The system may identify, based on the current eye position, pre-determined internal eye positions inside the outer edge and pre-determined external eye positions outside the outer edge, obtain pre-determined arrays of scaling factors associated with the pre-determined internal eye positions, and obtain additional arrays of scaling factors associated with the pre-determined external eye positions. The system may generate a single array of scaling factors based on the pre-determined and additional arrays, adjust pixel values of the current frame based on the single array, and output the current frame with the adjusted pixel values to the display. The arrays and adjusted pixel values may be associated with a particular color channel.

Dynamic uniformity correction for boundary regions

In one embodiment, the system may determine an estimated distance of an eye of a user to a display plane of a display. The system may access, from a memory storage, a number of transmission maps characterizing non-uniform transmission characters of the display as measured from a number of pre-determined view positions within a measurement plane. The measurement plane may be separated from the display plane by a known distance. The system may generate a custom transmission map for the estimated distance of the eye based on the transmission maps using light field rendering. The system may determine a custom correction map based on the custom transmission map. The system may adjust an image to be displayed on the display using the custom correction map. The system may display the image adjusted using the custom correction map on the display.

In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

Dynamic uniformity correction

A computing system may determine, for a current frame, a viewer's current eye position with respect to a waveguide of a display, identify eye positions that collectively form a grid of eye positions surrounding the current eye position, obtain, from a memory on the display, compressed arrays of scaling factors for correcting non-uniformities of the waveguide at the identified eye positions, perform interpolation based on the compressed arrays to generate an array of scaling factors for the current eye position, adjust pixel values of the current frame based on the customized array, and output the current frame with the adjusted pixel values to the display. The compression operation may include dithering or converting pixel values to a different color space. The interpolation may be performed on the compressed arrays or on results of a decompression operation. The customized array may be up-sampled prior to adjusting the pixel values.

Waveguide correction map compression

In one embodiment, a computing system may access an image to be displayed on a display. The system may perform compensation operations on the display to compensate for degradation effects of the display. The system may determine a change in an electric signal level associated with one or more light-emitting elements of the display. The change may be caused by the compensation operations. The system may determine a wavelength shift of the light-emitting elements of the display. The wavelength shift may be caused by the change of the electric signal level. The system may adjust values of RGB color components of the pixel values of the image based on the wavelength shift of the light-emitting elements of the display. The system may output the pixel values with the adjusted values of the RGB color components to the display.

Display degradation compensation

In one embodiment, a computing system may determine a target grayscale value associated with a target image to be represented by a plurality of subframes. The system may determine grayscale ranges based on the target grayscale value. Each grayscale range may correspond to a combination of zero or more subframes of the plurality of subframes. The system may select dot subsets from a dithering mask based on the grayscale ranges. Each of the dot subsets may correspond to a grayscale range. The system may generate the subframes based on (1) the selected dot subsets and (2) respective combinations of zero or more subframes. The subframes may have a smaller number of bits per color than the target frame. The system may display the subframes sequentially in time domain on a display to represent the target image.

Systems and methods for mask-based temporal dithering

In one embodiment, a computing system may determine a group of subpixels, that are associated with different color channels, within a display region of a display. The system may determine a micro-pixel corresponding to a basic unit shape configured to evenly divide the display region and each subpixel. The system may represent the display region as a group of micro-pixels and each subpixel as a combination of one or more micro-pixels in the group of micro-pixels. The system may determine a constraint for each color channel of the display region based on the group of micro-pixels. The constraint may constrain the micro-pixels associated with a same subpixel to have a same color value. The system may generate, based on an optimization process using the constraint, a filter for the display region. The filter may be configured to adjust image pixel values to be displayed by the group of subpixels.

Constrained rendering

In one embodiment, the system may receive a target pixel value for a pixel of an image of a series of images. The system may determine an error-modified target pixel value based on the target pixel value and a first error value. The system may generate a quantized pixel value corresponding to the error-modified target pixel value for display by the pixel of the image. The system may determine an aggregated representation of quantized pixel values displayed by the pixel of the image and corresponding pixels of one or more preceding images of the series of images. The system may determine a second error value based on the aggregated representation of the quantized pixel values and the first error-modified target pixel value. The system may dither at least a portion of the second error value to at least a corresponding pixel of a next image in the series of images.

Systems and methods for spatio-temporal dithering

A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Display that uses a light sensor to generate environmentally matched artificial reality content

In one embodiment, a computing system may render an image to be output by a display which sequentially outputs pixel rows of the image at a row-to-row velocity. The system may predict, based on eye-tracking data, an eye-motion velocity within a timeframe for displaying the image. The system may determine a predicted retina projection displacement for each pixel row based on the row-to-row velocity and eye-motion velocity. The system may determine a first correction displacement for each pixel row based on the predicted retina projection displacement. The system may determine a cumulative correction displacement based on the first correction displacement. The system may determine, for each pixel row, a second correction displacement based on the first correction displacement of that pixel row and the cumulative correction displacement. The system may warp each pixel row using the associated second correction displacement and output the warped pixel rows using the display.

Image correction

Adjusted overlaid images are generated in response to at least one color reference object or color reference point. A display is driven to present the adjusted overlaid image.

Adjusted overlaid images in scenes

Growing community of inventors

Redmond, WA, United States of America

Edward Buckley