Dolby Laboratories Licensing Corporation

Wenhui Jia

Ajit Ninan

Gregory John Ward

Chun Chi Wan

Arkady Ten

Haricharan Lakshman

Shwetha Ram

Domagoj Baricevic

Jasper Chao

Gaven Wang

Ankur Shah

Ten Arkady

Huiming Tong

Qiaoli Yang

Arkadi Ten

A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering.

Multi-resolution multi-view video rendering

Bordering pixels delineating a texture hole region are identified in a target image. Depth values of the bordering pixels are automatically clustered into two depth value clusters. A specific estimation direction is selected from multiple candidate estimation directions for a texture hole pixel in a texture hole region. A depth value of the texture hole pixel is estimated by interpolating depth values of two bordering background pixels in the specific estimation direction. The estimated depth value is used to warp the texture hole pixel into a reference view represented by a temporal reference image. A pixel value of the texture hole pixel is predicted based on a reference pixel value of a reference pixel from the reference image to which the texture hole pixel is warped using the estimated depth value.

Temporal hole filling for depth image based video rendering

Bordering pixels delineating a texture hole region in an image are identified. Depth values of the bordering pixels are recorded. The depth values are automatically clustered into two depth value clusters with a depth value threshold separating the two depth value clusters. A subset of bordering background pixels is identified in the bordering pixels as those with depth values in one of the two depth value clusters that is declared as a background depth value cluster. The subset of bordering background pixels is used to predict texture hole pixel values in the texture hole region based on multiple candidate prediction directions. Quality indicator values are computed for the multiple candidate prediction directions and used to select a specific candidate prediction direction for filling in final texture hole pixel values in the texture hole region of the image.

Hole filling for depth image based rendering

Methods for using a head mounted display (HMD) can detect slippage of the HMD through the use of a comparison between, for example, a calibrated glint reference point and a glint reference point calculated during monitoring of glints during usage of the HMD.

Slippage compensation in eye tracking

Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Encoding, decoding, and representing high dynamic range images

Displays, display components, image and video processing apparatus and related methods are described. A method for driving local-dimming displays comprises generating control values for driving pixels of a spatial light modulator from one image data component and generating control values for driving backlight elements from a second image data component. The first and second image data components may respectively comprise a tone map and a ratio image. Control values for the spatial light modulator and/or backlight may be obtained using cost effective hardware.

Displaying images on local-dimming displays

Techniques for displaying images of different dynamic ranges in a display system are provided. In some embodiments, images that have a number of dynamic ranges may be normalized to a configured dynamic range that corresponds to the full intensity reproduction capability of the device. The configured dynamic range may be wider, greater, or deeper than the relatively limited dynamic range.

Display backlight normalization

Techniques for operating a display system in a wide range of ambient light conditions are provided. An intensity of ambient light on a display panel may be detected. The display panel may be illuminated by light sources in addition to the ambient light. An individual light source may be individually settable to an individual light output level. If it is determined that the luminance level of the ambient light is above a minimum ambient luminance threshold, an ambient black level may be calculated using the intensity of ambient light. Light output levels of one or more of the light sources may be elevated to first light output levels. Here, the one or more light sources may be designated to illuminate one or more dark portions of an image. The first light output levels may create a new black level equaling the determined ambient black level.

Growing community of inventors

Dublin, CA, United States of America

Wenhui Jia