Dolby Laboratories Licensing Corporation

Thredup Inc.

Faurecia Irystec Inc.

Dolby Laboratories Licensing Coporation

Gregory John Ward

Helge Seetzen

Lorne Arthur Whitehead

Wolfgang Stuerzlinger

Wolfgang Heidrich

Ajit Ninan

Robin Atkins

Wenhui Jia

Arkady Ten

Scott J Daly

Timo Kunkel

Louis D Silverstein

Maryann Simmons

Don Graham

Allan G Rempel

Jon S McElvain

Samir N Hulyalkar

Walter Christian Gish

Gerwin Damberg

Guan-Ming Su

John Voris

Patrick Griffis

Vincent Kwong

Michael Santhanam

Vivek Daver

Qifan Huang

Jonathan Robert Miller

Matthew Trentacoste

Martin John Richards

Ning Xu

Neil W Messmer

Sheng Qu

Chun Chi Wan

Anders Ballestad

Trevor Davies

Tara Akhavan

Kenneth Schindler

Hyunjin Yoo

Andrey Kostin

Gary E Thomas

William Brent Wilson

Suzanne Farrell

Gaven Wang

Shwetha Ram

Domagoj Baricevic

Jon Scott Mcelvain

Douglas Campbell

Vijay Kamarshi

Jeremie Gerhardt

Chun-Chi Wan

James Harrison

Terence Ka Wing Lau

Ten Arkady

Henry Hang Kei Ip

Anders Ballestadt

Allan Rempel

Occluded image fragments are sorted in size. The largest image fragment is used to size a quadtree node in a layout mask for a disocclusion atlas used to store the image fragments. The sorted image fragments are stored into the disocclusion atlas using the layout mask such as each image fragment is hosted with a best fit quadtree node in the disocclusion atlas. A video signal may be generated by encoding one or more reference images and the disocclusion atlas storing the image fragments. The image fragments can be used by a recipient device to fill disoccluded image data in disoccluded spatial regions in a display image synthesized from the reference images.

Supporting multi-view video operations with disocclusion atlas

Saliency regions are identified in a global scene depicted by volumetric video. Saliency video streams that track the saliency regions are generated. Each saliency video stream tracks a respective saliency region. A saliency stream based representation of the volumetric video is generated to include the saliency video streams. The saliency stream based representation of the volumetric video is transmitted to a video streaming client.

Representing volumetric video in saliency video streams

A method for generating a high-dynamic-range (HDR) image includes (a) denoising a short-exposure-time image, wherein the denoising comprises applying a first guided filter to the short-exposure-time image, the guided filter utilizing a long exposure-time-image as its guide, (b) after the step of denoising, scaling at least one of the short-exposure-time image and the long-exposure-time image to place the short-exposure-time image and the long-exposure-time image on a common radiance scale, and (c) after the step of scaling, merging the short-exposure-time image with the long-exposure-time image to generate the HDR image.

High-dynamic-range image generation with pre-combination denoising

An image sensor includes a plurality of pixels, each pixel belonging to one of N subframes each characterized by (a) a same exposure-time sequence that includes a short exposure-time alternating with a long exposure-time, and (b) a respective temporal offset equal to a multiple of the short exposure-time. A method for encoding a video stream captured by the image sensor includes (i) for each subframe, linearly combining a long-exposure image, captured at the long exposure-time, and a short-exposure image, captured at the short exposure-time, to yield a residual image, (ii) combining at least some of the long-exposure images from the N subframes to yield a full-frame image having a higher resolution than any long-exposure image, (iii) encoding the full-frame image into a base layer of the video stream, and (iv) encoding at least some of the residual images from the N subframes into an enhancement layer of the video stream.

Video encoder and encoding method

A system and method is provided for color matching two or more electronic displays of a display system. The method includes: obtaining first and second spectral response readings for first and second electronic displays from spectral response device(s); determining first and second spectral response curves based on the first and second spectral response readings; determining first and second spectral power distributions based on the first and second spectral response readings; determining a first device-to-independent color mapping based on the first spectral response curve and the first spectral power distribution; determining a second device-to-independent color mapping based on the second spectral response curve and the second spectral power distribution; and configuring a display system having the first electronic display and the second electronic display to match colors being displayed based on using the first device-to-independent color mapping and the second device-to-independent color mapping.

System and method for configuring a display system to color match displays

Apparatus and methods are provided that employ one or more of a variety of techniques for reducing the time required to display high resolution images on a high dynamic range display having a light source layer and a display layer. In one technique, the image resolution is reduced, an effective luminance pattern is determined for the reduced resolution image, and the resolution of the effective luminance pattern is then increased to the resolution of the display layer. In another technique, the light source layer's point spread function is decomposed into a plurality of components, and an effective luminance pattern is determined for each component. The effective luminance patterns are then combined to produce a total effective luminance pattern. Additional image display time reduction techniques are provided.

Rapid estimation of effective illuminance patterns for projected light fields

A data structure defining a high dynamic range image comprises a tone map having a reduced dynamic range and HDR information. The high dynamic range image can be reconstructed from the tone map and the HDR information. The data structure can be backwards compatible with legacy hardware or software viewers. The data structure may comprise a JFIF file having the tone map encoded as a JPEG image with the HDR information in an application extension or comment field of the JFIF file, or a MPEG file having the tone map encoded as a MPEG image with the HDR information in a video or audio channel of the MPEG file. Apparatus and methods for encoding or decoding the data structure may apply pre- or post correction to compensate for lossy encoding of the high dynamic range information.

Apparatus and methods for encoding, decoding and representing high dynamic range images

An auto exposure method for a spatially-multiplexed-exposure (SME) high-dynamic-range (HDR) image sensor includes (a) retrieving raw image data from an exposure of the spatially-multiplexed-exposure high-dynamic-range image sensor, (b) preprocessing long-exposure pixel values and short-exposure pixel values of the raw image data to remove therefrom long-exposure pixel values and short-exposure pixel values failing to meet one or more quality requirements, (c) synthesizing, into an high-dynamic-range histogram, the long-exposure pixel values remaining after the step of preprocessing and the short-exposure pixel values remaining after the step of preprocessing, (d) deriving a goodness metric from the high-dynamic-range histogram, (e) adjusting at least one of the long exposure time and the short exposure time, based at least in part upon the goodness metric, and (f) outputting the at least one of the long exposure time and the short exposure time, as adjusted, to the spatially-multiplexed-exposure high-dynamic-range image sensor.

Auto exposure of spatially-multiplexed-exposure high-dynamic-range image sensor metric and adjustment

A display has a screen which incorporates a light modulator. The screen may be a front projection screen or a rear-projection screen. The screen is illuminated with light from a light source comprising an array of controllable light-emitters. The controllable-emitters and elements of the light modulator may be controlled to adjust the intensity of light emanating from corresponding areas on the screen. The display may provide a high dynamic range.

Image display

Imaging methods and devices with pixels divided into pixel groups are disclosed. A pixel group-based global shutter and pixel group-wise staggered long and short exposure followed by readout of two samples per pixel are presented. Example methods and devices for a Bayer color filter array divided into groups of n&#xd7;n pixels are provided.

CMOS sensor architecture for temporal dithered sampling

An auto exposure method for an image sensor includes (a) evaluating variance, for each of a plurality of histograms of the pixel values from a respective plurality of individual exposures of the image sensor at respective exposure 5 time settings, of contribution from individual bins of the histogram to total entropy of the histogram, to determine an optimal exposure time for the image sensor corresponding to a minimum value of the variance, and (b) outputting the optimal exposure time to the image sensor.

Auto exposure of image sensors based upon entropy variance

An imaging system, comprising a pixel image sensor array disposed on a substrate and comprising a plurality of pixels, a multi-stage timer coupled to said pixel image sensor array for triggering exposures of said pixels, wherein the pixels are grouped into N subsets, and the timer triggers, for each subset, a sequence of at least two exposures of different capture duration of the pixels of said subset, wherein start times of the exposure sequences of the different subsets are temporally offset, at least one ADC coupled to said pixel image sensor array, which converts said exposures of said pixels to pixel digital values, a memory coupled to said at least one ADC to store said pixel digital values, and a logic circuit coupled to said memory to determine for each pixel of the image sensor array which of the corresponding stored pixel digital values to upload to a video frame.

Apparatus and method for encoding high frame rate content in standard frame rate video using temporal interlacing

Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Encoding, decoding, and representing high dynamic range images

A method for demosaicing an image captured by an image sensor includes (a) computing, for each of a first plurality of interpolated pixel-values and based on neighboring primary pixel-values, a respective first confidence value; (b) generating a first thresholded mapping from a first coordinate mapping by removing each interpolated pixel-value having a first confidence value less than a threshold value; (c) repeating steps of computing and generating for a second and third sub-plurality of sensor pixels to yield a second and a third thresholded mapping; (d) determining high-confidence array-coordinates as array-coordinates included in all thresholded mappings, remaining array-coordinates being low-confidence array-coordinates; (e) forming a refined image including, at each high-confidence array-coordinate, a respective pixel-value-triplet including one primary pixel-value and two interpolated pixel-values; and (f) filling the refined image by assigning, for each low-confidence array-coordinate, a pixel-value based on pixel-values of neighboring high-confidence array-coordinates.

Image demosaicing system and method

Directional image sensor data may be acquired with one or more directional image sensors. A light source and illumination image may be generated based on the directional image sensor data. A number of operations may be caused to be performed for an image based at least in part on light source information in the light source image. The operations may include display management operations, device positional operations, augmented reality superimposition operations, ambient light control operations, etc.

Surround ambient light sensing, processing and adjustment

Growing community of inventors

Berkeley, CA, United States of America

Gregory John Ward