Dolby Laboratories Licensing Corporation

Robin Atkins

Peng Yin

Taoran Lu

Jaclyn Anne Pytlarz

Guan-Ming Su

Tao Chen

Walter J Husak

Sean Thomas McCarthy

Fangjun Pu

Per Jonas Andreas Klittmark

Scott J Daly

Gregory John Ward

Neil W Messmer

Jon S McElvain

Walter Christian Gish

Jon Scott Miller

Mahdi Nezamabadi

Gopi Lakshminarayanan

Elizabeth G Pieri

Suzanne Farrell

Gaven Wang

A method for representing a three-dimensional scene stored as a three-dimensional data set includes determining a set of P depth-plane depths along a viewing direction. The method includes generating, from a three-dimensional data set, a proxy three-dimensional data set including Pproxy images by, for each depth-plane depth: generating a proxy image of the Pproxy images from at least one cross-sectional image of a plurality of transverse cross-sectional images that (i) constitute the three-dimensional data set and (ii) each represent a respective transverse cross-section of the three-dimensional scene at a respective scene-depth.

Method, encoder, and display device for representing a three-dimensional scene and depth-plane data thereof

Methods and systems for generating and using dynamic spatial metadata in image and video processing are described. In an encoder, in addition to global metadata, local, spatial metadata for two or more image regions or image objects are generated, smoothed, and embedded as spatial metadata values. In a decoder, the decoder can reconstruct the spatial metadata and use interpolation techniques to generate metadata for specific regions of interest. Examples of generating spatial metadata related to min, mid, and max luminance values in an image are provided.

Dynamic spatial metadata for image and video processing

In one embodiment, methods, media, and systems process and display light field images using a view function that is based on pixel locations in the image and on the viewer's distance (observer's Z position) from the display. The view function can be an angular view function that specifies different angular views for different pixels in the light field image based on the inputs that can include: the x or y pixel location in the image, the viewer's distance from the display, and the viewer's angle relative to the display. In one embodiment, light field metadata, such as angular range metadata and/or angular offset metadata can be used to process and display the image. In one embodiment, color volume mapping metadata can be used to adjust color volume mapping based on the determined angular views; and the color volume mapping metadata can also be adjusted based on angular offset metadata.

Processing of extended dimension light field images

A volumetric image of a scene can be created, in one embodiment, by recording, through a camera in a device, a series of images of the scene as the camera is moved along a path relative to the scene; during the recording, the device stores motion path metadata about the path, and the series of images is associated with the motion path metadata and a metadata label is associated with the series of images, the metadata label indicating that the recorded series of images represent a volumetric image of the scene. The series of images, the motion path metadata and the metadata label can be assembled into a package for distribution to devices that can view the volumetric image, which may be referred to as a limited volumetric image. The devices that receive the volumetric image can display the individual images in the series of images or as a video.

Systems and methods for processing volumetric images

A system and method of editing video content includes receiving input video data; converting the input video data to a predetermined format; generating a plurality of initial metadata values for a frame of the converted video data, the plurality of initial metadata values including a first metadata value corresponding to a first fixed value not calculated from a content including the frame, a second metadata value corresponding to an average luminance value of the frame, and a third metadata value corresponding to a second fixed value not calculated from the content, wherein the first meta-data value, the second metadata value, and the third metadata value include information used by a decoder to render a decoded image on a display.

Computing dynamic metadata for editing HDR content

Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.

Frame-rate scalable video coding

A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Perceptual luminance nonlinearity-based image data exchange across different display capabilities

In a method to improve backwards compatibility when decoding high-dynamic range images coded in a wide color gamut (WCG) space which may not be compatible with legacy color spaces, hue and/or saturation values of images in an image database are computed for both a legacy color space (say, YCbCr-gamma) and a preferred WCG color space (say, IPT-PQ). Based on a cost function, a reshaped color space is computed so that the distance between the hue values in the legacy color space and rotated hue values in the preferred color space is minimized. HDR images are coded in the reshaped color space. Legacy devices can still decode standard dynamic range images assuming they are coded in the legacy color space, while updated devices can use color reshaping information to decode HDR images in the preferred color space at full dynamic range.

Signal reshaping for high dynamic range signals

The described embodiments include systems and methods for producing and adapting images, such as video images, for presentation on display devices that have various different aspects ratios, such as 4:3, 16:9, 9:16, etc. In one embodiment, a method for producing content, such as video images, can begin by selecting an original aspect ratio and determining, within at least a first scene in the content, a position of a subject in the first scene. In one embodiment, the original aspect ratio can be substantially square (e.g., 1:1). Metadata can then be created, based on the position of the subject in the first scene, to guide playback devices to asymmetrically crop the content, relative to the position, for display on display devices that have aspect ratios that are different than the original aspect ratio. Other methods and systems are also described.

Producing and adapting video images for presentation on displays with different aspect ratios

A content-creation tool includes a processor and a memory. The processor is configured to receive a first video clip and a second video clip, a respective first and second metadata-item thereof being set to a respective first and second metadata-value. The memory stores video-editing software that includes a timeline interface and instructions that, when executed by the processor, control the processor to: add the first video clip to the timeline interface as a first timeline-track that retains the first metadata-value; add the second video clip to the timeline interface as a second timeline-track that retains the second metadata-value; and generate a frame sequence that includes a plurality of video frames. Each video frame is a frame of, or a frame derived from, one of (i) the first timeline-track, (ii) the second timeline-track, and (iii) a composited time-line-track composited from at least one of the first and second timeline-tracks.

Growing community of inventors

Vancouver, Canada

Robin Atkins