Dolby Laboratories Licensing Corporation

Broadcom Corporation

Ati Research, Inc.

Advanced Micro Devices Corporation

Philips Electronics North America Corporation

Ati Technologies Inc.

Koninklijke Philips Corporation N.v.

U.S. Philips Corporation

Avago Technologies General IP (singapore) Pte. Ltd.

Ati Technologies Ulc

Dolby International Ab

Nxtwave Communications, Inc.

Ati Technology Ulc

Netwave Communications

Chen, Tao

Samir N Hulyalkar

Tao Chen

Guan-Ming Su

Sheng Qu

Xuemin Chen

Marcus Christopher Kellerman

Ilya Klebanov

Hubert Koepfer

Yufei Yuan

Walter Christian Gish

Robin Atkins

Ning Xu

Timo Kunkel

Scott J Daly

Christopher H Strolle

Azzedine Touzni

Thomas J Endres

Peng Yin

Gopi Lakshminarayanan

Sunkwang Hong

Gregory John Ward

Bongsun Lee

Troy A Schaffer

James E Crenshaw

Raúl Alejandro Casas

Stephen L Biracree

Hariharan Ganapathy

Yan Ye

Yuwen He

Ajit Ninan

Larry Alan Pearlstein

Chiu Yeung Ngo

Steven Nashed Hanna

David Brooks

Haosong Fu

Yunwei Jia

Raghuram Behara

Ajay Bhaskaran

Dinesh C Verma

Andrew E Youtz

Taoran Lu

Walter J Husak

Jaclyn Anne Pytlarz

Harshad Kadu

Michael J Rockwell

Kevin J Stec

Qian Chen

Raul Alejandro Casas

Anand M Shah

Keith Lee

Takashi Sato

Samuel Reichgott

Raymond Yeung

Anustup Kumar Atanu Choudhury

Amit Gulati

Klaas Heinrich Schueuer

Suzanne Farrell

Philipp Kraetzer

Alfred She

Limin Liu

Hariharan Ganapathy-Kathirvelu

Gopi Lakshminarayan

Santosh Chilkunda

Azzédine Touzni

Leon Steiner

Bharath Vishwanath

Gopi Lakshiminarayanan

Lee Shu Key

John J Zygmaniak

Elik Shekhter

Samuel H Reichgott

Marcus Kellermann

Embodiments described herein provide a unified container format for delivering different multimedia applications. One embodiment provides a data structure utilized for implementing a plurality of multimedia applications. The data structure includes a first metadata level including low-level metadata used to perform operations associated with media data in a bitstream. The data structure includes a second metadata level including mid-level metadata used to apply operation metadata to render the media data. The data structure includes a third metadata level including upper-level metadata used to utilize the low-level metadata and the mid-level metadata to deliver the plurality of multimedia applications. The first metadata level further includes synchronization metadata for converting the media data, the low-level metadata, the mid-level metadata, and the upper-level metadata from a first multimedia application of the plurality of multimedia applications to a second multimedia application of the plurality of multimedia applications.

Data structure for multimedia applicatons

Apparatus and methods for providing software and hardware based solutions to the problem of synthesizing noise for a digital image. According to one aspect, a probability image is generated and noise blocks are randomly placed at locations in the probability image where the locations have probability values that are compared to a threshold criterion, creating a synthesized noise image. Embodiments include generating synthesized film grain images and synthesized digital camera noise images.

Noise synthesis for digital images

An encoder receives an input enhanced dynamic range (EDR) image to be stored or transmitted using multiple coding formats in a layered representation. A layer decomposer generates a lower dynamic range (LDR) image from the EDR image. One or more base layer (BL) encoders encode the LDR image to generate a main coded BL stream and one or more secondary coded BL streams, where each secondary BL stream is coded in a different coding format than the main coded BL stream. A single enhancement layer (EL) coded stream and related metadata are generated using the main coded BL stream, the LDR image, and the input EDR image. An output coded stream includes the coded EL stream, the metadata, and either the main coded BL stream or one of the secondary coded BL streams. Computation-scalable decoding and display management processes for EDR images are also described.

Distribution of multi-format high dynamic range video using layered coding

Systems and methods for overlaying a second image/video data onto a first image/video data are described herein. The first image/video data may be intended to be rendered on a display with certain characteristics&#x2014;e.g., HDR, EDR, VDR or UHD capabilities. The second image/video data may comprise graphics, closed captioning, text, advertisement&#x2014;or any data that may be desired to be overlaid and/or composited onto the first image/video data. The second image/video data may be appearance mapped according to the image statistics and/or characteristics of the first image/video data. In addition, such appearance mapping may be made according to the characteristics of the display that the composite data is to be rendered. Such appearance mapping is desired to render a composite data that is visually pleasing to a viewer, rendered upon a desired display.

Systems and methods for appearance mapping for compositing overlay graphics

Methods and systems for controlling judder are disclosed. Judder can be introduced locally within a picture, to restore a judder feeling which is normally expected in films. Judder metadata can be generated based on the input frames. The judder metadata includes base frame rate, judder control rate and display parameters, and can be used to control judder for different applications.

Dual-ended metadata for judder visibility control

Coding syntaxes in compliance with same or different VDR specifications may be signaled by upstream coding devices such as VDR encoders to downstream coding devices such as VDR decoders in a common vehicle in the form of RPU data units. VDR coding operations and operational parameters may be specified as sequence level, frame level, or partition level syntax elements in a coding syntax. Syntax elements in a coding syntax may be coded directly in one or more current RPU data units under a current RPU ID, predicted from other partitions/segments/ranges previously sent with the same current RPU ID, or predicted from other frame level or sequence level syntax elements previously sent with a previous RPU ID. A downstream device may perform decoding operations on multi-layered input image data based on received coding syntaxes to construct VDR images.

Specifying visual dynamic range coding operations and parameters

In a method to code and transmit scalable HDR video signals, HDR signals are processed and encoded in the IPT-PQ color space to generate a base layer at reduced spatial resolution and/or dynamic range, and an enhancement layer with a residual signal. A signal reshaping block before the base layer encoder allows for improved coding of HDR signals using a reduced bit depth. A decoder can use a BL decoder and backward reshaping to generate a decoded BL HDR signal at a reduced dynamic range and/or spatial resolution, or it can combine the decoded BL HDR signal and the EL stream to generate a decoded HDR signal at full dynamic range and full resolution.

Video coding and delivery with both spatial and dynamic range scalability

Representation and coding of multi-view images using tapestry encoding are described for standard and enhanced dynamic ranges compatibility. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. Different methods for achieving compatibility are described.

Encoding and decoding of 3D HDR images using a tapestry representation

A processor for video coding receives a full-frame rate (FFR) HDR video signal and a corresponding FFR SDR video signal. An encoder generates a scalable bitstream that allows decoders to generate half-frame-rate (HFR) SDR, FFR SDR, HFR HDR, or FFR HDR signals. Given odd and even frames of the input FFR SDR signal, the scalable bitstream combines a base layer of coded even SDR frames with an enhancement layer of coded packed frames, where each packed frame includes a downscaled odd SDR frame, a downscaled even HDR residual frame, and a downscaled odd HDR residual frame. In an alternative implementation, the scalable bitstream combines four signals layers: a base layer of even SDR frames, an enhancement layer of odd SDR frames, a base layer of even HDR residual frames and an enhancement layer of odd HDR residual frames. Corresponding decoder architectures are also presented.

Backward-compatible HDR codecs with temporal scalability

Motion characteristics related to the images are determined. A motion characteristics metadata portion is generated based on the motion characteristics, and is to be used for determining an optimal FRC operational mode with a downstream device for the images. The images are encoded into a video stream. The motion characteristics metadata portion is encoded into the video stream as a part of image metadata. The video stream is transmitted to the downstream device. The downstream receives the video stream and operates the optimal FRC operational mode to generate, based on the images, additional images. The images and the additional images are rendered on a display device at an image refresh rate different from an input image refresh rate represented by images encoded in the video stream.

Dynamic adjustment of frame rate conversion settings

Methods are disclosed for adaptive display management using look-up table interpolation. Given a target maximum brightness value for a display, a new look-up table (LUT) for color gamut mapping is determined based on interpolating values from two other pre-computed color gamut LUTs; one computed for a first maximum display brightness larger than the target maximum brightness value, and one computed for a second maximum display brightness lower than the target brightness value. An interpolation scale is computed based at least on the target maximum brightness value and the first maximum display brightness. Methods to reduce the computation load for the translation of RGB data from one color representation (say, ST 2084) to another color representation (say, BT 1866) using fast interpolation methods are also presented.

Adaptive display management using 3D look-up table interpolation

Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback. Given an input video stream and associated minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. The instantaneous dynamic range of a target display is determined based on the filtered output value and the minimum and maximum brightness values of the display. A backlight control level is computed based on the instantaneous dynamic range, and the input signal is tone mapped by a display management process to be displayed on the target display at the selected backlight level. The design of a temporal filter based on an exponential moving average filter and scene-change detection is presented.

Backlight control and display mapping for high dynamic range images

Inter-color image prediction is based on multi-channel multiple regression (MMR) models. Image prediction is applied to the efficient coding of images and video signals of high dynamic range. MMR models may include first order parameters, second order parameters, and cross-pixel parameters. MMR models using extension parameters incorporating neighbor pixel relations are also presented. Using minimum means-square error criteria, closed form solutions for the prediction parameters are presented for a variety of MMR models.

Multiple color channel multiple regression predictor

Stereoscopic video data and corresponding depth map data for stereoscopic and auto-stereoscopic displays are coded using a coded base layer and one or more coded enhancement layers. Given a 3D input picture and corresponding input depth map data, a side-by-side and a top-and-bottom picture are generated based on the input picture. Using an encoder, the side-by-side picture is coded to generate a coded base layer Using the encoder and a texture reference processing unit (RPU), the top-and-bottom picture is encoded to generate a first enhancement layer, wherein the first enhancement layer is coded based on the base layer stream, and using the encoder and a depth-map RPU, depth data for the side-by-side picture are encoded to generate a second enhancement layer, wherein the second enhancement layer is coded based on to the base layer. Alternative single, dual, and multi-layer depth map delivery systems are also presented.

Frame compatible depth map delivery formats for stereoscopic and auto-stereoscopic displays

Growing community of inventors

Los Gatos, CA, United States of America

Samir N Hulyalkar