Disney Enterprises, Inc.

Eidgenossische Technische Hochschule Zurich

Gottfried Wilhelm Leibniz Universitat Hannover

Nikolce Stefanoski

Tunc Ozan Aydin

Aljosa A Smolic

Aljoscha Smolic

Simone Croci

Markus Gross

Aljosa Aleksej Andrej Smolic

Mark Arana

Alexander Sorkine Hornung

Manuel Lang

Alexandre Chapiro

Oliver Wang

Markus H Gross

Miquel Angel Farre Guiu

Anselm Grundhofer

Jörn Ostermann

Adriano Galati

Miquel À Farré

Pedro Christian Espinosa Fricke

Yongzhe Wang

Patrick Klie

Daniel Luginbuhl

Jing Liu

Novel systems and methods are described for creating, compressing, and distributing video or image content graded for a plurality of displays with different dynamic ranges. In implementations, the created content is 'continuous dynamic range' (CDR) content&#x2014;a novel representation of pixel-luminance as a function of display dynamic range. The creation of the CDR content includes grading a source content for a minimum dynamic range and a maximum dynamic range, and defining a luminance of each pixel of an image or video frame of the source content as a continuous function between the minimum and the maximum dynamic ranges. In additional implementations, a novel graphical user interface for creating and editing the CDR content is described.

Methods for creating and distributing art-directable continuous dynamic range video

Techniques are disclosed for view generation based on a video coding scheme. A bitstream is received that is encoded based on the video coding scheme. The bitstream includes video, quantized warp map offsets, and a message of a message type specified by the video coding scheme. Depth samples decoded from the first bitstream are interpreted as quantized warp map offsets, based on a first syntax element contained in the message. Warp maps are generated based on the quantized warp map offsets and a second syntax element contained in the message. Views are generated using image-domain warping and based on the video and the warp maps.

Signaling warp maps using a high efficiency video coding (HEVC) extension for 3D video coding

Disclosed is a system for linking transmedia content subsets. A memory stores a plurality of transmedia content data items and associated linking data, which define time-ordered content links between the transmedia content data items. The transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a transmedia content model that represents the transmedia content data items as nodes and the content links between the transmedia content data items as edges in one or more time-varying graphs. A processor is configured to associate the transmedia content data items with the time-ordered content links and store the linking data in the memory. It assigns the transmedia content data items to nodes of a graph structure, assign the time-ordered content links to edges of the graph structure, and store them in the transmedia content model.

User modelling and metadata of transmedia content data

Systems and methods are disclosed for weighting the image quality prediction of any visual-attention-agnostic quality metric with a saliency map. By accounting for the salient regions of an image or video frame, the disclosed systems and methods may dramatically improve the precision of the visual-attention-agnostic quality metric during image or video quality assessment. In one implementation, a method of saliency-weighted video quality assessment includes: determining a per-pixel image quality vector of an encoded video frame; determining per-pixel saliency values of the encoded video frame or a reference video frame corresponding to the encoded video frame; and computing a saliency-weighted image quality metric of the encoded video frame by weighting the per-pixel image quality vector using the per-pixel saliency values.

Saliency-weighted video quality assessment

A video coding pipeline is provided that can accommodate high dynamic range (HDR) and wide color gamut (WCG) content at a fixed bitrate. The video coding pipeline relies on separate chromaticity and luminance-specific transforms in order to process image content. Image content may be converted into a nearly perceptually uniform color space for coding in constant luminance. Moreover, chromaticity transforms are utilized which reduce coding errors in the chroma components (at the fixed bitrate) by enlarging the distribution of code words for compression.

Perceptual color transformations for wide color gamut video coding

Methods and systems for calibrating devices reproducing high dimensional data, such as calibrating High Dynamic Range (HDR) displays that reproduce chromatic data. Methods include mapping input data into calibrated data using calibration information retrieved from spatial data structures that encode a calibration function. The calibration function may be represented by any multidimensional scattered data interpolation methods such as Thin-Plate Splines. To efficiently represent and access the calibration information in runtime, the calibration function is recursively sampled based on guidance dataset. In an embodiment, an HDR display may be adaptively calibrated using a dynamic color guidance dataset and dynamic spatial data structures.

Chromatic Calibration of an HDR display using 3D octree forests

There is provided a server for providing an interactive broadcast. The server includes a memory configured to store a story manager including an event controller, a story controller and an action processor, and a hardware processor configured to execute the story manager. The story manager is configured to provide, using the event controller, an event based on a control script, story elements metadata, one or more user performance analyses, and one or more user preferences. The story manager is also configured to generate, using the story controller, an action command based on the event received from the event controller and a story state. The story manager is further configured to determine, using the action processor, an action corresponding to the action command for initiating one or more control processes for distributing the interactive broadcast.

Interactive broadcast

Embodiments herein disclose a tone mapping system that generates a base layer by filtering a frame in an HDR video. The tone mapping system then generates a tone curve using a tone mapping parameter derived from the base layer&#x2014;e.g., a mean or maximum luminance value. Once the tone curve parameter is identified, the system performs temporal filtering to smooth out inconsistencies between the current value of the tone curve parameter and the values of tone curve parameter of at least one previous frame in the HDR video. The tone mapping system applies the temporally filtered tone curve to the base layer to generate a temporally coherent layer. The temporally coherent base layer can be combined with a detail layer derived from the HDR video to generate a frame of a tone mapped video.

High dynamic range tone mapping

Techniques are disclosed for generating autostereoscopic video content. A multiscopic video frame is received that includes a first image and a second image. The first and second images are analyzed to determine a set of image characteristics. A mapping function is determined based on the set of image characteristics. At least a third image is generated based on the mapping function and added to the multiscopic video frame.

Synthesizing views based on image domain warping

Approaches are described for tone-mapping an image frame in a sequence of image frames. A tone-mapping pipeline applies a spatiotemporal filter to each pixel of the image frame, based on a forward optical flow and a backward optical flow, to produce a base layer image. The tone-mapping pipeline applies a temporal filter to each pixel of the image frame, based on the forward and backward optical flows, to produce a temporally filtered frame. The tone-mapping pipeline produces a detail layer image based on the base layer image and the temporally filtered frame. The tone-mapping pipeline produces a detail layer image based on the base layer image and the temporally filtered frame. The tone-mapping pipeline applies a tone curve to the base and detail layer images to produce a tone-mapped base and detail layer image, respectively, and combines the tone-mapped base and detail layer images to produce a tone-mapped image frame.

Temporally coherent local tone mapping of high dynamic range video

Approaches are described for filtering a first image frame in a sequence of image frames. A tone-mapping pipeline applies a spatiotemporal filter to each pixel of the first image frame, based on a forward optical flow and a backward optical flow, to produce a base layer image. The tone-mapping pipeline applies a temporal filter to each pixel of the first image frame, based on the forward optical flow and the backward optical flow, to produce a temporally filtered frame. The tone-mapping pipeline produces a detail layer image based on the base layer image and the temporally filtered frame.

Growing community of inventors

Zurich, Switzerland

Nikolce Stefanoski