Disney Enterprises, Inc.

Eidgenossische Technische Hochschule Zurich

Eth Zurich

Manuel Lang

Alexander Sorkine Hornung

Markus H Gross

Oliver Wang

Aljosa Aleksej Andrej Smolic

Philipp Kraehenbuehl

Nikolce Stefanoski

Aljosa A Smolic

Wojciech Matusik

Robert Walker Sumner

Kenneth John Mitchell

Wojciech Jarosz

Aljoscha Smolic

Derek Nowrouzezahrai

Simon Heinzle

Pierre Greisen

Pedro Christian Espinosa Fricke

Yongzhe Wang

Thomas Williams

Stefan C Geiger

Miquel À Farré

Aljosa Smolic

Techniques are disclosed for generating autostereoscopic video content. A multiscopic video frame is received that includes a first image and a second image. The first and second images are analyzed to determine a set of image characteristics. A mapping function is determined based on the set of image characteristics. At least a third image is generated based on the mapping function and added to the multiscopic video frame.

Synthesizing views based on image domain warping

Techniques are provided for content-aware video retargeting. An interactive framework combines key frame-based constraint editing with numerous automatic algorithms for video analysis. This combination gives content producers a high level of control of the retargeting process. One component of the framework is a non-uniform, pixel-accurate warp to the target resolution that considers automatic as well as interactively-defined features. Automatic features comprise video saliency, edge preservation at the pixel resolution, and scene cut detection to enforce bilateral temporal coherence. Additional high level constraints can be added by the producer to achieve a consistent scene composition across arbitrary output formats. Advantageously, embodiments of the invention provide a better visual result for retargeted video when compared to using conventional techniques.

Art-directable retargeting for streaming video

Techniques are disclosed for retargeting images. The techniques include receiving one or more input images, computing a two-dimensional saliency map based on the input images in order to determine one or more visually important features associated with the input images, projecting the saliency map horizontally and vertically to create at least one of a horizontal and vertical saliency profile, and scaling at least one of the horizontal and vertical saliency profiles. The techniques further include creating an output image based on the scaled saliency profiles. Low saliency areas are scaled non-uniformly while high saliency areas are scaled uniformly. Temporal stability is achieved by filtering the horizontal resampling pattern and the vertical resampling pattern over time. Image retargeting is achieved with greater efficiency and lower compute power, resulting in a retargeting architecture that may be implemented in a circuit suitable for mobile applications such as mobile phones and tablet computers.

Video retargeting using content-dependent scaling vectors

Techniques for displaying content using an augmented reality device are described. Embodiments provide a visual scene for display, the visual scene captured using one or more camera devices of the augmented reality device. Embodiments adjust physical display geometry characteristics of the visual scene to correct for optimal projection. Additionally, illumination characteristics of the visual scene are modified based on environmental illumination data to improve realism of the visual scene when it is displayed. Embodiments further adjust display characteristics of the visual scene to improve tone mapping output. The adjusted visual scene is then output for display on the augmented reality device.

Virtual lens-rendering for augmented reality lens

A video sequence having a plurality of frames is received. A feature in a first frame from the plurality of frames and a first position of the feature in the first frame are detected. The position of the feature in a second frame from the plurality of frames is estimated to determine a second position. A displacement vector between the first position and the second position is also computed. A plurality of content characteristics is determined for the first frame and the second frame. The displacement vector is spatially diffused with a spatial filter over a frame from the plurality of frames to generate a spatially diffused displacement vector field. The spatial filter utilizes the plurality of content characteristics. A temporal filter temporally diffuses over a video volume the spatially diffused displacement vector field to generate a spatiotemporal vector field. The temporal filter utilizes the plurality of content characteristics.

Practical temporal consistency for video applications

An integrated system and method for content-aware video retargeting. An interactive framework combines key frame-based constraint editing with numerous automatic algorithms for video analysis. This combination gives content producers a high level of control of the retargeting process. One component of the framework is a non-uniform, pixel-accurate warp to the target resolution that considers automatic as well as interactively-defined features. Automatic features comprise video saliency, edge preservation at the pixel resolution, and scene cut detection to enforce bilateral temporal coherence. Additional high level constraints can be added by the producer to achieve a consistent scene composition across arbitrary output formats. Advantageously, embodiments of the invention provide a better visual result for retargeted video when compared to using conventional techniques.

Systems, methods and articles of manufacture are disclosed for stereoscopically editing video content. In one embodiment, image pairs of a sequence may be stereoscopically modified by altering at least one image of the image pair. The at least one image may be altered using at least one mapping function. The at least one image may also be altered based on a saliency of the image pair. The at least one image may also be altered based on disparities between the image pair. Advantageously, stereoscopic properties of video content may be edited more conveniently and efficiently.

Stereoscopic editing for video production, post-production and display adaptation

Systems and methods for generating a stereoscopic pair of images from a monoscopic image input are described. At least one brushstroke input corresponding to a location in the monoscopic image is received. A saliency map and edge map of the monoscopic image are computed. A first image warp and a second image warp are computed using the at least one brushstroke, the saliency map, and the edge map. A stereoscopic pair of images are generated from the first image warp and the second image warp.

Discontinuous warping for 2D-to-3D conversions

Systems, methods and articles of manufacture are disclosed for performing scalable video coding. In one embodiment, non-linear functions are used to predict source video data using retargeted video data. Differences may be determined between the predicted video data and the source video data. The retargeted video data, the non-linear functions, and the differences may be jointly encoded into a scalable bitstream. The scalable bitstream may be transmitted and selectively decoded to produce output video for one of a plurality of predefined target platforms.

Growing community of inventors

Zurich, Switzerland

Manuel Lang