Disney Enterprises, Inc.

Eidgenossische Technische Hochschule Zurich

Ian Mcgonigal

Christopher Richard Schroers

Mark Joseph Meyer

Abdelaziz Djelouah

Karlis Martins Briedis

Marios Papas

Markus Plack

Raphael François Otriz

A system includes a processor and a memory storing software code. The processor executes the software code to receive a first rendered image having first color and auxiliary buffers, receive a second rendered image having second color and auxiliary buffers, provide a third auxiliary buffer for an intermediate image to be interpolated, and identify one or more context features from each of the color buffers and the auxiliary buffers. The software code further interpolates, based on the context features, the intermediate image to provide an interpolated image, determines, based on the one or more context features from each of the first, second, and third auxiliary buffers, a rendering mask for producing one or more rendered sub-portions of the intermediate image, partially renders, using the rendering mask, the intermediate image to provide a partially rendered image, and blends the interpolated image and the partially rendered image to provide a composite image.

Kernel-based frame interpolation for spatio-temporally adaptive rendering

One embodiment of the present invention sets forth a technique for performing frame interpolation. The technique includes generating (i) a first set of feature maps based on a first set of rendering features associated with a first key frame, (ii) a second set of feature maps based on a second set of rendering features associated with a second key frame, and (iii) a third set of feature maps based on a third set of rendering features associated with a target frame. The technique also includes applying one or more neural networks to the first, second, and third set of feature maps to generate a set of mappings from a first set of pixels in the first key frame to a second set of pixels in the target frame. The technique further includes generating the target frame based on the set of mappings.

Frame interpolation for rendered content

Growing community of inventors

London, United Kingdom

Ian Mcgonigal