Microsoft Technology Licensing, LLC

Shideh Rezaeifar

Matthew Alastair Johnson

Stephan Joachim Garbin

Jingjing Shen

Virginia Estellers Casas

Julien Pascal Christophe Valentin

Marek Adam Kowalski

Stanislaw Kacper Szymanowicz

To compute an image of a dynamic 3D scene comprising a 3D object, a description of a deformation of the 3D object is received, the description comprising a cage of primitive 3D elements and associated animation data from a physics engine or an articulated object model. For a pixel of the image the method computes a ray from a virtual camera through the pixel into the cage animated according to the animation data and computes a plurality of samples on the ray. Each sample is a 3D position and view direction in one of the 3D elements. The method computes a transformation of the samples into a canonical cage. For each transformed sample, the method queries a learnt radiance field parameterization of the 3D scene to obtain a color value and an opacity value. A volume rendering method is applied to the color and opacity values producing a pixel value of the image.

Computing images of controllable dynamic scenes

Growing community of inventors

Basel, Switzerland

Shideh Rezaeifar