Disney Enterprises, Inc.

Eth Zurich (eidgenossische Technische Hochschule Zurich)

Xianyao Zhang

Marios Papas

Tunc Ozan Aydin

Farnood Salehi

Marco Manzi

Gerhard Roethlin

Melvin Ott

Shilin Zhu

A system includes a hardware processor and a system memory storing software code and one or more machine learning (ML) models. The hardware processor is configured to execute the software code to train a first ML model of the one or more ML models as a denoising feature selector, generate, using the trained first ML model a plurality of candidate feature sets, and identify a best volumetric feature set of the plurality of candidate feature sets using a predetermined selection criterion. The hardware processor is further configured to execute the software code to train, using the identified best volumetric feature set, one of the first ML model or a second ML model of the one or more ML models as a denoiser, receive an image including noise due to rendering, and denoise, using the trained denoiser, the noise due to rendering to produce a denoised image.

Volume denoising with feature selection

A system includes a pre-processor configured to receive three-dimensional (3-D) image data, flatten the 3-D image data to produce corresponding two-dimensional (2-D) image data, and concatenate the 3-D image data and the corresponding 2-D image data to provide concatenated image data. The system further includes an encoder including one or more first neural networks (NNs), the encoder configured to use the one or more first NNs to encode the concatenated image data to provide encoded data, a decoder including one or more second NNs, the decoder configured to use the one or more second NNs to decode the encoded data to provide decoded data, and a reconstructor including a plurality of hybrid 2-D/3-D reconstructors configured to reconstruct the decoded data to provide a denoised 3-D output image corresponding to the 3-D image data.

Hybrid two-dimensional and three-dimensional denoiser

Growing community of inventors

Zürich, Switzerland

Xianyao Zhang