Nvidia Corporation

Joey Litalien

Sanja Fidler

Charles T Loop

Jun Gao

Morgan Samuel McGuire

Karsten Julian Kreis

Wenzheng Chen

Kangxue Yin

Or Litany

Towaki Alan Takikawa

Zian Wang

Sameh Khamis

Clement Tse Tsian Christophe Louis Fuji Tsang

In various examples, information may be received for a 3D model, such as 3D geometry information, lighting information, and material information. A machine learning model may be trained to disentangle the 3D geometry information, the lighting information, and/or material information from input data to provide the information, which may be used to project geometry of the 3D model onto an image plane to generate a mapping between pixels and portions of the 3D model. Rasterization may then use the mapping to determine which pixels are covered and in what manner, by the geometry. The mapping may also be used to compute radiance for points corresponding to the one or more 3D models using light transport simulation. Disclosed approaches may be used in various applications, such as image editing, 3D model editing, synthetic data generation, and/or data set augmentation.

Hybrid differentiable rendering for light transport simulation systems and applications

Systems and methods are described for rendering complex surfaces or geometry. In at least one embodiment, neural signed distance functions (SDFs) can be used that efficiently capture multiple levels of detail (LODs), and that can be used to reconstruct multi-dimensional geometry or surfaces with high image quality. An example architecture can represent complex shapes in a compressed format with high visual fidelity, and can generalize across different geometries from a single learned example. Extremely small multi-layer perceptrons (MLPs) can be used with an octree-based feature representation for the learned neural SDFs.

Real-time rendering with implicit shapes

Growing community of inventors

CA

Joey Litalien