Adobe, Inc.

Siddhartha Chaudhuri

Vladimir Kim

Noam Aigerman

Alec Jacobson

Hsueh-ti Liu

Radomir Mech

Vineet Batra

Duygu Ceylan Aksit

Emiliano Gambaretto

Kevin Wampler

Jonathan Eisenmann

Sumit Dhingra

Giorgio Gori

Nathan Aaron Carr

Matthew David Fisher

Ankit Phogat

Jun Saito

Ashish Jindal

Thibault Groueix

Sanjeev Muralikrishnan

Kunal Gupta

Bo Sun

Methods, systems, and non-transitory computer readable storage media are disclosed that utilizes machine learning models for patch retrieval and deformation in completing three-dimensional digital shapes. In particular, in one or more implementations the disclosed systems utilize a machine learning model to predict a coarse completion shape from an incomplete 3D digital shape. The disclosed systems sample coarse 3D patches from the coarse 3D digital shape and learn a shape distance function to retrieve detailed 3D shape patches in the input shape. Moreover, the disclosed systems learn a deformation for each retrieved patch and blending weights to integrate the retrieved patches into a continuous surface.

Utilizing machine learning models for patch retrieval and deformation in completing three-dimensional digital shapes

Methods, systems, and non-transitory computer readable storage media are disclosed for generating digital chain pull paintings in digital images. The disclosed system generate, utilizing a neural network, a plurality of matrices over an ambient space for a plurality of polygons of a three-dimensional mesh based on a plurality of features of the plurality of polygons associated with the three-dimensional mesh. The disclosed system determines a gradient field based on the plurality of matrices of the plurality of polygons. The disclosed system generates a mapping for the three-dimensional mesh based on the gradient field and a differential operator corresponding to the three-dimensional mesh.

Generating mappings of three-dimensional meshes utilizing neural network gradient fields

In implementations of systems for visualizing vector graphics in three-dimensional scenes, a computing device implements a projection system to receive input data describing a digital image depicting a three-dimensional scene and a vector graphic to be projected into the three-dimensional scene. The projection system generates a depth image by estimating disparity values for pixels of the digital image. A three-dimensional mesh is computed that approximates the three-dimensional scene based on the depth image. The projection system projects the vector graphic onto the digital image by transforming the vector graphic based on the three-dimensional mesh.

Visualizing vector graphics in three-dimensional scenes

This disclosure describes one or more implementations of systems, non-transitory computer-readable media, and methods that apply a resolution independent, vector-based decal on a 3D object. In one or more implementations, the disclosed systems apply piecewise non-linear transformation on an input decal vector geometry to align the decal with a surface of an underlying 3D object. To apply a vector-based decal on a 3D object, in certain embodiments, the disclosed systems parameterize a 3D mesh of the 3D object to create a mesh map. Moreover, in some instances, the disclosed systems determine intersections between edges of a decal geometry and edges of the mesh map to add vertices to the decal geometry at the intersections. Additionally, in some implementations, the disclosed systems lift and project vertices of the decal geometry into three dimensions to align the vertices with faces of the 3D mesh of the 3D object.

Applying vector-based decals on three-dimensional objects

Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing one or more neural networks to recursively subdivide a three-dimensional mesh according to local geometries of vertices in the three-dimensional mesh. For example, the disclosed system can determine a local geometry (e.g., a one-ring neighborhood of half-flaps) for each vertex in a three-dimensional mesh. For each subdivision iteration, the disclosed system can then utilize a neural network to determine displacement coordinates for existing vertices in the three-dimensional mesh and coordinates for new vertices added to edges between the existing vertices in the three-dimensional mesh in accordance with the local geometries of the existing vertices. Furthermore, the disclosed system can generate a subdivided three-dimensional mesh based on the determined displacement coordinates for the existing vertices and the determined coordinates for the new vertices.

Subdividing a three-dimensional mesh utilizing a neural network

Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.

Intuitive editing of three-dimensional models

Techniques are described herein for generating and using a unified shape representation that encompasses features of different types of shape representations. In some embodiments, the unified shape representation is a unicode comprising a vector of embeddings and values for the embeddings. The embedding values are inferred, using a neural network that has been trained on different types of shape representations, based on a first representation of a three-dimensional (3D) shape. The first representation is received as input to the trained neural network and corresponds to a first type of shape representation. At least one embedding has a value dependent on a feature provided by a second type of shape representation and not provided by the first type of shape representation. The value of the at least one embedding is inferred based upon the first representation and in the absence of the second type of shape representation for the 3D shape.

Unified shape representation

Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

Growing community of inventors

Bengaluru, India

Siddhartha Chaudhuri