Google Inc.

Other

Mihai Zanfir

William T Freeman

Rahul Sukthankar

Eduard Gabriel Bazavan

Cristian Sminchisescu

Andrei Zanfir

Alin-lonut Popa

Elisabeta Marinoiu

The present disclosure is generally directed to reconstructing representations of bodies from images. An example method of the present disclosure includes inputting, into a machine-learned reconstruction model, input data descriptive of an image depicting a body; predicting, using a machine-learned marker prediction component of the reconstruction model, a set of surface marker locations on the body; and outputting, using a machine-learned marker poser component of the reconstruction model, an output representation of the body that corresponds to the set of surface marker locations. In the example method, one or more parameters of the reconstruction model were learned at least in part based on a consistency loss corresponding to a distance between relaxed-constraint representations generated from a prior set of surface marker locations predicted according to the one or more parameters and parametric representations generated from the prior set using kinematic constraints associated with the body.

Systems and methods for reconstructing body shape and pose

Systems and methods are directed to a method for estimation of an object state from image data. The method can include obtaining two-dimensional image data depicting an object. The method can include processing, with an estimation portion of a machine-learned object state estimation model, the two-dimensional image data to obtain an initial estimated state of the object. The method can include, for each of one or more refinement iterations, obtaining a previous loss value associated with a previous estimated state for the object, processing the previous loss value to obtain a current estimated state of the object, and evaluating a loss function to determine a loss value associated with the current estimated state of the object. The method can include providing a final estimated state for the object.

Systems and methods for refined object estimation from image data

The present invention is directed to generating an image based on first image data of a first person having first pose, first body shape, and first clothing and second image data of a second person having second pose, a second body shape, and second clothing. The generated image represents a transfer of appearance (e.g., clothing) of the second person to the first person. This is achieved by modeling 3d human pose and body shape for each of the persons via triangle mesh, fitting the 3d human pose and body shape models to the images of the persons, transferring appearance using barycentric methods for commonly visible vertices, and learning to color the remaining ones using deep image synthesis techniques.

Image processing method, system and device for synthesizing human appearance

Growing community of inventors

Bucharest, Romania

Mihai Zanfir