The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 26, 2025
Filed:
Dec. 28, 2022
Menglei Chai, Los Angeles, CA (US);
Hsin-ying Lee, San Jose, CA (US);
Willi Menapace, Santa Monica, CA (US);
Kyle Olszewski, Los Angeles, CA (US);
Jian Ren, Hermosa Beach, CA (US);
Aliaksandr Siarohin, Los Angeles, CA (US);
Ivan Skorokhodov, Los Angeles, CA (US);
Sergey Tulyakov, Santa Monica, CA (US);
Menglei Chai, Los Angeles, CA (US);
Hsin-Ying Lee, San Jose, CA (US);
Willi Menapace, Santa Monica, CA (US);
Kyle Olszewski, Los Angeles, CA (US);
Jian Ren, Hermosa Beach, CA (US);
Aliaksandr Siarohin, Los Angeles, CA (US);
Ivan Skorokhodov, Los Angeles, CA (US);
Sergey Tulyakov, Santa Monica, CA (US);
Snap Inc., Santa Monica, CA (US);
Abstract
Unsupervised volumetric 3D animation (UVA) of non-rigid deformable objects without annotations learns the 3D structure and dynamics of objects solely from single-view red/green/blue (RGB) videos and decomposes the single-view RGB videos into semantically meaningful parts that can be tracked and animated. Using a 3D autodecoder framework, paired with a keypoint estimator via a differentiable perspective-n-point (PnP) algorithm, the UVA model learns the underlying object 3D geometry and parts decomposition in an entirely unsupervised manner from still or video images. This allows the UVA model to perform 3D segmentation, 3D keypoint estimation, novel view synthesis, and animation. The UVA model can obtain animatable 3D objects from a single or a few images. The UVA method also features a space in which all objects are represented in their canonical, animation-ready form. Applications include the creation of lenses from images or videos for social media applications.