The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 04, 2026

Filed:

Sep. 23, 2024
Applicant:

Snap Inc., Santa Monica, CA (US);

Inventors:

Hsin-Ying Lee, San Jose, CA (US);

Willi Menapace, Los Angeles, CA (US);

Aliaksandr Siarohin, Santa Monica, CA (US);

Sergey Tulyakov, Santa Monica, CA (US);

Chaoyang Wang, Los Angeles, CA (US);

Heng Yu, Los Angeles, CA (US);

Peiye Zhuang, Culver City, CA (US);

Assignee:

Snap Inc., Santa Monica, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04N 13/279 (2018.01); G06T 17/00 (2006.01); H04N 13/282 (2018.01); H04N 21/81 (2011.01);
U.S. Cl.
CPC ...
H04N 13/279 (2018.05); G06T 17/00 (2013.01); H04N 13/282 (2018.05); H04N 21/816 (2013.01);
Abstract

A method for generating photorealistic 4D scenes from text inputs is disclosed. The method utilizes a text-to-video diffusion model to generate a reference video and a freeze-time video. A canonical 3D representation is reconstructed using deformable 3D Gaussian Splats (D-3DGS) based on the freeze-time video. Temporal deformations are learned to capture dynamic interactions in the reference video. The method employs a novel Score Distillation Sampling strategy combining multi-view and temporal aspects to enhance consistency and robustness. The resulting 4D scenes feature multiple objects interacting with detailed background environments, viewable from different angles and times. The method enables flexible camera control and integration with augmented and virtual reality applications. Some examples include features such as image-to-4D generation.


Find Patent Forward Citations

Loading…