The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 04, 2025

Filed:

Jan. 07, 2022
Applicant:

Meta Platforms Technologies, Llc, Menlo Park, CA (US);

Inventors:

Zhaoyang Lv, Redmond, WA (US);

Miroslava Slavcheva, Seattle, WA (US);

Tianye Li, Los Angeles, CA (US);

Michael Zollhoefer, Pittsburgh, PA (US);

Simon Gareth Green, Deptford, GB;

Tanner Schmidt, Seattle, WA (US);

Michael Goesele, Woodinville, WA (US);

Steven John Lovegrove, Woodinville, WA (US);

Christoph Lassner, San Francisco, CA (US);

Changil Kim, Seattle, WA (US);

Assignee:

META PLATFORMS TECHNOLOGIES, LLC, Menlo Park, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06T 7/00 (2017.01);
U.S. Cl.
CPC ...
G06T 7/97 (2017.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01);
Abstract

In one embodiment, a method includes initializing latent codes respectively associated with times associated with frames in a training video of a scene captured by a camera. For each of the frames, a system (1) generates rendered pixel values for a set of pixels in the frame by querying NeRF using the latent code associated with the frame, a camera viewpoint associated with the frame, and ray directions associated with the set of pixels, and (2) updates the latent code associated with the frame and the NeRF based on comparisons between the rendered pixel values and original pixel values for the set of pixels. Once trained, the system renders output frames for an output video of the scene, wherein each output frame is rendered by querying the updated NeRF using one of the updated latent codes corresponding to a desired time associated with the output frame.


Find Patent Forward Citations

Loading…