Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Meta Platforms, Inc.

Simon Gareth Green

Steven John Lovegrove

Richard Andrew Newcombe

Renzo De Nardi

Yuheng Ren

Michael Zollhoefer

Thomas John Whelan

Chetan Parag Gupta

Changil Kim

Tanner Schmidt

Michael Goesele

Tianye Li

Zhaoyang Lv

Miroslava Slavcheva

Christoph Lassner

In one embodiment, a method includes initializing latent codes respectively associated with times associated with frames in a training video of a scene captured by a camera. For each of the frames, a system (1) generates rendered pixel values for a set of pixels in the frame by querying NeRF using the latent code associated with the frame, a camera viewpoint associated with the frame, and ray directions associated with the set of pixels, and (2) updates the latent code associated with the frame and the NeRF based on comparisons between the rendered pixel values and original pixel values for the set of pixels. Once trained, the system renders output frames for an output video of the scene, wherein each output frame is rendered by querying the updated NeRF using one of the updated latent codes corresponding to a desired time associated with the output frame.

Neural 3D video synthesis

Systems, methods, and non-transitory computer-readable media can obtain information describing a set of views corresponding to a rendered environment, the views being captured based on a specified virtual camera configuration; determine at least one representation in which information describing the set of views is formatted; and output virtual reality content based at least in part on the at least one representation.

Systems and methods for capturing content

The disclosed computer-implemented method may include comprising identifying, within a real-world environment, a position of a user relative to a safety boundary. The position of the user is identified by a head-mounted display system comprising a display device. The display device is configured to at least partially obscure visibility of the real-world environment to the user. The method may further include selecting, based on the position of the user, at least a portion of a model of the real-world environment, rendering the portion of the model of the real-world environment, and displaying the rendered portion of the model of the real-world environment via the display device as a notification of the position of the user relative to the safety boundary. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for providing a mobile artificial reality user with environmental awareness

Growing community of inventors

Deptford, United Kingdom

Simon Gareth Green