Mitsubishi Electric Research Laboratories, Inc.

Pedro Miraldo

Moitreya Chatterjee

Embodiments for rendering a 2D image of a dynamic 3D scene from different view angles using a neural radiance field (NeRF) are provided. In this regard, an AI image processing system is configured to process coordinates of a point in a dynamic 3D scene with an RNN over a number of time steps indicated by a time instance of interest to produce motion information of the point at the time instance of interest, process the motion information with a fully connected neural network to produce a displacement of the point from the coordinates in the dynamic 3D scene, and process a displaced point from a view angle of interest with the NeRF to render the point on the 2D image of the dynamic 3D scene at the time instance of interest. The displaced point is generated based on an estimate of the displacement of the point by leveraging motion cues.

Growing community of inventors

Cambridge, MA, United States of America

Pedro Miraldo