Shanghai United Imaging Intelligence Co., Ltd.

Liangchen Song

Described herein are systems, methods, and instrumentalities associated with estimating the motions of multiple 3D points in a scene and predicting a view of scene based on the estimated motions. The tasks may be accomplished using one or more machine-learning (ML) models. A first ML model may be used to predict motion-embedding features for a temporal state of a scene, based on motion-embedding features for previous states. A second ML model may be used to predict a motion field representing displacement or deformation of the multiple 3D points from a source time to a target time. Then, a third ML model may be used to predict respective image properties of the 3D points based on their updated locations at the target time and/or a viewing direction. An image of the scene at the target time may then be generated based on the predicted image properties of the 3D points.

Growing community of inventors

Sunnyvale, CA, United States of America

Liangchen Song