Tsinghua University

Haozhe Lin

Lu Fang

Jinzhi Zhang

Zequn Chen

In a method for generating a multi-dimensional scene graph with a complex light field, entity features of entities are obtained by inputting respective 2-Dimensional (2D) images captured in multiple view directions into an object detection model, and features of a respective single-view-direction scene graph are obtained by predicting a semantic relation among the entities contained in a corresponding 2D image captured in each view direction. An entity correlation for an entity among the multiple view directions is determined as an entity re-identification result. A multi-dimensional bounding box for the entity is established based on the entity re-identification result and a geometric constraint of camera parameters. A feature fusion result is obtained by fusing features of respective single-view-direction scene graphs in the multiple view directions. The multi-dimensional scene graph with the complex light field is established.

Growing community of inventors

Beijing, China

Haozhe Lin