Reconstruction of body motion using a camera system camera system for reconstruction of body motion based on 3d joint heat map

Abstract

A method may include collecting first and second image data of an object motion, the first and second image data respectively including first and second frames captured by a first and a second camera. The method may include identifying an object included in the first and second frames and modeling two-dimensional pose estimations of the object for each identified frame. The two-dimensional pose estimations may indicate coordinate positions of the object features that contribute to the object motion. The method may include generating a first and a second three-dimensional joint heatmap corresponding to the object identified in the first and second frames based on features indicated in the two-dimensional pose estimations. The method may include determining a time delay between the first and second cameras based on the three-dimensional joint heatmaps and generating a motion journal that summarizes the motion associated with the object based on the time delay.