Bertec Corporation

Bedirhan Uguz

Necip Berme

Mohan Chandra Baro

Emre Akbas

Ozhan Suat

Batuhan Karagoz

Utku Aktas

A system for estimating a three dimensional pose of one or more persons in a scene is disclosed herein. The system includes one or more cameras and a data processor configured to execute computer executable instructions. The computer executable instructions include: (i) receiving the one or more images of the scene from the one or more cameras; (ii) extracting features from the one or more images of the scene for providing inputs to a three dimensional pose estimation neural network; (iii) generating, by using the three dimensional pose estimation neural network, vertices of a canonical human mesh model for the one or more images of the scene; (iv) retrieving a weight matrix from an annotation server that corresponds to a desired keypoint set; and (v) generating the desired keypoint set by multiplying the retrieved weight matrix with the vertices of the canonical human mesh model.

System for estimating a three dimensional pose of one or more persons in a scene

A system for training neural networks that predict the parameters of a human mesh model is disclosed herein. The system includes at least one camera and a data processor configured to execute computer executable instructions for: receiving a first frame and a second frame of a video from the at least one camera; extracting first and second image data from the first and second frames of the video; inputting the sequence of frames of the video into a human mesh estimator module, the human mesh estimator module estimating mesh parameters from the sequence of frames of the video so as to determine a predicted mesh; and generating a training signal for input into the human mesh estimator module by using a two-dimensional keypoint loss module that compares a first set of two-dimensional image-based keypoints to a second set of two-dimensional model-based keypoints.

System for training neural networks that predict the parameters of a human mesh model using dense depth and part-based UV map annotations

A system for estimating a pose of one or more persons in a scene includes a camera configured to capture one or more images of the scene; and a data processor configured to execute computer executable instructions for: (i) receiving the one or more images of the scene from the camera; (ii) extracting features from the one or more images of the scene for providing inputs to a keypoint subnet and a person detection subnet; (iii) generating one or more keypoints using the keypoint subnet; (iv) generating one or more person instances using the person detection subnet; (v) assigning the one or more keypoints to the one or more person instances by learning pose structures from image data; and (vi) determining one or more poses of the one or more persons in the scene using the assignment of the one or more keypoints to the one or more person instances.

Growing community of inventors

Pittsburgh, PA, United States of America

Bedirhan Uguz