Microsoft Technology Licensing, LLC

Noranart Vesdapunt

Baoyuan Wang

Wei-Chih Chen

Joshua Bryan Weisberg

Hsiang-Tao Wu

Gil Moshe Nahmias

Ying Jin

Kandarpkumar J Makwana

Pierrick Arsenault

Melissa Regalia

Wenbin Zhu

Zeyu Chen

Utkarsh Sinha

Gil M Nahmias

Techniques performed by a data processing system for reconstructing a three-dimensional (3D) model of the face of a human subject herein include obtaining source data comprising a two-dimensional (2D) image, three-dimensional (3D) image, or depth information representing a face of a human subject. Reconstructing the 3D model of the face also includes generating a 3D model of the face of the human subject based on the source data by analyzing the source data to produce a coarse 3D model of the face of the human subject, and refining the coarse 3D model through free form deformation to produce a fitted 3D model. The coarse 3D model may be a 3D Morphable Model (3DMM), and the coarse 3D model may be refined through free-form deformation in which the deformation of the mesh is limited by applying an as-rigid-as-possible (ARAP) deformation constraint.

Reinforced differentiable attribute for 3D face reconstruction

Described herein is a human pose prediction system and method. An image comprising at least a portion of a human body is received. A trained neural network is used to predict one or more human features (e.g., joints/aspects of a human body) within the received image, and, to predict one or more human poses in accordance with the predicted one or more human features. The trained neural network can be an end-to-end trained, single stage deep neural network. An action is performed based on the predicted one or more human poses. For example, the human pose(s) can be displayed as an overlay with received image.

Human pose estimation

Techniques for automatically selecting image frames from a video and providing the selected image frames to a device for display are disclosed.

Deep learning on image frames to generate a summary

Growing community of inventors

Bellevue, WA, United States of America

Noranart Vesdapunt