Naver Corporation

Naver Labs Corporation

Romain Bregier

Philippe Weinzaepfel

Gregory Rogez

Vincent Leroy

Hadrien Combaluzier

Thibault Groueix

Ioannis Kalantidis

Fabien Baradel

A training system includes: a neural network model configured to determine three-dimensional coordinates of joints, respectively, representing poses of animals in images, where the neural network model is trained using a first training dataset including: images including animals; and coordinates of joints of the animals in the images, respectively; and a training module configured to, after the training of the neural network model using the first training dataset, train the neural network model using a second training dataset including motion capture data, where the motion capture data does not include images of animals and includes measured coordinates at points, respectively, on animals.

Pose estimation systems and methods trained using motion capture data

A system for generating whole body poses includes: a body regression module configured to generate a first pose of a body of an animal in an input image by regressing from a stored body anchor pose; a face regression module configured to generate a second pose of a face of the animal in the input image by regressing from a stored face anchor pose; an extremity regression module configured to generate a third pose of an extremity of the animal in the input image by regressing from a stored extremity anchor pose; and a pose module configured to generate a whole body pose of the animal in the input image based on the first pose, the second pose, and the third pose.

Distillation of part experts for whole-body pose estimation

Growing community of inventors

Grenoble, France

Romain Bregier