Adobe, Inc.

Fei Yang

Elya Shechtman

Jue Wang

Lubomir D Bourdev

Various embodiments of methods and apparatus for face fitting are disclosed. In one embodiment, sets of two-dimensional local feature points on a face in each image of a set of images are identified. The set of images includes a sequence of frames a video stream. A three-dimensional face model for the face in the each image is generated as a combination of a set of predefined three-dimensional face models. In some embodiments, the generating includes reducing an error between a projection of vertices of the set of predefined three-dimensional face models and the two-dimensional local feature points of the each image, and constraining facial expression of the three-dimensional face model to change smoothly from image to image in the sequence of video frames.

Methods and apparatus for face fitting and editing applications

Three dimensional models corresponding to a target image and a reference image are selected based on a set of feature points defining facial features in the target image and the reference image. The set of feature points defining the facial features in the target image and the reference image are associated with corresponding 3-dimensional models. A 3D motion flow between the 3-dimensional models is computed. The 3D motion flow is projected onto a 2D image plane to create a 2D optical field flow. The target image and the reference image are warped using the 2D optical field flow. A selected feature from the reference image is copied to the target image.

Methods and apparatus for facial feature replacement

A set of feature points for defining features of a face is detected in a target image and a reference image. The target image is warped to accommodate a selected feature from the reference image using the set of feature points and a set of three-dimensional models. The reference image is warped to a pose of the target image using the set of feature points and the set of three-dimensional models. The selected feature is copied from the reference image to the target image.

Growing community of inventors

Highland Park, NJ, United States of America

Fei Yang