Ming Chuan University

Hsiu-Chien Hsu

Chaur-Heh Hsieh

A method for automatic video face replacement includes steps of capturing a face image, detecting a rotation angle of the face image, defining a region to be replaced in the face image, and pasting a region to be replaced of one of the replaced images having the corresponding rotation angle of the face image into a target replacing region. Therefore, the region to be replaced of a static or dynamic face image can be replaced by a replaced image quickly by a single camera without requiring a manual setting of the feature points of a target image. These methods support face replacement at different angles and compensate the color difference to provide a natural look of the replaced image.

Method for automatic video face replacement by using a 2D face image to estimate a 3D vector angle of the face image

A method for creating a face replacement database includes steps of creating a face database for storing a plurality of replaced images with a face image rotation angle by using a method for estimating a 3D vector angle from a 2D face image, and defining a region to be replaced in the replaced image. The method for estimating a 3D vector angle from a 2D face image includes the steps of creating a feature vector template; detecting a corner of eye and mouth in a face image; defining a sharp point in a vertical direction of the quadrilateral plane, and converting the vertices into 3D coordinates; computing the four vectors from the sharp point to the four vertices to obtain a vector set, and matching the vector set with the feature vector model to obtain an angle which is defined as a rotation angle of the input face image.

Method for creating face replacement database

A method for estimating a 3D vector angle from a 2D face image, a method for creating a face replacement database and a method for replacing a face image includes steps of capturing a face image, detecting a rotation angle of the face image, defining a region to be replaced in the face image, creating a face database for storing replaced images corresponding to the region to be replaced, and pasting one of the replaced images having the corresponding rotation angle of the face image into a target replacing region. Therefore, the region to be replaced of a static or dynamic face image can be replaced by a replaced image quickly by a single camera without requiring a manual setting of the feature points of a target image. These methods support face replacement at different angles and compensate the color difference to provide a natural look of the replaced image.

Growing community of inventors

Taipei, Taiwan

Hsiu-Chien Hsu