Bigo Technology Pte. Ltd.

Gengdai Liu

Wenyu Chen

Feiqian Zhang

Leju Yan

Xiaowei Zhang

Zhongyuan Hu

A method for reconstructing three-dimensional faces is provided. The method includes: estimating a dynamic reconstruction parameter of a current video frame for three-dimensional face reconstruction by inputting, in response to a steady-state reconstruction parameter of the current video frame for the three-dimensional face reconstruction having been estimated by a pre-constructed teacher network model, the current video frame into a student network model distilled from the teacher network model; and reconstructing a three-dimensional face corresponding to the current video frame by inputting the steady-state reconstruction parameter and the dynamic reconstruction parameter into a pre-constructed three-dimensional deformation model.

Method and device for reconstructing three-dimensional faces and storage medium

Provided is a method for training an adaptive rigid prior model. The method includes: initializing model parameters of the adaptive rigid prior model; acquiring a plurality of frames of facial data of a same face by face tracking on training video data using the adaptive rigid prior model; updating the model parameters based on the plurality of frames of facial data; determining whether a condition of stopping updating the model parameters is satisfied; stopping updating the model parameters of the adaptive rigid prior model, and acquiring a final adaptive rigid prior model; and returning to the step of acquiring the plurality of frames of facial data of the same face by face tracking on the training video data using the adaptive rigid prior model.

Method for training adaptive rigid prior model, and method for tracking faces, electronic device, and storage medium

Provided is a method for detecting line-of-sight. The method for detecting line-of-sight includes: determining, based on a key feature point in a face image, a face posture and an eye pupil rotational displacement corresponding to the face image, wherein the eye pupil rotational displacement is a displacement of a pupil center relative to an eyeball center in the face image; and acquiring a line-of-sight direction of an actual face by back-projecting, based on a preset projection function and the face posture, the eye pupil rotational displacement to a three-dimensional space where the actual face is located.

Method for determining line-of-sight, method for processing video, device, and storage medium

Provided is a method for reconstructing a face mesh model. The method includes: acquiring face scanning data to be reconstructed and a three-dimensional face mesh template; obtaining a target face mesh model by hierarchically extracting key feature points in the 3D face mesh template and by sequentially deforming the 3D face mesh template based on posture matching positions of the hierarchically extracted key feature points in the face scanning data; and obtaining a reconstructed face mesh model by acquiring global feature points in the target face mesh model and by deforming the target face mesh model based on the posture matching positions of the global feature points in the face scanning data.

Method and apparatus for reconstructing face mesh model, and storage medium

An illumination detection method comprises acquiring a face image to be detected and a three-dimensional face mesh template; deforming the three-dimensional face mesh template according to the face image to obtain a reconstructed face mesh model; according to the deformation positions, in the reconstructed face mesh model, of key feature points in the three-dimensional face mesh template, determining the brightness of feature points, corresponding to the key feature points, in the face image; and according to the relationship between the predetermined brightness of the key feature points and the illumination, and the brightness of the feature points, corresponding to the key feature points, in the face image, determining illumination information of the face image.

Illumination detection method and apparatus for face image, and device and storage medium

A method for determining human eye close degrees includes: acquiring a face image; determining a human eye open amplitude and a reference distance in the face image; calculating a relative amplitude of the human eye open amplitude relative to the reference distance; acquiring a maximum relative amplitude; and calculating a human eye close weight in the face image based on the relative amplitude and the maximum relative amplitude, the human eye close weight being configured to measure a human eye close degree.

Growing community of inventors

Guangzhou, China

Gengdai Liu