De-Identification Ltd.

De-Ideniification Ltd.

Amitay Nachmani

Gil Perry

Sella Blondheim

Eliran Kuta

Or Gorodissky

Matan Ben-Yosef

Yoav HaCohen

Matan Feldman

Naama Antebi

System and method for reconstructing a three-dimensional (3D) face model from an input 2D image of the face, including: feeding the input 2D image into at least one preparatory network to generate 3D landmarks (L'), facial features (F′) and segmentation maps (S′); feeding the 3D landmarks (L′), the facial features (F′), and the segmentation maps (S′) to a parameter regressor network (M1) to predict parameters of a 3D face parametric model (P′), camera parameters (C′), hair parameters (H′) and wrinkle parameters (W′); generating an initial UV texture map (UV_0′) using the input 2D image and (P′, C′, H′, W′); feeding the initial UV texture map (UV_0′) into a UV completion network (M2) to generate a full UV texture map (UV′) and illumination parameters (LI′); and generating the 3D face model using (P′, C′, H′, W′, UV′, LI′).

System and method for reconstruction of a three-dimensional human head model from a single image

A system and method of performing facial image anonymization may include: obtaining, by at least one processor of a first computing device, at least one first image data element, depicting a first face; using, by the at least one processor, a first neural network (NN), to encode the facial image into a first low-dimension, latent vector; using, by the at least one processor, a transformation module, adapted to modify the first latent vector, to produce an anonymized latent vector; and transmitting, by the at least one processor, the anonymized latent vector, via a communication network to a remote second computing device, wherein the second computing device is adapted to decode the anonymized latent vector into a second image data element, depicting an anonymized face.

System and method for performing facial image anonymization

System and method for reconstructing a three-dimensional (3D) face model from an input 2D image of the face, including: feeding the input 2D image of the first face into a hypernetwork (H) to generate weights for an implicit representation network (IRN); generating, by the IRN with the generated weights, multi-view face images of the first face; and generating the 3D model of the first face by feeding the multi-view face images of the first face into a network trained to generate a 3D face model from the multi-view face images.

System and method for reconstruction of an animatable three-dimensional human head model from an image using an implicit representation network

To consistently anonymize video, an identity-preserving encoder may be trained with a decoder to preserve identity information unique to an individual in an encoded space. The identity-preserving encoder may encode source video images of a source identity to generate identity-preserving encoded data representing the source identity. A de-identification engine may generate de-identifying encoded data representing a different target identity. A transformation may be generated based on a difference between the identity-preserving and de-identifying encoded data, representing swapping the source identity with the target identity. The identity may be consistently swapped from the source to target in the encoded space by applying the same transformation to the identity-preserving encoded data for the source images. The swapped identity encoded data may be decoded to generate consistently anonymized output images representing the non-identity information of the source images with the target identity, for all the output video images.

Facial anonymization with consistent facial attribute preservation in video

A system and method voice driven animation of an object in an image by sampling an input video, depicting a puppet object, to obtain an image, receiving audio data, extracting voice related features from the audio data, producing an expression representation based on the voice related features, wherein the expression representation is related to a region of interest, obtaining from the image, auxiliary data related to the image and generating a target image based on the expression representation and the auxiliary data.

System and method for voice driven lip syncing and head reenactment

A system and method of animating an image of an object by extracting a plurality of three dimensional (3D) features from a first image, depicting a puppet object, and from the second image of a driver object, obtaining, a value of a first 3D identity-invariant feature of the puppet object, and a value of a second 3D identity-invariant feature, from the second image, calculating and applying, a mixing function, on the plurality of 3D features, generating a rendered image, based on the plurality of 3D features, the first 3D identity-invariant feature and the second 3D identity-invariant feature, and generating an output image based on the rendered image, the plurality of 3D features, the first image and the second image, wherein the output image depicting a target object comprising at least one 3D identity-invariant feature of the driver object.

System and method for artificial neural-network based animation with three-dimensional rendering

A system and method of animating an image of an object may include: receiving a first image, depicting a 'puppet' object; sampling an input video, depicting a second, 'driver' object, to obtain at least one second image; obtaining, by a first machine-learning (ML) model, a first identity-invariant feature of the puppet object, from the first image; obtaining at least one second identity-invariant feature of the driver object, from the respective at least one second image; calculating, by a second ML model, a transformation function, based on the first identity-invariant feature and the at least one second identity-invariant feature; applying the calculated transformation function on the first image, to produce one or more third images, depicting a target object, including at least one identity-invariant feature of the driver object; and appending the one or more third images to produce an output video depicting animation of the puppet object.

Growing community of inventors

Tel Aviv, Israel

Amitay Nachmani