Adobe, Inc.

Siavash Khodadadeh

Shabnam Ghadar

Ratheesh Kalarot

Zhe Lin

Baldo Antonio Faieta

Saeid Motiian

Richard Zhang

Yannick Hold-Geoffroy

Wei-An Lin

Hui Qu

Sven Olsen

Jinrong Xie

Surabhi Sinha

Zohreh Azizi

Anjali Agarwal

The present disclosure relates to systems, methods, and non-transitory computer readable media for generating and composting pixels of a digital image that depict hair of an individual using generative neural networks. In some embodiments, the disclosed systems receive a modification to a face crop enclosing a face depicted within a digital image. In some cases, the disclosed systems determine, from the modification, modified hair pixels within the face crop of the digital image and unmodified hair pixels outside of the face crop of the digital image. The disclosed systems generate, for the unmodified hair pixels outside of the face crop, replacement hair pixels that resemble the modified hair pixels utilizing a generative neural network. Additionally, the disclosed systems generate a modified digital image by replacing the unmodified hair pixels outside of the face crop with the replacement hair pixels.

Generating and compositing hair pixels using generative neural networks

Methods for image processing are described. Embodiments of the present disclosure identifies an image generation network that includes an encoder and a decoder; prunes channels of a block of the encoder; prunes channels of a block of the decoder that is connected to the block of the encoder by a skip connection, wherein the channels of the block of the decoder are pruned based on the pruned channels of the block of the encoder; and generates an image using the image generation network based on the pruned channels of the block of the encoder and the pruned channels of the block of the decoder.

Guided CoModGaN optimization

Systems and methods for image processing are provided. Embodiments include identifying an image of a face that includes an artifact in a part of the face. A machine learning model generates an intermediate image based on the original image. The intermediate image depicts the part of the face in a closed position. Then the model generates a corrected image based on the intermediate image. The corrected image depicts the face with the part of the face in an open position and without the artifact.

Repairing irregularities in computer-generated images

The present disclosure relates to systems, methods, and non-transitory computer readable media for generating anonymized digital images utilizing a face anonymization neural network. In some embodiments, the disclosed systems utilize a face anonymization neural network to extract or encode a face anonymization guide that encodes face attribute features, such as gender, ethnicity, age, and expression. In some cases, the disclosed systems utilize the face anonymization guide to inform the face anonymization neural network in generating synthetic face pixels for anonymizing a digital image while retaining attributes, such as gender, ethnicity, age, and expression. The disclosed systems learn parameters for a face anonymization neural network for preserving face attributes, accounting for multiple faces in digital images, and generating synthetic face pixels for faces in profile poses.

Anonymizing digital images utilizing a generative adversarial neural network

Embodiments are disclosed for automatic object re-colorization in images. In some embodiments, a method of automatic object re-colorization includes receiving a request to recolor an object in an image, the request including an object identifier and a color identifier, identifying an object in the image associated with the object identifier, generating a mask corresponding to the object in the image, providing the image, the mask, and the color identifier to a color transformer network, the color transformer network trained to recolor objects in input images, and generating, by the color transformer network, a recolored image, wherein the object in the recolored image has been recolored to a color corresponding to the color identifier.

Automatic object re-colorization

Systems and methods for image processing are described. One or more embodiments of the present disclosure identify a latent vector representing an image of a face, identify a target attribute vector representing a target attribute for the image, generate a modified latent vector using a mapping network that converts the latent vector and the target attribute vector into a hidden representation having fewer dimensions than the latent vector, wherein the modified latent vector is generated based on the hidden representation, and generate a modified image based on the modified latent vector, wherein the modified image represents the face with the target attribute.

Growing community of inventors

Orlando, FL, United States of America

Siavash Khodadadeh