Adobe, Inc.

Shradha Agrawal

Deepak Pai

Debraj Basu

Ambareesh Revanur

Dhanya Raghu

Dhwanit Agarwal

In accordance with the described techniques, an image transformation system receives an input image and a text prompt, and leverages a generator network to edit the input image based on the text prompt. The generator network includes a plurality of layers configured to perform respective edits. A plurality of masks are generated based on the text prompt that define local edit regions, respectively, of the input image for respective layers of the generator network. Further, the generator network generates an edited image by editing the input image based on the plurality of masks, the respective edits of the respective layers, and the text prompt.

Mask conditioned image transformation based on a text prompt

Embodiments of the present disclosure are directed towards generating images conditioned on a desired attribute. In particular, an attribute-based image generation system can use a directional-GAN architecture to generate images conditioned on a desired attribute. A latent vector and a desired attribute are received. A feature subspace is determined for the latent vector using a latent-attribute linear classifier trained to determine a relationship between the latent vector and the desired attribute. An image is generated using the latent vector such that the image contains the desired attribute. In embodiments, where the feature space differs from a desired feature subspace, a directional vector is applied to the latent vector that shifts the latent vector from the feature subspace to the desired feature subspace. This modified latent vector is then used during generation of the image.

Growing community of inventors

San Jose, CA, United States of America

Shradha Agrawal