Adobe, Inc.

Shaoan Xie

Zhe Lin

Zhifei Zhang

Tobias Hinz

Systems and methods for multi-modal image editing are provided. In one aspect, a system and method for multi-modal image editing includes identifying an image, a prompt identifying an element to be added to the image, and a mask indicating a first region of the image for depicting the element. The system then generates a partially noisy image map that includes noise in the first region and image features from the image in a second region outside the first region. A diffusion model generates a composite image map based on the partially noisy image map and the prompt. In some cases, the composite image map includes the target element in the first region that corresponds to the mask.

Growing community of inventors

Pittsburgh, PA, United States of America

Shaoan Xie