Adobe, Inc.

Cusuh Ham

Zhifei Zhang

Krishna Kumar Singh

Tobias Hinz

Systems and methods for image processing are described. Embodiments of the present disclosure obtain a noise image and guidance information for generating an image. A diffusion model generates an intermediate noise prediction for the image based on the noise image. A conditioning network generates noise modulation parameters. The intermediate noise prediction and the noise modulation parameters are combined to obtain a modified intermediate noise prediction. The diffusion model generates the image based on the modified intermediate noise prediction, wherein the image depicts a scene based on the guidance information.

Growing community of inventors

Marietta, GA, United States of America

Cusuh Ham