Canva Pty Ltd

Alexander Tack

Stefan Paul Sietzen

Sanchit Sanchit

David Fankhauser

Described embodiments generally relate to a computer-implemented method for performing inpainting. The method includes accessing a first image; receiving a selected area of the first image; identifying a foreground area of the first image; generating a merged mask based on the union of the user selected area and the foreground area; performing an inpainting process on the area of the first image corresponding to the merged mask to generate a second image, being an inpainted image; generating a reduced mask based on the user selected area reduced by the foreground area; and combining the first image with the area of the second image corresponding to the reduced mask to produce an output image.

Systems and methods for performing inpainting

Some embodiments relate to a method of performing prompt-based image editing. The method includes accessing an image; receiving a selected area of the image; receiving a prompt, wherein the prompt is indicative of an editing instruction; generating a latent by transforming the image into visual noise; predicting, based on the latent and the prompt, a noise image corresponding to the latent; subtracting at least a portion of the noise image from the latent to generate an updated latent; generating a noisy representation of the image; generating a masked latent based on the noisy representation, the updated latent and selected area, wherein the masked latent comprises the updated latent in the areas corresponding to the selected area, and the noisy representation in the areas that do not correspond to the selected area.

Growing community of inventors

Vienna, Austria

Alexander Tack