Adobe, Inc.

Stc.unm

Aliakbar Darabi

Elya Shechtman

Sohrab Amirghodsi

Jingwan Lu

Daniel Goldman

Ratheesh Kalarot

Oliver Brdiczka

Alexandru Vasile Costin

Sylvain Philippe Paris

Kevin Wampler

Pradeep Sen

Kevin Gary Smith

Baldo Antonio Faieta

Richard Zhang

Shabnam Ghadar

Niloy Jyoti Mitra

Zhixin Shu

Cameron Smith

Wei-An Lin

Jun-Yan Zhu

Kyoung Tak Kim

Kushith Amerasinghe

Jakub Fiser

Sudeep Siddheshwar Katakol

Robert Alley

Jue Wang

Kalyan Krishna Sunkavalli

Jayant Kumar

Doo Soon Kim

Taesung Park

Nipun Jindal

Yinglan Ma

Sanat Sharma

Oliver Markus Michael Brdiczka

Devavrat Tomar

Arpit Mathur

Ripul Bhutani

Nima Khademi Kalantari

Cristian-Catalin Buzoiu

Elya Schectman

Steve Christopher Bako

Ryan Joe Murdock

Kevin Duarte

Siddharth Iyer

Gabriel Boroghina

Dan-Gabriel Ghita

Various disclosed embodiments are directed to classify or determining an image style of a target image according to a consumer application based on determining a similarity score between the image style of a target image and one or more other predetermined image styles of the consumer application. Various disclosed embodiments can resolve image style transfer destructiveness functionality by making various layers of predetermined image styles modifiable. Further various embodiments resolve tedious manual user input requirements and reduce computing resource consumption, among other things.

Classifying image styles of images based on procedural style embeddings

Embodiments of the present disclosure include obtaining an input image and an approximate mask that approximately indicates a foreground region of the input image. Some embodiments generate an unconditional mask of the foreground region based on the input image. A conditional mask of the foreground region is generated based on the input image and the approximate mask. Then, an output image is generated based on the unconditional mask and the conditional mask. In some cases, the output image includes the foreground region of the input image.

Background separation for guided generative models

Systems and methods train an encoder neural network for fast and accurate projection into the latent space of a Generative Adversarial Network (GAN). The encoder is trained by providing an input training image to the encoder and producing, by the encoder, a latent space representation of the input training image. The latent space representation is provided as input to the GAN to generate a generated training image. A latent code is sampled from a latent space associated with the GAN and the sampled latent code is provided as input to the GAN. The GAN generates a synthetic training image based on the sampled latent code. The sampled latent code is provided as input to the encoder to produce a synthetic training code. The encoder is updated by minimizing a loss between the generated training image and the input training image, and the synthetic training code and the sampled latent code.

Supervised learning techniques for encoder training

The present disclosure relates to systems, methods, and non-transitory computer readable media for generating modified digital images by utilizing a patch match algorithm to generate nearest neighbor fields for a second digital image based on a nearest neighbor field associated with a first digital image. For example, the disclosed systems can identify a nearest neighbor field associated with a first digital image of a first resolution. Based on the nearest neighbor field of the first digital image, the disclosed systems can utilize a patch match algorithm to generate a nearest neighbor field for a second digital image of a second resolution larger than the first resolution. The disclosed systems can further generate a modified digital image by filling a target region of the second digital image utilizing the generated nearest neighbor field.

Generating modified digital images utilizing nearest neighbor fields from patch matching operations of alternate digital images

Systems and methods train and apply a specialized encoder neural network for fast and accurate projection into the latent space of a Generative Adversarial Network (GAN). The specialized encoder neural network includes an input layer, a feature extraction layer, and a bottleneck layer positioned after the feature extraction layer. The projection process includes providing an input image to the encoder and producing, by the encoder, a latent space representation of the input image. Producing the latent space representation includes extracting a feature vector from the feature extraction layer, providing the feature vector lo the bottleneck layer as input, and producing the latent space representation as output. The latent space representation produced by the encoder is provided as input to the GAN, which generates an output image based upon the latent space representation.

Direct regression encoder architecture and training

A method for training a GAN to transfer lighting from a reference image to a source image includes: receiving the source image and the reference image; generating a lighting vector from the reference image; applying features of the source image and the lighting vector to a generative network of the GAN to create a generated image; applying features of the reference image and the lighting vector to a discriminative network of the GAN to update weights of the discriminative network; and applying features of the generated image and the lighting vector to the discriminative network to update weights of the generative network.

Image lighting transfer

An illustrator system accesses a multi-element document including a plurality of elements. The illustrator system selects, from the plurality of elements, a selected element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein the substitute element is different from the selected element. The illustrator system displays, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is focused to depict the substitute element.

User interface for editing of a composite document through intelligently zoomed previews

The present disclosure describes systems, non-transitory computer-readable media, and methods that intelligently sense digital user context across client devices applications utilizing a dynamic sensor graph framework and then utilize a persistent context store to generate flexible digital recommendations across digital applications. In one or more embodiments, the disclosed systems utilize triggers to select and activate one or more sensor graphs. These sensor graphs can include software sensors arranged according to an architecture of dependencies and subject to various constraints. The underlying architecture of dependencies and constraints in each sensor graph allows the disclosed systems to avoid race-conditions in persisting actionable user-context based signals, verify the validity of sensor output through the sensor graph, generate user-context based recommendations across multiple related applications, and accommodate a specific latency/refresh rate of context values.

Intelligently generating client device application recommendations based on dynamic digital user context states

Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.

Techniques for smooth region merging in image editing

Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.

Detail-preserving image editing techniques

An illustrator system accesses a multi-element document, the multi-element document including a plurality of elements. The illustrator system determines, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics. The illustrator system creates a first aggregated topic distribution from the determined element-specific topic distributions. The illustrator system determines a global intent for the multi-element document, the global intent including one or more terms from the first aggregated topic distribution. The illustrator system queries a database using the global intent to retrieve a substitute element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of an element in the multi-element document The at least one substitute element is different from the element in the displayed multi-element document.

Deriving global intent from a composite document to facilitate editing of the composite document

Classifying image styles of images based on image style embeddings

Intelligently sensing digital user context to generate recommendations across client device applications

In implementations of systems for generating suggestions with knowledge graph embedding vectors, a computing device implements a suggestion system to receive input data describing user interactions with an application for editing digital content. The suggestion system generates input embedding vectors based on the user interactions with the application and determines an item based on the input embedding vectors and knowledge graph embedding vectors generated from nodes of a knowledge graph describing a tutorial for editing digital content. The suggestion system generates an indication of the item for display in a user interface of a display device.

Systems for generating suggestions with knowledge graph embedding vectors

Growing community of inventors

Newcastle, WA, United States of America

Aliakbar Darabi