Adobe, Inc.

Microsoft Technology Licensing, LLC

American Express Travel Related Services Company, Inc.

Vishwa Vinay

Balaji Vasan Srinivasan

Niyati Himanshu Chhaya

Michael James Taylor

Paridhi Maheshwari

Ashok Kuppusamy

Gaurav Verma

Torbjørn Helvik

Sopan Khosla

Cedric Huesler

Vidar V Vikjord

Viral Shah

Bjørnstein Lilleby

Harshit Agrawal

Praneetha Vaddamanu

Prabhat Mahapatra

Rizurekh Saha

Kevin Gary Smith

Ryan A Rossi

William Brandon George

Nedim Lipka

Ritwik Sinha

Branislav Kveton

Iftikhar Ahamath Burhanuddin

Yauhen Shnitko

Zheng Wen

Sanket Vaibhav Mehta

Sunny Dhamnani

Yasin Abbasi Yadkori

Vinay Aggarwal

Bhanu Prakash Reddy Guda

Lilly Kumari

Shraiysh Vaishay

Sahith Thallapally

Dhananjay Bhausaheb Raut

Shuai Li

Chloe McConnell

Shahram Izadi

Franck Dernoncourt

Jennifer Anne Healey

Jose Ignacio Echevarria Vallespi

Shiv Kumar Saini

Natwar Modani

Tong Sun

Pranav Ravindra Maneriker

Harvineet Singh

Tracy Holloway King

Moumita Sinha

David Meier Weinstein

Youssef Hamadi

Srikrishna Karanam

Aparna Garimella

Margarita Savova

Kuldeep Kulkarni

Lucas Bordeaux

Tripti Shukla

Anandha Velu Natarajan

Victor Soares Bursztyn

Manoj Kilaru

Navita Goyal

Suryateja Bv

Manoj Ghuhan Arivazhagan

Frederic Mary

Aishwarya Mittal

Syed Mohd Mehadi

Pratyush Garg

Harkanwar Singh

Ritwick Chaudhry

Nihal Jain

Elaine Chao

Rohit Jain

Vaibhav Nagar

Mitansh Jain

Siddharth Sahay

Sneha Chowdary Vinjam

Seyedsaed Rezayidemne

Shaurya Goel

Vidit Jain

Embodiments are disclosed for multichannel content recommendation. The method may include receiving an input collection comprising a plurality of images. The method may include extracting a set of feature channels from each of the images. The method may include generating, by a trained machine learning model, an intent channel of the input collection from the set of feature channels. The method may include retrieving, from a content library, a plurality of search result images that include a channel that matches the intent channel. The method may include generating a recommended set of images based on the intent channel and the set of feature channels.

Multichannel content recommendation system

An illustrator system determines, for each feature of a set of features, a feature representation for an electronic document displayed via a user interface, based on a plurality of elements of the electronic document. The system receives a selection from among the set of features of (1) a query feature and of (2) a target feature and determines, for each replacement template of a set of replacement templates, a compatibility score based on the feature representation for the electronic document determined for the query feature and a target feature representation of the replacement template determined for the target feature, the representations being determined in a joint representation space. The system selects one or more replacement electronic documents based on the determined compatibility scores. The system displays a preview for each replacement electronic document and displays a particular replacement electronic document responsive to receiving a selection of a preview.

Cross view template recommendation system

Embodiments are disclosed for generating an intelligent change summary are described. In some embodiments, a method of generating an intelligent change summary includes obtaining a representation of a plurality of versions of a document, determining a distance score based on a comparison of a first of version of the document and a second version of the document, the distance score representing a magnitude of changes made from the first version of the document to the second version of the document, and generating a change summary of the document based on the distance score.

Intelligent change summarization for designers

The present disclosure relates to systems that perform text-based palette searches that convert a text query into a color distribution and utilize the color distribution to identify relevant color palettes. More specifically, the disclosed systems receive a textual color palette search query and convert, utilizing a text-to-color model, the textual color palette search query into a color distribution. The disclosed systems determine, utilizing a palette scoring model, distance metrics between the color distribution and a plurality of color palettes in a color database by: identifying swatch matches between colors of the color distribution and unmatched swatches of the plurality of color palettes and determining distances between the colors of the color distribution and matched swatches of the plurality of color palettes. The disclosed systems return one or more color palettes of the plurality of color palettes in response to the textual color palette search query based on the distance metrics.

Text-based color palette searches utilizing text-to-color models

Systems and methods for color representation are described. Embodiments of the inventive concept are configured to receive an attribute-object pair including a first term comprising an attribute label and a second term comprising an object label, encode the attribute-object pair to produce encoded features using a neural network that orders the first term and the second term based on the attribute label and the object label, and generate a color profile for the attribute-object pair based on the encoded features, wherein the color profile is based on a compositional relationship between the first term and the second term.

Color representations for textual phrases

Systems and methods for image searching are described. The systems and methods include receiving a search query comprising user input for a reference image; converting the user input for the reference image to a preference statement using a machine learning model; encoding the preference statement in an embedding space to obtain an encoded preference statement; combining the encoded preference statement with an encoded reference image representing the reference image in the embedding space to obtain a multi-modal search encoding; and performing a search operation using the multi-modal search encoding to retrieve a second image, wherein the second image differs from the reference image based on the user input for the reference image.

Performing image search based on user input using neural networks

Techniques for template generation from image content include extracting information associated with an input image. The information comprises: 1) layout information indicating positions of content corresponding to a content type of a plurality of content types within the input image; and 2) text attributes indicating at least a font of text included in the input image. A user-editable template having the characteristics of the input image is generated based on the layout information and the text attributes.

Semantically-guided template generation from image content

Digital image text editing techniques as implemented by an image processing system are described that support increased user interaction in the creation and editing of digital images through understanding a content creator's intent as expressed using text. In one example, a text user input is received by a text input module. The text user input describes a visual object and a visual attribute, in which the visual object specifies a visual context of the visual attribute. A feature representation generated by a text-to-feature system using a machine-learning module based on the text user input. The feature representation is passed to an image editing system to edit a digital object in a digital image, e.g., by applying a texture to an outline of the digital object within the digital image.

Text editing of digital images

Systems and methods for image processing are described. One or more embodiments of the present disclosure identify an image including a plurality of objects, generate a scene graph of the image including a node representing an object and an edge representing a relationship between two of the objects, generate a node vector for the node, wherein the node vector represents semantic information of the object, generate an edge vector for the edge, wherein the edge vector represents semantic information of the relationship, generate a scene graph embedding based on the node vector and the edge vector using a graph convolutional network (GCN), and assign metadata to the image based on the scene graph embedding.

Scene graph embeddings using relative similarity supervision

In implementations of systems for generating occurrence contexts for objects in digital content collections, a computing device implements a context system to receive context request data describing an object that is depicted with additional objects in digital images of a digital content collection. The context system generates relationship embeddings for the object and each of the additional objects using a representation learning model trained to predict relationships for objects. A relationship graph is formed for the object that includes a vertex for each relationship between the object and the additional objects indicated by the relationship embeddings. The context system clusters the vertices of the relationship graph into contextual clusters that each represent an occurrence context of the object in the digital images of the digital content collection. The context system generates, for each contextual cluster, an indication of a respective occurrence context for the object for display in a user interface.

Generating occurrence contexts for objects in digital content collections

In implementations of systems for generating sequential supporting answer reports, a computing device implements a report system to receive a user input defining a question with respect to a visual representation of analytics data rendered in a user interface. The report system determines a final answer to the question by processing a semantic representation of the question using a machine learning model. A sequence of reports is generated and the sequence defines an order of progression from a first supporting answer to the final answer. Each report of the sequence of reports includes a visual representation of a supporting answer to the question. The report system displays a dashboard in the user interface including a first report of the sequence of reports, the first report depicting a visual representation of the first supporting answer to the question.

Systems for generating sequential supporting answer reports

The present disclosure describes systems and methods for information retrieval. Embodiments of the disclosure provide a retrieval network that leverages external knowledge to provide reformulated search query suggestions, enabling more efficient network searching and information retrieval. For example, a search query from a user (e.g., a query mention of a knowledge graph entity that is included in a search query from a user) may be added to a knowledge graph as a surrogate entity via entity linking. Embedding techniques are then invoked on the updated knowledge graph (e.g., the knowledge graph that includes additional edges between surrogate entities and other entities of the original knowledge graph), and entities neighboring the surrogate entity are retrieved based on the embedding (e.g., based on a computed distance between the surrogate entity and candidate entities in the embedding space). Search results can then be ranked and displayed based on relevance to the neighboring entity.

Knowledge-derived search suggestion

A sound association system identifies one or more aurally active words in digital text. Aurally active words refer to words that denote particular sounds. Context-based sounds corresponding to the one or more aurally active words are also identified. Each context-based sound is anchored to or associated with the corresponding one or more aurally active words and is played back when the digital text is played back or read, providing context-based background sounds associated with the one or more aurally active words. For example, a context-based sound can be played back at a higher volume when the one or more aurally active words are played back or read, and at a lower volume when other words of the digital text are played back or read.

Automatically associating context-based sounds with text

Techniques for template generation from image content includes extracting information associated with an input image. The information comprises: 1) layout information indicating positions of content corresponding to a content type of a plurality of content types within the input image; and 2) text attributes indicating at least a font of text included in the input image. A user-editable template having the characteristics of the input image is generated based on the layout information and the text attributes.

Growing community of inventors

Bengaluru, India

Vishwa Vinay