Adobe, Inc.

Debraj Basu

Deepak Pai

Joshua Sweetkind-Singer

Shankar Venkitachalam

Prakhar Gupta

Ganesh Satish Mallya

Vinh Ngoc Khuc

Shradha Agrawal

Aayush Ojha

Ambareesh Revanur

Dhwanit Agarwal

Nalam V S S Krishna Chaitanya

In accordance with the described techniques, an image transformation system receives an input image and a text prompt, and leverages a generator network to edit the input image based on the text prompt. The generator network includes a plurality of layers configured to perform respective edits. A plurality of masks are generated based on the text prompt that define local edit regions, respectively, of the input image for respective layers of the generator network. Further, the generator network generates an edited image by editing the input image based on the plurality of masks, the respective edits of the respective layers, and the text prompt.

Mask conditioned image transformation based on a text prompt

Enhanced methods for improving the performance of classifiers are described. A ground-truth labeled dataset is accessed. A classifier predicts a predicted label for datapoints of the dataset. A confusion matrix for the dataset and classifier is generated. A credibility interval is determined for a performance metric for each label. A first labels with a sufficiently large credibility interval is identified. A second label is identified, where the classifier is likely to confuse, in its predictions, the first label with the second label. The identification of the second label is based on instances of incorrect label predictions of the classifier for the first and/or the second labels. The classifier is updated based on a new third label that includes an aggregation of the first label and the second label. The updated classifier model predicts the third label for any datapoint that the classifier previously predicted the first or second labels.

Quantifying and improving the performance of computation-based classifiers

The present disclosure relates to systems, methods, and non-transitory computer readable media that utilize intelligent contextual bias weights for informing keyphrase relevance models to extract keyphrases. For example, the disclosed systems generate a graph from a digital document by mapping words from the digital document to nodes of the graph. In addition, the disclosed systems determine named entity bias weights for the nodes of the graph utilizing frequencies with which the words corresponding to the nodes appear within named entities identified from the digital document. Moreover, the disclosed systems generate a keyphrase summary for the digital document utilizing the graph and a machine learning model biased according to the named entity bias weights for the nodes of the graph.

Generating weighted contextual themes to guide unsupervised keyphrase relevance models

In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.

Prototype-based machine learning reasoning interpretation

Methods, systems, and non-transitory computer readable storage media are disclosed for analyzing feature impact of a machine-learning model using prototypes across analytical spaces. For example, the disclosed system can identify features of data points used to generate outputs via a machine-learning model and then map the features to a feature space and the outputs to a label space. The disclosed system can then utilize an iterative process to determine prototypes from the data points based on distances between the data points in the feature space and the label space. Furthermore, the disclosed system can then use the prototypes to determine the impact of the features within the machine-learning model based on locally sensitive directions; region variability; or mean, range, and variance of features of the prototypes.

Determining feature impact within machine learning models using prototypes across analytical spaces

A computer system stores digital media content such as images and video along with associated tags and timestamps. The system detects trends in the media content by semantic analysis which includes generation of a temporal tag graph that includes data indicative of a semantic representation of the tags over a plurality of time periods. The data in the tag graph is clustered to generate a set of identified trends reflected by the tags over the plurality of time periods. The set of identified trends is stored in data storage and is available for characterization which includes labeling of the trends, scoring the trends, evaluating changes in the trends over time, and identifying images representative of the detected trends. The temporal tag graph may take the form of a weighted undirected graph where each node in the graph is associated with one of the tags and the edges connecting the nodes represents a temporal correlation between the nodes associated with each edge.

Growing community of inventors

Los Angeles, CA, United States of America

Debraj Basu