Adobe, Inc.

Tak Yeon Lee

Eunyee Koh

Ryan A Rossi

Fan Du

Sana Malik Lee

Sungchul Kim

Handong Zhao

Vasanthi Holtcamp

Xin Qian

Yikun Xian

Sumit Shekhar

Nikhil Belsare

Nathan Carl Ross

John Anderson

Qisheng Li

Shenyu Xu

Duy-Trung Trong Dinh

Zening Qu

Thomas M Jacobs

Saurabh Mahapatra

Jonggi Hong

Camille Harris

Andrew Thomson

Caroline Jiwon Kim

A visualization recommendation system generates recommendation scores for multiple visualizations that combine data attributes of a dataset with visualization configurations. The visualization recommendation system maps meta-features of the dataset to a meta-feature space and configuration attributes of the visualization configurations to a configuration space. The visualization recommendation system generates meta-feature vectors that describe the mapped meta-features, and generates configuration attribute sets that describe the attributes of the visualization configurations. The visualization recommendation system applies multiple scoring models to the meta-feature vectors and configuration attribute sets, including a wide scoring model and a deep scoring model. In some cases, the visualization recommendation system trains the multiple scoring models using the meta-feature vectors and configuration attribute sets.

Machine learning techniques for generating visualization recommendations

Systems and methods for lifelong schema matching are described. The systems and methods include receiving data comprising a plurality of information categories, classifying each information category according to a schema comprising a plurality of classes, wherein the classification is performed by a neural network classifier trained based on a lifelong learning technique using a plurality of exemplar training sets, wherein each of the exemplar training sets includes a plurality of examples corresponding to one of the classes, and wherein the examples are selected based on a metric indicating how well each of the examples represents the corresponding class, and adding the data to a database based on the classification, wherein the database is organized according to the schema.

Lifelong schema matching

Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data visualization generation. In one implementation, dataset intent data, visual design intent data, and insight intent data determined from a user input natural language query are obtained. A set of candidate intent recommendations is generated using various combinations of the dataset intent data, visual design intent data, and insight intent data. Each of the candidate intent recommendations is incorporated into a set of visualization templates to determine eligibility of the candidate intent recommendations. For eligible candidate intent recommendations, a score associated with a corresponding visualization template is determined. Based on the scores, a candidate intent recommendation and corresponding visualizations template is selected to use as a visual recommendation for presenting a data visualization.

Facilitating generation of data visualizations via natural language processing

In some embodiments, a data visualization system detects insights from a dataset and computes insight scores for respective insights. The data visualization system further computes insight type scores, from the insight scores, for insight types in the detected insights. The data visualization system determines a selected insight type for the dataset having a higher insight type score than unselected insight types and determines, for the selected insight type, a set of selected insights that have higher insight scores than unselected insights. The data visualization system determines insight visualizations for the set of selected insights and generates, for inclusion in a user interface of the data visualization system, selectable interface elements configured for invoking an editing tool for updating the determined insight visualizations from the dataset. The selectable interface elements are arranged in the user interface according to the insight scores of the set of selected insights.

Configuration of user interface for intuitive selection of insight visualizations

A dataset captioning system is described that generates captions of text to describe insights identified from a dataset, automatically and without user intervention. To do so, given an input of a dataset the dataset captioning system determines which data insights are likely to support potential visualizations of the dataset, generates text based on these insights, orders the text, processes the ordered text for readability, and then outputs the text as a caption. These techniques also include adjustments made to the complexity of the text, globalization of the text, inclusion of links to outside sources of information, translation of the text, and so on as part of generating the caption.

Automated caption generation from a dataset

This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories. Based on the visual-data-story graph, the disclosed systems can select a relevant visual data story to display on a graphical user interface.

Generating visual data stories

Systems and methods for personalized visualization recommendation are described. Embodiments of the described systems and methods are configured to identify a first matrix representing user interactions with a plurality of data attributes corresponding to a plurality of datasets, a second matrix representing user interactions with a plurality of visualizations, and a third matrix representing a plurality of meta-features for each of the data attributes; compute low-dimensional embeddings representing user characteristics, the data attributes, visualization configurations, and the meta-features using joint factorization of the first matrix, the second matrix and the third matrix; generate a model for predicting visualization preference weights based on the low-dimensional embeddings; predict the visualization preference weights for a user corresponding to a plurality of candidate visualizations of dataset using the model; and generate a personalized visualization of the dataset for the user based on the predicted visualization preference weights.

Personalized visualization recommendation system

Systems, methods, and non-transitory computer-readable media are disclosed for generating generate explanatory paths for column annotations determined using a knowledge graph and a deep representation learning model. For instance, the disclosed systems can utilize a knowledge graph to generate an explanatory path for a column label determination from a deep representation learning model. For example, the disclosed systems can identify a column and determine a label for the column using a knowledge graph (e.g., a representation of a knowledge graph) that includes encodings of columns, column features, relational edges, and candidate labels. Then, the disclosed systems can determine a set of candidate paths between the column and the determined label for the column within the knowledge graph. Moreover, the disclosed systems can generate an explanatory path by ranking and selecting paths from the set of candidate paths using a greedy ranking and/or diversified ranking approach.

Generating explanatory paths for predicted column annotations

Systems, methods, and non-transitory computer-readable media are disclosed for dynamically determining schema labels for columns regardless of information availability within the columns. For example, the disclosed systems can identify a column that contains an arbitrary amount of information (e.g., a header-only column, a cell-only column, or a whole column). Additionally, the disclosed systems can generate a vector embedding for an arbitrary input column by selectively using a header neural network and/or a cell neural network based on whether the column includes a header label and/or whether the column includes a populated column cell. Furthermore, the disclosed systems can compare the column vector embedding to schema vector embeddings of candidate schema labels in a d-dimensional space to determine a schema label for the column.

Dynamically determining schema labels using a hybrid neural network encoder

Methods, systems, and non-transitory computer readable storage media are disclosed for determining and resolving semantic misalignments between digital messages containing links and corresponding external digital content. For example, in one or more embodiments, the disclosed systems compare semantic message features from the digital message with semantic external digital content features from the external digital content. More specifically, in at least one embodiment, the disclosed systems compare semantic message feature vectors and semantic external digital content feature vectors to determine a relevance score for the digital message and identify semantic misalignments. Additionally, in one or more embodiments, the disclosed systems provide for display a user interface that presents a plurality of digital messages, the linked external digital content, and identified semantic misalignments.

Detecting and resolving semantic misalignments between digital messages and external digital content

In implementations of systems for suggesting content components, a computing device implements a design system to receive input data describing a feature of a content component to be included in a hypertext markup language (HTML) document. The design system represents that feature of the content component as a document object model (DOM) element and determines a hash value for the DOM element using locality-sensitive hashing. Manhattan distances are computed between the has value and has values described by a segment of content component data. The hash values were determined using the locality-sensitive hashing for DOM elements extracted from a corpus of HTML documents. The design system generates indications, for display in a user interface, of candidate content components for inclusion in the HTML document based on the Manhattan distances.

Systems for suggesting content components

Methods, systems, and non-transitory computer readable storage media are disclosed for determining and resolving misalignments between digital messages containing links and corresponding external digital content. For example, in one or more embodiments, the disclosed systems extract a plurality of alignment classification features from a digital link in a digital message and corresponding external digital content. Based on the alignment classification features and using a machine learning classification model, the disclosed system can generate alignment probability scores for a plurality of misalignment classes. The disclosed system can report identified misalignments of corresponding misalignment classes in a misalignment identification user interface. Furthermore, the disclosed system can receive publisher input via the misalignment identification user interface to further personalize the machine learning classification model.

Identifying and presenting misalignments between digital messages and external digital content

This disclosure involves generating, from a user data set, a ranked list of recommended secondary variables in a user interface field similar to primary variable selected in another user interface field. A system receives a data set having variables and corresponding sets of values. The data visualization system determines a feature vector for each variable based on statistics of a corresponding values set. The system generates a variable similarity graph having nodes representing variables and links representing degrees of similarity between feature vectors of variables. The system receives a selection of a first variable via a first field of the user interface, detects a selection of a second field, and identifies a relationship between the first field and the second field. The system generates a contextual menu of recommended secondary variables for use with the selected first variable based on similarity value of the links in the variable similarity graph.

Growing community of inventors

Cupertino, CA, United States of America

Tak Yeon Lee