International Business Machines Corporation

Ooyala, Inc.

Lei Huang

Shun Jiang

Guangjie Ren

Robert John Moore

Eric Young Liu

Sunhwan Lee

Chung-hao Tan

Peifeng Yin

Pawan Raghunath Chowdhary

Aly Megahed

Raphael I Arar

Margaret Helen Szymanski

Saurabh Mishra

Divyesh Jadav

Eric Hc Liu

Zhichen Xu

Hovey Raymond Strong

Nimrod Hoofien

Sami Abu-El-Haija

Sungeun An

Zhixuan Qin

Techniques for personalizing an AI automated conversational system are provided. In one aspect, a method for personalizing an automated conversational system includes: making predictions of a familiarity of a user with concepts needed to understand a standard output utterance based on the familiarity of an aggregate of users and a background knowledge model of the concepts and related concepts, wherein the standard output utterance assumes that the concepts are known; and giving, by the automated conversational system, an output utterance that is tailored to the user given the predictions. For instance, the automated conversational system can give the standard output utterance to the user when it is predicted that the user is familiar with the concepts, or a nonstandard output utterance when it is it is predicted that the user is unfamiliar with at least one of the concepts.

Personalizing automated conversational system based on predicted level of knowledge

In an approach to improve mining and identifying priority relationships and solution packages by identifying client-satisfied solutions packages based on determined relationships, embodiments identify business priorities and software product solutions to recommend to a user. Additionally, embodiments receive electronic representations of the software product solutions utilized by an organization, and generate software product solution relationship maps based on the received electronic representations of software product solutions utilized by the organization. Further, embodiments map received business priorities to the generated software product solution relationship maps based on keyword and key phrase searches or full text similarity using statistical methods and machine learning models, recommend solution packages based on the mapped business priorities to the generated software product solution relationship maps, and output, by a user interface, the solution packages to users.

Identifying solution packages based on determined relationships

A computer-implemented method of voice-to-text tagging for transcription of a human voice signal by one of an automatic speech recognition system, or a natural conversation, includes generating a speech-to-text verbal transcript of the verbal vocalizations of an audio signal at a verbal timestamp of the audio signal. A voice-to-text non-verbal transcript of the one or more non-verbal vocalizations of the audio signal is generated at a non-verbal timestamp of the audio signal. The non-verbal transcript and the verbal transcript are combined to generate an enhanced transcript.

System for voice-to-text tagging for rich transcription of human speech

A computer-implemented method, system and computer program product for generating a user interface. A sketch (e.g., wireframe) of a portion of a user interface is received. The sketch is analyzed to predict a set of intended sketches using artificial intelligence based on historical data and/or the user's asset library. A set of intended final sketch renderings of the user interface is then generated and displayed using the set of predicted intended sketches based on historical data or a model trained to extract visual characteristics from existing user interface screens. If the user selects one of the intended final sketch renderings of the user interface as being directed to the intended design of the user interface and indicates that the selected intended final sketch rendering of the user interface corresponds to the final intended design, then code is generated to render the selected final sketch rendering of the user interface.

Using artificial intelligence to iteratively design a user interface through progressive feedback

One embodiment provides a method for predicting a next action in a conversation system that includes obtaining, by a processor, information from conversation logs and a conversation design. The processor further creates a dialog graph based on the conversation design. Weights and attributes for edges in the dialog graph are determined based on the information from the conversation logs and adding user input and external context information to an edge attributes set. An unrecognized user input is analyzed and a next action is predicted based on dialog nodes in the dialog graph and historical paths. A guiding conversation response is generated based on the predicted next action.

Graph based prediction for next action in conversation flow

Techniques regarding personalizing one or more design layouts of a user interface for application software are provided. For example, one or more embodiments described herein can comprise a system, which can comprise a memory that can store computer executable components. The system can also comprise a processor, operably coupled to the memory, and that can execute the computer executable components stored in the memory. The computer executable components can comprise a design component that can generate a design layout of a user interface for application software by adjusting an initial design layout of the user interface based on interactions via the user interface and a design perturbation preference associated with the initial design layout.

Personalized design layout for application software

A computer-implemented method for time-based multiple automobile travel coordination. Aspects include creating a travel coordination group having at least two participants and obtaining a current position and a destination location for each of the at least two participants. Aspects also include determining an estimated travel time for each of the at least two participants based at least in part on the current position and the destination location for each of the at least two participants. Aspects further include coordinating travel plans for each of the at least two participants based at least in part on the estimated travel time of each of the at least two participants, wherein the coordination includes determining a departure time for each of the at least two participants such that each of the at least two participants will arrive at the destination location within a threshold amount of time from one another.

Time-based multiple automobile travel coordination

A computer-implemented method, according to one embodiment, is used to creating customized templates and template recommendations. The computer-implemented method includes: extracting text content from user information which corresponds to a user, and using the text content extracted from the user information to generate feature vectors. The feature vectors are further used to form one or more clusters of existing user editions. For each of the one or more formed clusters, a tree structure is generated for each user edition in the cluster. Moreover, the tree structures in the cluster are combined into a merged tree structure. A customized template is generated for each of the one or more formed clusters using the respective merged tree structure, and at least one of the customized templates is recommended to the user based on the user information.

Customization and recommendation of tree-structured templates

A method and system of evaluating a user experience (UX) design are provided. A UX design is received. All objects that are identified to be part of a background of the input UI screen are removed to create a filtered input UI screen. The input UI screen is assigned to a cluster. A target UI screen of the input screen is determined and its background removed, to create a filtered target UI cluster. The target UI screen is assigned to a cluster. The filtered input UI screen is used as an input to a deep learning model to predict a target UI cluster. The predicted target UI cluster is compared to the filtered target UI cluster based on the clustering. Upon determining that the filtered target UI cluster is similar to the target UI screen, the UX design is classified as being successful.

AI-assisted UX design evaluation

In one general aspect, a computer-implemented method includes identifying current choices with different verbosity levels for a current turn in a conversation; normalizing multi-dimensional verbosity vectors for each of the current choices to obtain a normalized value for each of the current choices; determining a state definition for the current turn in the conversation, utilizing the normalized values for each of the current choices; providing the state definition for the current turn in the conversation and the normalized values for each of the current choices to a trained reinforcement learning module; receiving, from the trained reinforcement learning module, a score associated with each of the current choices for the current turn in the conversation; and selecting one of the current choices to be entered for the current turn in the conversation, based on the score associated with each of the current choices for the current turn in the conversation.

Adjusting a verbosity of a conversation turn

One embodiment provides a method including receiving authoring conversational training data. A machine learning based conversational agent is trained with the conversational training data. The training includes: creating and storing example transcripts of user utterances, creating and storing example transcripts of agent utterances, sequencing utterance transcripts using the example transcripts of user utterances and the example transcripts of agent utterances, forming a corpus from the sequenced utterance transcripts, marking speech patterns that represent social actions from tagging the sequenced utterance transcripts, and forming a patterned corpus from the marked speech patterns.

Program dialog by example

Systems, computer-implemented methods, and computer program products that can facilitate word entity disambiguation are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a language model component that employs an artificial intelligence model to generate a profile vector of an entity based on one or more binary values representing profile data of the entity and a word vector of a word entity in a dialogue based on one or more second word entities adjacent to the word entity in the dialogue. The computer executable components can further comprise a dialogue management component that disambiguates the word entity based on the profile vector and the word vector.

Contextual disambiguation of an entity in a conversation management system

A method and system of automatically identifying topics of a conversation are provided. An electronic data package comprising a sequence of utterances between conversation entities is received by a computing device. Each utterance is classified to a corresponding social action. One or more utterances in the sequence are grouped into a segment based on a deep learning model. A similarity of topics between adjacent segments is determined. Upon determining that the similarity is above a predetermined threshold, the adjacent segments are grouped together. A transcript of the conversation including the grouping of the adjacent segments is stored in a memory.

Topic mining based on interactionally defined activity sequences

One embodiment provides a method for predicting a next action in a conversation system that includes obtaining, by a processor, information from conversation logs and a conversation design. The processor further creates a dialog graph based on the conversation design. Weights and attributes for edges in the dialog graph are determined based on the information from the conversation logs. An unrecognized user input the conversation system is detected. The unrecognized user input is analyzed and a next action is predicted based on dialog nodes in the dialog graph and historical paths. A guiding conversation response is generated based on the predicted next action.

Growing community of inventors

Mountain View, CA, United States of America

Lei Huang