Google Inc.

Abhinav Kumar Rastogi

Dilek Zeynep Hakkani-Tur

Xiaoxue Zang

Srinivas Kumar Sunkara

Larry Paul Heck

Raghav Gupta

Blaise Hilary Aguera-Arcas

Jindong Chen

Zecheng He

Mihir Sanjay Kale

Gabriel Overholt Schubiner

Nevan Holt Wichers

Lijuan Liu

Ying Xu

Pranav Khaitan

Systems and methods for guided text generation in task-based dialogue. In some aspects of the technology, an automated assistant system is configured to receive a user request, call multiple APIs, generate dialogue acts based on data received from each API, replace any slot names in the dialogue acts with natural language descriptions of the slots, concatenate the modified dialogue acts, and pass the concatenated result to an NLG model for generation of a natural language response. In some aspects of the technology, the automated assistant may be configured to generate simple templated responses based on the data received from each API, concatenate the simple templated responses, and pass the concatenated sequence to an NLG model trained as a sequence-to-sequence transformer for generation of a final natural language response.

Guided text generation for task-oriented dialogue

Generally, the present disclosure is directed to user interface understanding. More particularly, the present disclosure relates to training and utilization of machine-learned models for user interface prediction and/or generation. A machine-learned interface prediction model can be pre-trained using a variety of pre-training tasks for eventual downstream task training and utilization (e.g., interface prediction, interface generation, etc.).

Machine-learned models for user interface prediction, generation, and interaction understanding

Methods, systems, and apparatus, including computer programs encoded on computer storage media for dialogue systems. A transcription of a user utterance is obtained. The transcription of the utterance is tokenized to identify multiple tokens for the utterance. Token-level utterance encodings corresponding to different tokens of the transcription are generated. A system action encoding from data indicating system actions previously performed by the dialogue system are generated. A dialogue context vector based on the utterance encoding and the system action encoding are generated. The token-level utterance encodings, the system action encoding, and the dialogue context vector are processed using a slot tagger to produce token-level output vectors. A limited set of candidate token classifications for the tokens of the user utterance are determined based on the token-level utterance encodings. A response for output is provided in response to the user utterance.

Language understanding and dialogue state tracking in dialogue systems

Determining a dialog state of an electronic dialog that includes an automated assistant and at least one user, and performing action(s) based on the determined dialog state. The dialog state can be represented as one or more slots and, for each of the slots, one or more candidate values for the slot and a corresponding score (e.g., a probability) for each of the candidate values. Candidate values for a slot can be determined based on language processing of user utterance(s) and/or system utterance(s) during the dialog. In generating scores for candidate value(s) of a given slot at a given turn of an electronic dialog, various features are determined based on processing of the user utterance and the system utterance using a memory network. The various generated features can be processed using a scoring model to generate scores for candidate value(s) of the given slot at the given turn.

Determining state of automated assistant dialog

Generally, the present disclosure is directed to systems and methods for performing task-oriented response generation that can provide advantages for artificial intelligence systems or other computing systems that include natural language processing for interpreting user input. Example implementations can process natural language descriptions of various services that can be accessed by the system. In response to a natural language input, systems can identify relevant values for executing one of the service(s), based in part on comparing embedded representations of the natural language input and the natural language description using a machine learned model.

Schema-guided response generation

Growing community of inventors

Sunnyvale, CA, United States of America

Abhinav Kumar Rastogi