Google Inc.

James Kuczmarski

Vladimir Vuskovic

Melvin Jose Johnson Premkumar

Amarnag Subramanya

Vibhor Jain

Nimesh Ranjan

Luna Dai

Nihal Sandeep Balani

Jinna Lei

Mengmeng Niu

Hongjie Chai

Daisuke Ikeda

Wangqing Yuan

Techniques described herein relate to facilitating end-to-end multilingual communications with automated assistants. In various implementations, speech recognition output may be generated based on voice input in a first language. A first language intent may be identified based on the speech recognition output and fulfilled in order to generate a first natural language output candidate in the first language. At least part of the speech recognition output may be translated to a second language to generate an at least partial translation, which may then be used to identify a second language intent that is fulfilled to generate a second natural language output candidate in the second language. Scores may be determined for the first and second natural language output candidates, and based on the scores, a natural language output may be selected for presentation.

Facilitating communications with automated assistants in multiple languages

Facilitating end-to-end communications with automated assistants in multiple languages

Techniques described herein may serve to increase the language coverage of an automated assistant system, i.e. they may serve to increase the number of queries in one or more non-native languages for which the automated assistant is able to deliver reasonable responses. For example, techniques are described herein for training and utilizing a machine translation model to map a plurality of semantically-related natural language inputs in one language to one or more canonical translations in another language. In various implementations, the canonical translations may be selected and/or optimized for determining an intent of the speaker by the automated assistant, so that one or more responsive actions can be performed based on the speaker's intent. Put another way, the canonical translations may be specifically formatted for indicating the intent of the speaker to the automated assistant.

Adapting automated assistants for use with multiple languages

Growing community of inventors

San Francisco, CA, United States of America

James Kuczmarski