Google Inc.

Srikanth Pandiri

Behshad Behzadi

Zaheed Sabur

Luv Kothari

Yang Lu

Xu Liu

Steve Cheng

Gokay Baris Gultekin

Akshay Kannan

Angana Ghosh

Domenico Carbotta

Qi Wang

Victor Carbune

Nicolo D'Ercole

Julia Proskurnia

Alvin Abdagic

Jacopo Sannazzaro Natta

Viesturs Zarins

Krzysztof Andrzej Goj

Systems and methods described herein relate to determining whether to incorporate recognized text, that corresponds to a spoken utterance of a user of a client device, into a transcription displayed at the client device, or to cause an assistant command, that is associated with the transcription and that is based on the recognized text, to be performed by an automated assistant implemented by the client device. The spoken utterance is received during a dictation session between the user and the automated assistant. Implementations can process, using automatic speech recognition model(s), audio data that captures the spoken utterance to generate the recognized text. Further, implementations can determine whether to incorporate the recognized text into the transcription or cause the assistant command to be performed based on touch input being directed to the transcription, a state of the transcription, and/or audio-based characteristic(s) of the spoken utterance.

Voice commands for an automated assistant utilized in smart dictation

Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

Voice-controlled entry of content into graphical user interfaces

Growing community of inventors

Zurich, Switzerland

Srikanth Pandiri