Google Inc.

Sang Soo Sung

Lantian Zheng

David P Whipp

Krishna Asur Bharat

Pravir Kumar Gupta

Bo Wang

Maxim Gubin

Kenneth Wayne Dauber

Chad Owen Yoshikawa

Chris Ramsdale

Alfonso Gomez-Jordana

Kevin Yeun

Jae Won Seo

Haywai Hayward Chan

Jing Qian

Chen Liu

Venkat Kotla

Liuyi Sun

Andrew Stephen Tomkins

Robin Dua

Fergus Gerard Hurley

Michael Schwarz

Subbaiah Venkata

Jae Seo

Yeliang Zhang

Abraham Jung-Gyu Lee

The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for integrating voice-based interaction and control into a native graphical user interface (GUI) of an executed application. For example, a communications device may obtaining component data identifying a plurality of components of a voice-user interface from a computing system maintained by a voice-service provider, and may execute an application linked to a corresponding one of the components of the voice-user interface. The communications device may generate the native GUI based on an output of the executed application, and may generate an interface element representative of the corresponding one of the components of the voice-user interface. The communications device may present the generated interface element within the native GUI, which may embed the corresponding component of the voice-user interface into the native GUI.

Component libraries for voice interaction services

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing suggestions within a document. In one aspect, a method includes obtaining textual input provided to a document editing application by a user device, the textual input being provided to the document editing application for inclusion in a document; identifying performance measures associated with the current editing session for the document, each performance measure being based on session data obtained from the user device during a document editing session, the session data being for the textual input and prior text that was included in the document prior to the textual input; providing the performance measures as input to a suggestion model that was trained using historical performance measures identified in performance logs for historical document editing sessions of users; and throttling textual suggestions during the current editing session based on the output of the suggestion model.

Providing suggestions within a document

Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

Systems and methods for voice-based initiation of custom device actions

Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for asynchronous execution of client requests. In some implementations, data indicating a user request to a digital assistant is received. An action corresponding to the user request is determined. It is determined that the action is classified as an action to be performed asynchronously to the user request. A confirmation message is sent, for output, and the action is performed asynchronously to the user request.

Asynchronous processing of user requests

Methods, systems, and apparatus, for detour based content selection. In one aspect, a method includes receiving, at a data processing apparatus, location data for a plurality of users, the location data describing, for each user, locations of a user device of the user; determining, from the location data, route data for the plurality of users, the route data describing, for each user, a route traveled by the user; determining, by the data processing apparatus, for at least one or more of the users, a detour from the route traveled by the user to a retail location of the offeror; determining, by the data processing apparatus, for each of the at least one or more of the users, whether the user is eligible for an offer of the offeror based on the detour; and for each user eligible for an offer, enabling the offeror to provide an offer to the user.

Detour based content selections

In one aspect, a method includes obtaining textual input provided to a document editing application by a user device, the textual input being provided to the document editing application for inclusion in a document; identifying performance measures associated with the current editing session for the document, each performance measure being based on session data obtained from the user device during a document editing session, the session data being for the textual input and prior text that was included in the document prior to the textual input; providing the performance measures as input to a suggestion model that was trained using historical performance measures identified in performance logs for historical document editing sessions of users; and throttling textual suggestions during the current editing session based on the output of the suggestion model.

Growing community of inventors

Palo Alto, CA, United States of America

Sang Soo Sung