Google Inc.

Pravir Kumar Gupta

Bo Wang

Scott B Huffman

Michael Buchanan

Omer Bar-or

Sunil Vemuri

Nitin Mangesh Shetti

Barnaby John James

Tal Cohen

Adi Mano

Kavi J Goel

Christopher Bo Tandiono

Arthur Edmond Blume

Ziv Bar-Yossef

Igor Tsvetkov

Oren Naim

Nitsan Oz

Ida Mayer

Javier Alejandro Rey

Vikram Aggarwal

Lantian Zheng

Peter Jin Hong

Jack Wright Menzel

Sang Soo Sung

Christina R Dhanaraj

Chad Owen Yoshikawa

Chris Ramsdale

Bruce Christensen

Nathaniel J Gaylinn

Jan Kuipers

Ramakrishnan Kazhiyur-Mannar

Alfonso Gomez-Jordana

Kevin Yeun

Jeffrey A Boortz

Jae Won Seo

Mark Andrew Paskin

Nir Andelman

Venkat Kotla

Siddhi Tadpatrikar

Ganesh Ramanarayanan

Yuzhao Ni

David Roy Schairer

Lev Finkelstein

Shashidhar Anil Thakur

Jun Gong

Tomer Kol

Murali Krishna Viswanathan

Jared L Levy

Grace Chung

Benson Tsai

Daphne Dembo

Evan B Roseman

Yang Gao

Jakob David Uszkoreit

Okan Kolak

Peter John Hodgson

Nitin Khandelwal

Percy Shuo Liang

Deniz Binay

Daniel Martin Bikel

Cheng Li

Subbaiah Venkata

Jae Seo

Mahesh S Palekar

Akshay Jaggi

Ester Lopez Berga

Arne Vansteenkiste

Robin Martinjak

Krish Narang

Dhruv Amin

Aakash Goel

Tayfun Elmas

Keith Brady

Omer Bar-Or

Peter Hodgson

Methods and apparatus related to ranking modifications of a previous query. For example, modifications of a previous query may be generated based on a current query issued subsequent to the previous query by substituting one or more n-grams of the previous query with one or more n-grams of the current query. One or more measures of each of the modifications may be identified and, based on such measures, a ranking of each of the modifications may be determined. One of the modifications may be selected as a submission query based on the rankings of the modifications. The submission query may be selected for submission in lieu of, or in addition to, the current query.

Ranking modifications of a previous query

Technology of the disclosure may facilitate user discovery of various voice-based action queries that can be spoken to initiate computer-based actions, such as voice-based action queries that can be provided as spoken input to a computing device to initiate computer-based actions that are particularized to content being viewed or otherwise consumed by the user on the computing device. Some implementations are generally directed to determining, in view of content recently viewed by a user on a computing device, at least one suggested voice-based action query for presentation via the computing device. Some implementations are additionally or alternatively generally directed to receiving at least one suggested voice-based action query at a computing device and providing the suggested voice-based action query as a suggestion in response to input to initiate providing of a voice-based query via the computing device.

Providing suggested voice-based action queries

Systems, methods and apparatus for invoking actions at a second user device from a first user device. A method includes determining that a first user device has an associated second user device; accessing specification data that specifies a set of user device actions that the second user device is configured to perform; receiving command inputs for the first user device; for each command input, determining whether the command input resolves to one of the user device actions; for each command input not determined to resolve any of the user device actions, causing the command input to be processed at the first user device; and for each command input determined to resolve one of the user device actions causing the first user device to display in a user interface a dialog by which a user may either accept or deny invoking the user device action at the second user device.

Remote invocation of mobile device actions

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for speech endpointing based on word comparisons are described. In one aspect, a method includes the actions of obtaining a transcription of an utterance. The actions further include determining, as a first value, a quantity of text samples in a collection of text samples that (i) include terms that match the transcription, and (ii) do not include any additional terms. The actions further include determining, as a second value, a quantity of text samples in the collection of text samples that (i) include terms that match the transcription, and (ii) include one or more additional terms. The actions further include classifying the utterance as a likely incomplete utterance or not a likely incomplete utterance based at least on comparing the first value and the second value.

Speech endpointing based on word comparisons

Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

Systems and methods for voice-based initiation of custom device actions

Methods, systems, and apparatus for receiving, by a voice action system, data specifying trigger terms that trigger an application to perform a voice action and a context that specifies a status of the application when the voice action can be triggered. The voice action system receives data defining a discoverability example for the voice action that comprises one or more of the trigger terms that trigger the application to perform the voice action when a status of the application satisfies the specified context. The voice action system receives a request for discoverability examples for the application from a user device having the application installed, and provides the data defining the discoverability examples to the user device in response to the request. The user device is configured to provide a notification of the one or more of the trigger terms when a status of the application satisfies the specified context.

Voice action discoverability system

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for speech endpointing are described. In one aspect, a method includes the action of accessing voice query log data that includes voice queries spoken by a particular user. The actions further include based on the voice query log data that includes voice queries spoken by a particular user, determining a pause threshold from the voice query log data that includes voice queries spoken by the particular user. The actions further include receiving, from the particular user, an utterance. The actions further include determining that the particular user has stopped speaking for at least a period of time equal to the pause threshold. The actions further include based on determining that the particular user has stopped speaking for at least a period of time equal to the pause threshold, processing the utterance as a voice query.

Speech endpointing

Methods, systems, and apparatus, for defining and monitoring an event for a physical entity and the performance of an action in response to the occurrence of the event. A method includes receiving data indicating an event for a physical entity, the event specified in part by a physical environment feature for which the occurrence of the event is to be monitored by the data processing apparatus; receiving data indicating an action associated with the event and to be taken in response to the occurrence of the event; monitoring for the occurrence of the event for the physical entity; and in response to the occurrence of the event, causing the action associated with the event to be performed.

Developer voice actions system

Implementations include identifying, from a database of entries reflecting past automated assistant commands submitted within a threshold amount of time relative to a current time, particular entries that each reflect corresponding features of a corresponding user submission of a particular command. Further, those implementations include determining that the particular command is a golden command, for a particular automated assistant function, responsive to determining that: at least a threshold percentage of the user submissions of the particular command triggered the particular automated assistant function, and a quantity of the user submission of the particular command satisfies a threshold quantity. Those implementations further include, responsive to determining that the particular command is currently the golden command: processing a stream of current occurrences of submissions of the particular command to determine whether the particular automated assistant function is triggered; and when the processing indicates that a threshold quantity and/or percentage of the current occurrences fails to satisfy a potential problem threshold: causing one or more electronic alerts to be transmitted.

Low latency automated identification of automated assistant function failure

Growing community of inventors

Mountain View, CA, United States of America

Pravir Kumar Gupta