Google Inc.

Luca Zanolin

Richard Zarek Cohen

Simon Tickner

Peter John Hodgson

Bjorn Erik Bringert

Pawel Pietryka

Henrique Dias Penha

Marcus Alexander Foster

Michael J Lebeau

Dave Burke

Roberto Cosenza

Alexander James Faaborg

Peter Ng

Daniel Marc Gatan Shiplacoff

Matias Gonzalo Duarte

Henrique Penha

Andrew Anderson Stewart

Daniel Marc Shiplacoff

Andrew Stewart

The present disclosure includes a system and method for delaying, suppressing, or canceling the output of notifications in an electronic device. Notifications may be delayed, suppressed, or canceled based on the urgency of the notification, whether an application is actively executing and controlling certain aspects of the output device, whether an application actively executing and controlling certain aspects of the output device can be interrupted, and/or the operating environment of the electronic device.

System and method for selection of notification techniques in an electronic device

Disclosed are systems, methods, and devices for providing a layered user interface for one or more applications. A user-interface layer for a voice user interface is generated. The user-interface layer can be based on a markup-language-structured user-interface description for an application configured to execute on a computing device. The user-interface layer can include a command display of one or more voice-accessible commands for the application. The computing device can display at least the user-interface layer of the voice user interface. The computing device can receive an input utterance, obtain input text based upon speech recognition performed upon the input utterance, and determine that the input text corresponds to a voice-accessible command displayed as part of the command display. The computing device can execute the application to perform the command.

Layered mobile application user interfaces

A computing device may receive an incoming communication and, in response, generate a notification that indicates that the incoming communication can be accessed using a particular application on the communication device. The computing device may further provide an audio signal indicative of the notification and automatically activate a listening mode. The computing device may receive a voice input during the listening mode, and an input text may be obtained based on speech recognition performed upon the voice input. A command may be detected in the input text. In response to the command, the computing device may generate an output text that is based on at least the notification and provide a voice output that is generated from the output text via speech synthesis. The voice output identifies at least the particular application.

Voice control for asynchronous notifications

A computing device is configured to initiate actions in response to speech input that includes a name or other indication of an entity, in a first spoken utterance, followed by an action, in a second spoken utterance. The computing device receives the first spoken utterance, identifies an entity based on the first spoke utterance, and indicates a plurality of available actions based on the identified entity. The computing device then receives the second spoken utterance and identifies a selection of at least one of the available actions based on the second spoken utterance. The computing device then initiates the at least one selected action.

Voice application finding and user invoking applications related to a single entity

A computing device receives an audio input from a user. The computing device determines a series of words from the audio input. The computing device outputs, for display, one or more substituted symbols. The one or more substituted symbols correspond to at least a portion of the series of words. In response to determining that receipt of the audio input has completed, the computing device outputs, for display, alphanumeric characters comprising the series of words in place of the one or more substituted symbols.

Visual confirmation of voice recognized text input

A method for providing suggestions includes capturing audio that includes speech and receiving textual content from a speech recognition engine. The speech recognition engine performs speech recognition on the audio signal to obtain the textual content, which includes one or more passages. The method also includes receiving a selection of a portion of a first word in a passage in the textual content, wherein the passage includes multiple words, and retrieving a set of suggestions that can potentially replace the first word. At least one suggestion from the set of suggestions provides a multi-word suggestion for potentially replacing the first word. The method further includes displaying, on a display device, the set of suggestions, and highlighting a portion of the textual content, as displayed on the display device, for potentially changing to one of the suggestions from the set of suggestions.

Interactive text editing

This specification describes technologies relating to recognition of text in various media. In general, one aspect of the subject matter described in this specification can be embodied in methods that include receiving an input signal including data representing one or more words and passing the input signal to a text recognition system that generates a recognized text string based on the input signal. The methods may further include receiving the recognized text string from the text recognition system. The methods may further include presenting the recognized text string to a user and receiving a corrected text string based on input from the user. The methods may further include checking if an edit distance between the corrected text string and the recognized text string is below a threshold. If the edit distance is below the threshold, the corrected text string may be passed to the text recognition system for training purposes.

Selective feedback for text recognition systems

A computing device is configured to initiate actions in response to speech input that includes a name or other indication of an entity, in a first spoken utterance, followed by user choosing an application related to an entity, in a second spoken utterance. The computing device receives the first spoken utterance, identifies an entity based on the first spoke utterance, and indicates a plurality of available applications related to the identified entity. The computing device then receives the second spoken utterance and identifies a selection of at least one of the available applications based on the second spoken utterance. The computing device then invokes the at least one selected application.

A spoken utterance includes at least a first level of a multi-level command format, in which the first level identifies an application. The spoken utterance may also include a second level of the multi-level command format, in which the second level identifies an action. In response to receiving the spoken utterance at a computing device, a representation of the application identified by the first level is displayed on a display of the computing device. If the spoken utterance includes the second level of the multi-level command format, the action identified by the second level is initiated. If the spoken utterance does not include the second level of the multi-level command format, the computing device waits for a predetermined period of time and provides at least one of an audible or visual action prompt if the second level is not received within the predetermined period of time.

Structuring verbal commands to allow concatenation in a voice interface in a mobile device

The present application describes systems, articles of manufacture, and methods for continuous speech recognition for mobile computing devices. One embodiment includes determining whether a mobile computing device is receiving operating power from an external power source or a battery power source, and activating a trigger word detection subroutine in response to determining that the mobile computing device is receiving power from the external power source. In some embodiments, the trigger word detection subroutine operates continually while the mobile computing device is receiving power from the external power source. The trigger word detection subroutine includes determining whether a plurality of spoken words received via a microphone includes one or more trigger words, and in response to determining that the plurality of spoken words includes at least one trigger word, launching an application corresponding to the at least one trigger word included in the plurality of spoken words.

Systems and methods for continual speech recognition and detection in mobile computing devices

In general, this disclosure describes techniques to direct textual characters converted from vocal input into selected graphical user interface input fields. Vocal input may be received. Textual characters may be identified based on the vocal input. A first portion of the textual characters corresponding to a first portion of the vocal input may be graphically inputted into a first input field of a GUI. While receiving the vocal input, a selection by of a second input field in the GUI may be accepted after the first portion of the vocal input has been received. After accepting the selection of the second input field, a second portion of the textual characters corresponding to a second portion of the vocal input received after the selection of the second input field may be inputted into the second input field.

Growing community of inventors

London, United Kingdom

Luca Zanolin