Google Inc.

Bjorn Erik Bringert

Richard Zarek Cohen

Henrique Dias Penha

Simon Tickner

Peter John Hodgson

Luca Zanolin

Pawel Pietryka

Michael J Lebeau

Robert William Hamilton

Dave Burke

Johan Schalkwyk

David Singleton

Marcus Alexander Foster

Hugo Botelho Barra

Nicholas Brock Weininger

Andrew Anderson Stewart

John Nicholas Jitkoff

Alexander James Faaborg

William J Byrne

Peter Ng

Daniel Marc Gatan Shiplacoff

Matias Gonzalo Duarte

Mikkel Crone Koser

Thomas Jenkins

Jean-Michel Roland Trivi

Henrique Penha

Satish Kumar Sampath

Adam Travis Skory

Mark Brophy

Mathew Inwood

Daniel Marc Shiplacoff

Andrew Stewart

Systems may include receiving, from the user device, data representing input to a virtual keyboard on the user device, where the virtual keyboard includes keys, and the data represents least one of: locations at which the keys were selected and durations for which the keys were selected. The systems may include using the data to identify character strings; and performing a spellcheck on the character strings to identify candidates for the character strings. The systems may also include determining popularities of the candidates; selecting one or more of the candidates based on popularity and ranking of the one or more candidates; and outputting the selected one or more candidates.

Using information from a user device and a server to suggest an input

A computer-implemented method can include initializing, at a computing device including one or more processors, an input method editor for composing an electronic message. The method can include receiving, at the computing device, an input from a user identifying a recipient for the electronic message. The method can include obtaining, at the computing device, language information corresponding to the recipient, the language information indicating one or more suggested natural languages for composing the electronic message. The method can include selecting, at the computing device, a natural language for composing the electronic message based on the language information to obtain a selected natural language. The method can also include configuring, at the computing device, the input method editor based on the selected natural language.

Techniques for automatically selecting a natural language for configuring an input method editor at a computing device

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for receiving, from a user device, data indicating a user performed a user input gesture combining a first display object in a plurality of display objects with a second display object in the plurality of display objects; identifying attributes that are associated with both the first display object and the second display object; and performing a search based on the attributes.

Requesting search results by user interface gesture combining display objects

Disclosed are systems, methods, and devices for providing a layered user interface for one or more applications. A user-interface layer for a voice user interface is generated. The user-interface layer can be based on a markup-language-structured user-interface description for an application configured to execute on a computing device. The user-interface layer can include a command display of one or more voice-accessible commands for the application. The computing device can display at least the user-interface layer of the voice user interface. The computing device can receive an input utterance, obtain input text based upon speech recognition performed upon the input utterance, and determine that the input text corresponds to a voice-accessible command displayed as part of the command display. The computing device can execute the application to perform the command.

Layered mobile application user interfaces

A computing device may receive an incoming communication and, in response, generate a notification that indicates that the incoming communication can be accessed using a particular application on the communication device. The computing device may further provide an audio signal indicative of the notification and automatically activate a listening mode. The computing device may receive a voice input during the listening mode, and an input text may be obtained based on speech recognition performed upon the voice input. A command may be detected in the input text. In response to the command, the computing device may generate an output text that is based on at least the notification and provide a voice output that is generated from the output text via speech synthesis. The voice output identifies at least the particular application.

Voice control for asynchronous notifications

In a first speech detection mode, a computing device listens for speech that corresponds to one of a plurality of activation phrases or 'hotwords' that cause the computing device to recognize further speech input in a second speech detection mode. Each activation phrase is associated with a respective application. During the first speech detection mode, the computing device compares detected speech to the activation phrases to identify any potential matches. In response to identifying a matching activation phrase with a sufficiently high confidence, the computing device invokes the application associated with the matching activation phrase and enters the second speech detection mode. In the second speech detection mode, the computing device listens for speech input related to the invoked application.

Multi hotword robust continuous voice command detection in mobile devices

According to an example implementation, a method may include playing, by a computing device, first audio generated by a first application, determining that the first audio generated by the first application should be interrupted based on a notification associated with a second application, pausing the first audio generated by the first application, playing interruptive audio generated by the second application during the pausing of the first audio, identifying a portion of the first audio that was previously played before the first audio was paused, and resuming the playing of the first audio so that the portion of the first audio that was previously played is replayed.

Continuous audio interaction with interruptive audio

A computing device is configured to initiate actions in response to speech input that includes a name or other indication of an entity, in a first spoken utterance, followed by an action, in a second spoken utterance. The computing device receives the first spoken utterance, identifies an entity based on the first spoke utterance, and indicates a plurality of available actions based on the identified entity. The computing device then receives the second spoken utterance and identifies a selection of at least one of the available actions based on the second spoken utterance. The computing device then initiates the at least one selected action.

Voice application finding and user invoking applications related to a single entity

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for recognizing speech input. In one aspect, a method includes receiving a user input and a grammar including annotations, the user input comprising audio data and the annotations providing syntax and semantics to the grammar, retrieving third-party statistical speech recognition information, the statistical speech recognition information being transmitted over a network, generating a statistical language model (SLM) based on the grammar and the statistical speech recognition information, the SLM preserving semantics of the grammar, processing the user input using the SLM to generate one or more results, comparing the one or more results to candidates provided in the grammar, identifying a particular candidate of the grammar based on the comparing, and providing the particular candidate for input to an application executed on a computing device.

Robust speech recognition

According to one general aspect, a method of remotely controlling a remote computing device from a local computing device that is executing a web browser, may include receiving, via a Hypertext Transfer Protocol (HTTP), at least a graphical human interface output from the remote computing device. The method may also include displaying, within a display area defined by a Hypertext Markup Language (HTML) web element, wherein the HTML web element is interpreted by the web browser, the graphical human interface output from the remote computing device. The method may further include receiving, from the remote computing device via HTTP, at least one update to the graphical human interface output. And, the method may include dynamically updating the graphical human interface output displayed within the display area defined by the HTML web element, wherein updating is based upon the received at least one update to the graphical human interface output.

Remote control of a computing device

A computing device receives an audio input from a user. The computing device determines a series of words from the audio input. The computing device outputs, for display, one or more substituted symbols. The one or more substituted symbols correspond to at least a portion of the series of words. In response to determining that receipt of the audio input has completed, the computing device outputs, for display, alphanumeric characters comprising the series of words in place of the one or more substituted symbols.

Visual confirmation of voice recognized text input

A computing device is configured to initiate actions in response to speech input that includes a name or other indication of an entity, in a first spoken utterance, followed by user choosing an application related to an entity, in a second spoken utterance. The computing device receives the first spoken utterance, identifies an entity based on the first spoke utterance, and indicates a plurality of available applications related to the identified entity. The computing device then receives the second spoken utterance and identifies a selection of at least one of the available applications based on the second spoken utterance. The computing device then invokes the at least one selected application.

A spoken utterance includes at least a first level of a multi-level command format, in which the first level identifies an application. The spoken utterance may also include a second level of the multi-level command format, in which the second level identifies an action. In response to receiving the spoken utterance at a computing device, a representation of the application identified by the first level is displayed on a display of the computing device. If the spoken utterance includes the second level of the multi-level command format, the action identified by the second level is initiated. If the spoken utterance does not include the second level of the multi-level command format, the computing device waits for a predetermined period of time and provides at least one of an audible or visual action prompt if the second level is not received within the predetermined period of time.

Growing community of inventors

Bath, United Kingdom

Bjorn Erik Bringert