Google Inc.

Amplify Education, Inc.

John J Lee

Gabriel Taubman

Jason Sanders

Andrew William Hogue

Melissa K Carroll

John R Provine

Engin Cinar Sahin

Vinicius J Fortuna

Kevin Lerman

Abhijit A Mahabal

Zachary D Wissner-Gross

Kenny Peng

Vivek Venkatachalam

John F Palma

Fergal Casey

Stephanie J Yaung

Implementations relate to techniques for providing context-dependent search results. The techniques can include receiving a query and background audio. The techniques can also include identifying the background audio, establishing concepts related to the background audio and obtaining terms related to the concepts related to the background audio. The techniques can also include obtaining search results based on the query and on at least one of the terms. The techniques can also include providing the search results.

Background audio identification for query disambiguation

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input, determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying, by the dialog engine, a predetermined feedback scare associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.

Providing answers to voice queries using user feedback

Implementations relate to techniques for providing context-dependent search results. A computer-implemented method includes receiving an audio stream at a computing device during a time interval, the audio stream comprising user speech data and background audio, separating the audio stream into a first substream that includes the user speech data and a second substream that includes the background audio, identifying concepts related to the background audio, generating a set of terms related to the identified concepts, influencing a speech recognizer based on at least one of the terms related to the background audio, and obtaining a recognized version of the user speech data using the speech recognizer.

Background audio identification for speech disambiguation

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input; determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying, by the dialog engine, a predetermined feedback score associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resolving ambiguity in received voice queries. An original voice query is received following one or more earlier voice queries, wherein the original voice query includes a pronoun or phrase. In one implementation, a plurality of acoustic parameters is identified for one or more words in the original voice query. A concept represented by the pronoun is identified based on the plurality of acoustic parameters, wherein the concept is associated with a particular query of the one or more earlier queries. The concept is associated with the pronoun. Alternatively, a concept may be associated with a phrase by using grammatical analysis of the query to relate the phrase to a concept derived from a prior query.

Resolving pronoun ambiguity in voice queries

Training a dialog system using user feedback for answers to questions

A system and method for providing playback of interactions on a computing device. The system is configured to provide a user of a computing device with the capability of playing and/or recording walkthroughs on a user interface of the computing device, wherein the user is able to directly interact with the walkthrough and user interface in real- or near real-time during playback of the walkthrough. The walkthrough may be tutorial-based, such that the user may follow along with the walkthrough when attempting to answer a question or solve a problem via the user interface (e.g. classroom lesson on solving equations). The system is further configured to allow the user to record and generate a customized walkthrough.

System and method for recording and playback of interactions on a computing device

Growing community of inventors

Long Island City, NY, United States of America

John J Lee