Google Inc.

Gabriel Taubman

John J Lee

Jason Sanders

Ryan M Geiss

Andrew William Hogue

Max Benjamin Braun

David Petrou

Thad Eugene Starner

Harvey Ho

Thomas Weedon Hume

Matthew Nirvan Sharifi

Hartmut Neven

Hartwig Adam

Dominik Roblek

Charles Joseph Rosenberg

Blaise Hilary Aguera-Arcas

Brandon Charles Barbello

Julian James Odell

Ulrich Franz Buddemeier

Christopher Thornton

Fernando A Brucher

Beat Gfeller

Jan Heinrich Althaus

Kevin I Kilgour

Katsiaryna Naliuka

James David Lyon

Marvin Karl Ritter

Ilya Firman

Adam Coimbra

Mihajlo Velimirović

William J Byrne

Mitchell Joseph Heinrich

Marcin M Nowak-Przygodzki

Brian Strope

Keun Soo Yim

Hen Fitoussi

James Stout

Joseph Lange

Mugurel Ionut Andreica

Abhanshu Sharma

Svetoslav Ganov

Cliff Kuang

Jindong Chen

Gökhan Bakir

John DiMartile

Mikhail Reutov

Noam Etzion-Rosenberg

Benjamin Schlesinger

Robert Berry

Jacek Szmigiel

Casey Ho

Michael Oh

Kyle Pedersen

Sapir Caduri

Sahil Goel

Anatoly Efros

Vishwath Mohan

Nikita Edward Dubrovsky

Morgan Venable

Gilles Baechler

Yunfan Jin

Reed Enger

Kalyana Ram Desineni

John Dimartile

The present disclosure is directed to automating user interactions in an application. In particular, the computing device can determine, based on the input data, an intent associated with performing an action on the computing device. Additionally, the computing device can invoke, using an application-level assistant component configured to provide an application-level interface on the computing device, execution of an application. Moreover, the computing device can transmit, to a system-level assistant component configured to provide a system-level interface with the computing device, instructions to interface with an actionable component of the application. The instructions can be transmitted using a trusted intermediary component configured to facilitate an interface between the system-level assistant component and the application-level assistant component. Furthermore, the computing device can engage, using the system-level assistant component, the actionable component of the application to perform the action.

Human-in-the-loop voice automation system

Implementations relate to techniques for providing context-dependent search results. The techniques can include receiving a query and background audio. The techniques can also include identifying the background audio, establishing concepts related to the background audio and obtaining terms related to the concepts related to the background audio. The techniques can also include obtaining search results based on the query and on at least one of the terms. The techniques can also include providing the search results.

Background audio identification for query disambiguation

Methods, systems, and apparatus for filtering content at the operating system level. In one aspect, a method includes accessing, at a user device, data that includes content items that are to be presented by an application executing on the user device; prior to the content being presented by the application: for each content item, determining, at the user device and by a filtering model, whether the content item is to be presented by the application or filtered, for each content item that is determined to be presented by the application, allowing the application to present the content item, and for each content item that is determined to be filtered, precluding, by the filtering model by a system level filtering operation performed at an operating system level and separate from an application level at which the application is executing, presentation of the content item by the application.

System for filtering displayed content at the OS level

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input, determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying, by the dialog engine, a predetermined feedback scare associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.

Providing answers to voice queries using user feedback

Implementations relate to techniques for providing context-dependent search results. A computer-implemented method includes receiving an audio stream at a computing device during a time interval, the audio stream comprising user speech data and background audio, separating the audio stream into a first substream that includes the user speech data and a second substream that includes the background audio, identifying concepts related to the background audio, generating a set of terms related to the identified concepts, influencing a speech recognizer based on at least one of the terms related to the background audio, and obtaining a recognized version of the user speech data using the speech recognizer.

Background audio identification for speech disambiguation

Implementations set forth herein relate to an automated assistant that can interact with applications that may not have been pre-configured for interfacing with the automated assistant. The automated assistant can identify content of an application interface of the application to determine synonymous terms that a user may speak when commanding the automated assistant to perform certain tasks. Speech processing operations employed by the automated assistant can be biased towards these synonymous terms when the user is accessing an application interface of the application. In some implementations, the synonymous terms can be identified in a responsive language of the automated assistant when the content of the application interface is being rendered in a different language. This can allow the automated assistant to operate as an interface between the user and certain applications that may not be rendering content in a native language of the user.

Automated assistant control of non-assistant applications via identification of synonymous term and/or speech processing biasing

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input; determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying, by the dialog engine, a predetermined feedback score associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.

In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products. A computing device stores reference song characterization data and receives digital audio data. The computing device determines whether the digital audio data represents music and then performs a different process to recognize that the digital audio data represents a particular reference song. The computing device then outputs an indication of the particular reference song.

Determining that audio includes music and then identifying the music as a particular song

Techniques and devices for access to high frame-rate radar data via a circular buffer are described. In some implementations, a radar sensor collects radar data regarding objects detected by a radar field and stores the data to a circular buffer. A data manager monitors the circular buffer and processes data requests from multiple applications. Through use of the described techniques and devices, the multiple applications can efficiently access the requested radar frame data from the circular buffer, reducing both memory requirements and processor resource usage associated with providing the requested data.

Access to high frame-rate radar data via a circular buffer

Growing community of inventors

Brooklyn, NY, United States of America

Gabriel Taubman