Google Inc.

Kyle Pedersen

Tim Phillip Wantland

Marcin M Nowak-Przygodzki

Gabriel Taubman

Ilya Firman

Brandon Charles Barbello

Adam Coimbra

James Stout

Joseph Lange

Thomas Weedon Hume

Abhanshu Sharma

Gökhan Bakir

David Lloyd Jones

Jindong Chen

Jacek Szmigiel

Yunfan Jin

Gilles Baechler

Reed Enger

Vishwath Mohan

Implementations set forth herein relate to an automated assistant that can interact with applications that may not have been pre-configured for interfacing with the automated assistant. The automated assistant can identify content of an application interface of the application to determine synonymous terms that a user may speak when commanding the automated assistant to perform certain tasks. Speech processing operations employed by the automated assistant can be biased towards these synonymous terms when the user is accessing an application interface of the application. In some implementations, the synonymous terms can be identified in a responsive language of the automated assistant when the content of the application interface is being rendered in a different language. This can allow the automated assistant to operate as an interface between the user and certain applications that may not be rendering content in a native language of the user.

Automated assistant control of non-assistant applications via identification of synonymous term and/or speech processing biasing

Systems are provided to facilitate continuous detection of words, names, phrases, or other sounds of interest and, responsive to such detection, provide a related user experience. The user experience can include providing links to media, web searches, translation services, journaling applications, or other resources based on detected ambient speech or other sounds. To preserve the privacy of those using and/or proximate to such systems, the system refrains from transmitting any information related to the detected sound unless the system receives permission from a user. Such permission can include the user interacting with a provided web search link, media link, or other user interface element.

Trigger sound detection in ambient audio to provide related functionality on a user interface

The present disclosure provides systems and methods to improve discoverability of selectable user interface elements. In particular, the present disclosure provides computing devices that, in some implementations, intelligently identify user interface elements that are selectable (e.g., based on intelligent understanding of the user interface content) and visually modify one or more of such selectable user interface elements to indicate to the user that they are selectable. The visual modification can highlight or otherwise draw attention to the user interface element(s), thereby improving their discoverability.

Systems and methods to increase discoverability in user interfaces

Growing community of inventors

Seattle, WA, United States of America

Kyle Pedersen