Google Inc.

Haywai Hayward Chan

Eric H C Liu

Lantian Zheng

Sang Soo Sung

David P Whipp

Chen Liu

Liuyi Sun

Arvind Chandrababu

Ik Hwan Byun

Eric Hc Liu

The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for integrating voice-based interaction and control into a native graphical user interface (GUI) of an executed application. For example, a communications device may obtaining component data identifying a plurality of components of a voice-user interface from a computing system maintained by a voice-service provider, and may execute an application linked to a corresponding one of the components of the voice-user interface. The communications device may generate the native GUI based on an output of the executed application, and may generate an interface element representative of the corresponding one of the components of the voice-user interface. The communications device may present the generated interface element within the native GUI, which may embed the corresponding component of the voice-user interface into the native GUI.

Component libraries for voice interaction services

A system and method for interfacing a television with a second device is provided. The system includes an interfacing unit to enter an interfacing mode between the television mode and the second device; a card storage unit to store a first card and a second card, the first card being presently displayed on the television and the second card being previously displayed on the television; a current card display register to store the first card; an interactive retrieval unit to retrieve a plurality of interactive functions associated with the first card; and a display unit to display the first card and the plurality of interactive functions in response to being in the interfacing mode.

Interfacing a television with a second device

Implementations described herein relate to transitioning a computing device between operating modes according to whether the computing device is suitably oriented for received non-audio related gestures. For instance, the user can attach a portable computing device to a docking station of a vehicle and, while in transit, wave their hand near the portable computing device in order to invoke the automated assistant. Such action by the user can be detected by a proximity sensor and/or any other device capable of determining a context of the portable computing device and/or an interest of the user in invoking the automated assistant. In some implementations location, orientation, and/or motion of the portable computing device can be detected and used in combination with an output of the proximity sensor to determine whether to invoke the automated assistant in response to an input gesture from the user.

Operating modes that designate an interface modality for interacting with an automated assistant

A system and method for interfacing a television with a second device is provided. The system includes an interfacing unit to enter an interfacing mode between the television mode and the second device; a card storage unit to store a first card and a second card, the first card being presently displayed on the television and the second card being previously displayed on the television; a current card display register to store the first card; an interactive retrieval unit to retrieve a plurality of interactive functions associated with the first card, the plurality of interactive functions configured to instigate an action via the second device; and a display unit to display the first card and the plurality of interactive functions in response to being in the interfacing mode.

Growing community of inventors

Mountain View, CA, United States of America

Haywai Hayward Chan