Google Inc.

Michael Oh

Ricardo Escutia

Alan Lee Rogers

Min-sang Choi

Sun Kyung Park

Renwei Wu

Stephen Joseph McDonald

Gabriel Taubman

Ilya Firman

Keun Soo Yim

Adam Coimbra

Mugurel Ionut Andreica

Svetoslav Ganov

Cliff Kuang

Mikhail Reutov

Robert Berry

Kalyana Ram Desineni

Min-Sang Choi

Stephen Joseph Mcdonald

The present disclosure is directed to automating user interactions in an application. In particular, the computing device can determine, based on the input data, an intent associated with performing an action on the computing device. Additionally, the computing device can invoke, using an application-level assistant component configured to provide an application-level interface on the computing device, execution of an application. Moreover, the computing device can transmit, to a system-level assistant component configured to provide a system-level interface with the computing device, instructions to interface with an actionable component of the application. The instructions can be transmitted using a trusted intermediary component configured to facilitate an interface between the system-level assistant component and the application-level assistant component. Furthermore, the computing device can engage, using the system-level assistant component, the actionable component of the application to perform the action.

Human-in-the-loop voice automation system

Systems and methods are provided for displaying and interacting with multiple open views in a mobile environment. An example method can include displaying content for a first web page in a first pane in a maximized state on a mobile device, receiving a touch input on a navigation control associated with the first pane, and responsive to receiving the touch input, displaying a second web page in a second pane on the mobile device, the second pane being in a minimized state in a dock area. The dock area can overlay the first pane in the maximized state and the minimized state of the second pane can display a smaller version of the second web page than the second pane in a maximized state. In some examples the second web page updates content in parallel with the first web page.

Interface for multiple simultaneous views

Systems and methods are provided for displaying and interacting with multiple open views in a mobile environment. An example method can include displaying a current pane in a maximized state and at least a first pane in a minimized state in a dock area. The current pane is a top of a stack list and displays content associated with a first location and the first pane is in a dock list and displays content associated with a second location. The minimized state for a pane is a scaled down version of the maximized state for the pane, the scale applying to the content for the pane and a size of the pane. The method also includes receiving a drag input on the first pane in the dock area and scaling the size of the first pane according to proximity to the dock area.

Interface for multiple simultaneous interactive views

Systems and methods are provided for displaying and interacting with multiple open views in a mobile environment. An example method can include displaying content for a first active web page in a first pane on a display, the first active web page having a first hyperlink for a first target web page, and the first pane being displayed in a maximized state on the display. The method may also include receiving a long touch input on the first hyperlink, and, responsive to receiving the long touch input, opening the first target web page in a second pane, the second pane being displayed in a minimized state in a dock area of the display, wherein a minimized state is a scaled down version of a maximized state.

Growing community of inventors

Sunnyvale, CA, United States of America

Michael Oh