Google Inc.

Matthew Stokes

Andrew Schoneweis

Nayon Kim

Pei-Ling Feng

James Felkins

Julian Le

Adriana Teresa Olmos Antillon

Felix David Mejia Abreu

Jason Kearns

Harry Yu

Alexander Edward Stillwell

Mark Buswell

Marcin M Nowak-Przygodzki

Mugurel-Ionut Andreica

Dana Ritter

Andre Elisseeff

Mathias Carlen

Lukasz Suder

Ernest Galbrun

Torsten Marek

João Paulo Pagaime Da Silva

Gökhan Hasan Bakir

Gökhan Bakir

Marius Dumitran

Display screen with graphical user interface

Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to extract, validate, maintain, generalize, extend and/or distribute individual actions and 'traces' of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party website without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

Analyzing web pages to facilitate automatic navigation

Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to abstract, validate, maintain, generalize, extend and/or distribute individual actions and 'traces' of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party web site without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

Display screen with computer graphical user interface

Computer display screen or portion thereof with graphical user interface

Display screen with a graphical user interface

Growing community of inventors

Zurich, Switzerland

Matthew Stokes