Google Inc.

Matthew Stokes

Andrew Schoneweis

Pei-Ling Feng

James Felkins

Julian Le

Adriana Teresa Olmos Antillon

Jason Kearns

Felix David Mejia Abreu

Harry Yu

Mark Buswell

Nayon Kim

Alexander Edward Stillwell

Marcin M Nowak-Przygodzki

Mugurel-Ionut Andreica

Dana Ritter

Andre Elisseeff

Ernest Galbrun

Lukasz Suder

Mathias Carlen

João Paulo Pagaime Da Silva

Torsten Marek

Gökhan Hasan Bakir

Gökhan Bakir

Marius Dumitran

Display screen with graphical user interface

Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to extract, validate, maintain, generalize, extend and/or distribute individual actions and 'traces' of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party website without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

Analyzing web pages to facilitate automatic navigation

Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to abstract, validate, maintain, generalize, extend and/or distribute individual actions and 'traces' of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party web site without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

Display screen with computer graphical user interface

Computer display screen or portion thereof with graphical user interface

Display screen with a graphical user interface

Growing community of inventors

Zurich, Switzerland

Matthew Stokes