Peloton Interactive, Inc.

Aiqudo, Inc

Matan Levi

Rajat Mukherjee

Kiran Bindhu Hemaraj

Mark Robinson

Sunil Patil

Embodiments of the present invention provide systems, methods, and computer storage media directed to providing talk back automation for applications installed on a mobile device. To do so actions (e.g., talk back features) can be created, via the digital assistant, by recording a series of events that are typically provided by a user of the mobile device when manually invoking the desired action. At a desired state, the user may select an object that represents the output of the application. The recording embodies the action and can be associated with a series of verbal commands that the user would typically announce to the digital assistant when an invocation of the action is desired. In response, the object is verbally communicated to the user via the digital assistant, a different digital assistant, or even another device. Alternatively, the object may be communicated to the same application or another application as input.

Talk back from actions in applications

Embodiments described herein are generally directed towards systems and methods relating to a crowd-sourced digital assistant and system. In particular, embodiments facilitate the intuitive creation and distribution of action datasets that include computing events or tasks that can be reproduced when an associated command, stored in an action dataset, is determined received by a digital assistant device. The digital assistant device described herein can generate new action datasets, on-board new action datasets, and receive new action datasets or updates to existing action datasets. Each digital assistant device in the described system can participate in the building of action datasets, so as to crowd-source a dialect that can be understood by a digital assistant device.

Crowdsourced on-boarding of digital assistant operations

Various embodiments, methods and systems for implementing a digital assistant connectivity system are provided. In operation, a request to receive a unique identifier is communicated from a digital assistant device. The unique identifier is utilized to pair the digital assistant device with a smart assistant device. The unique identifier is received from and generated by a digital assistant server to correspond with the digital assistant device and a corresponding digital assistant device application instance. An instruction to perform an action on the digital assistant device is received at the digital assistant device application. The instruction is communicated based on an established command-driven session between the digital assistant device application and the smart assistant device. The command-driven session is associated with the unique identifier that paired the digital assistant device and the smart assistant device. The action is executed on the digital assistant device based on commands received by the smart assistant device.

Growing community of inventors

Santa Clara, CA, United States of America

Matan Levi