Apple Inc.

Ari Weinstein

Jay Moon

Conrad B Kramer

Stephen Olivier Lemay

John L Blatz

Ayaka Nonaka

Pallavika Ramaswamy

Joseph E Meyer

Joao Pedro De Almeida Forjaz De Lacerda

Yuan Li

Kelan Champagne

Cameron Burgess

Andrew William Malta

Aleksandr Gusev

Matthew J Sundstrom

Giovanni M Agnoli

Cyrus Daniel Irani

Gokcen Cilingir

Paul W Salzman

Ieyuki Kawashima

Joshua C Weinberg

Oluwatomiwa B Alabi

Joshua R Ford

Kellie L Albert

Michael R Sumner

Lynn I Streja

Kyle T Howarth

Roozbeh Mahdavian

Charles B Etzel

Rishab Mehra

Jared K McGann

Michael A Gorbach

Ross A Freeman

Mert Dumenci

Ilkyu Lee

Daniel Sean Hsu

Ian J McDowell

Nicholas Christian Frey

Elizabeth Elsa Perakis

William C MacCartney

Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes the automatic registration of voice-activated shortcuts for a particular application at a vocabulary engine associated with the intelligent automated digital assistant. In some embodiments the automatic registration can be performed during installation or update of an application. Automatic registration can also be initiated after entry of particular types of data into the application or a determination that a particular feature of the application is being commonly used.

Voice-activated shortcut registration

Systems and processes for user configurable task triggers are provided. In one example, at least one user input, including a selection of at least one condition of a plurality of conditions and a selection of at least one task of a plurality of tasks, is received. Stored context data corresponding to an electronic device is received. A determination is whether the stored context data indicates an occurrence of the at least one selected condition. In response to determining that the stored context data indicates an occurrence of the at least one selected condition, the at least one selected task associated with the at least one selected condition is performed.

User configurable task triggers

This relates generally to intelligent automated assistants and, more specifically, to provide intelligent contextual action predictions by the intelligent automated assistants. An example method includes, at an electronic device displaying a content to a user, receiving a user input on a display area of the displayed content, determining a content type associated with a content object of the displayed content in response to receiving the user input, extracting one or more data items from the determined content type, determining one or more action types of each of the one or more data items and one or more action parameters for the each of the action types, determining one or more suggestive actions based on the determined one or more actions types; and presenting, to the user, at least one suggestive action from the one or more suggestive actions.

Contextual action predictions

A system for determining relevant information based on user interactions may include a processor configured to receive application data from one or more applications, the application data including features related to user activity from the one or more applications, the one or more application including applications local to the device that are stored in the memory and applications external to the device. The processor may be further configured to provide, using a machine learning (ML) model, a relevance score for each of one or more user interface (UI) elements based on each of the features. The processor may be further configured to sort one or more UI elements based on a ranking of the relevance scores. The processor may be further configured to provide, as output, the one or more UI elements based at least in part on the ranking.

Determining relevant information based on third party information and user interactions

Systems and processes for operating an intelligent automated assistant are provided. An example process for performing a task includes, at an electronic device having one or more processors and memory, determining whether a shortcut criteria is met and in accordance with a determination that the shortcut criteria is met: displaying a first affordance corresponding to a first task of a shortcut over a user interface, determining whether the first task can be completed without displaying an application interface corresponding to the first task, in accordance with a determination that the first task can be completed without displaying the application interface, performing the first task while displaying the first affordance, and in accordance with a determination that the first task cannot be completed without displaying the application interface, displaying the application interface, and completing the first task using the application interface.

Task shortcut user interface

Electronic device with graphical user interface

Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

User activity shortcut suggestions

Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device including a display and one or more input devices, displaying, on the display, a user interface including a suggestion affordance associated with a task, detecting, via the one or more input devices, a first user input corresponding to a selection of the suggestion affordance, in response to detecting the first user input: in accordance with a determination that the task is a task of a first type, performing the task, and in accordance with a determination that the task is a task of a second type different than the first type, displaying a confirmation interface including a confirmation affordance.

Accelerated task performance

Growing community of inventors

San Francisco, CA, United States of America

Ari Weinstein