Apple Inc.

Karan M Daryanani

Myra C Lukens

Stephen Olivier Lemay

Pedro Mari

Jay Moon

David A Carson

Sreeneel K Maddika

Brad Kenneth Herman

Chaitanya Mannemala

Saurabh Adya

Keith P Avery

Lynn I Streja

Shiraz Akmal

Alkeshkumar M Patel

Scott M Andrus

Abhishek Rawat

Viraaj M Marathe

St John W Colon

Isar Arason

Zihan Xu

Ryan J Quintana

An example process includes: while displaying a portion of an extended reality (XR) environment representing a current field of view of a user: detecting a user gaze at a first object displayed in the XR environment, where the first object is persistent in the current field of view of the XR environment; in response to detecting the user gaze at the first object, expanding the first object into a list of objects including a second object representing a digital assistant; detecting a user gaze at the second object; in accordance with detecting the user gaze at the second object, displaying a first animation of the second object indicating that a digital assistant session is initiated; receiving a first audio input from the user; and displaying a second animation of the second object indicating that the digital assistant is actively listening to the user.

Extended reality based digital assistant interactions

Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving an utterance including a user request and determining whether at least a portion of the user request is ambiguous. If at least the portion of the user request is ambiguous then a set of context data based on the ambiguous portion of the user request is determined, metadata is extracted from the context data and a response to the user request is determined based on the extracted metadata.

Multimodal assistant understanding using on-screen and device context

This relates generally to intelligent automated assistants and, more specifically, to provide intelligent visualization of snippet information. An example method includes receiving a user request and in response to receiving the user request, determining a response for the user request, determining a format for a visual representation of the response, identifying one or more virtual objects based on the format for the visual representation of the response, determining a size for each of the one or more virtual objects based on context information associated with the response, and displaying the one or more virtual objects within a background environment based on the size for each of the one or more virtual objects and geometry of the background environment.

Digital assistant for providing visualization of snippet information

Growing community of inventors

San Francisco, CA, United States of America

Karan M Daryanani