Apple Inc.

Willem Mattelaer

Joseph P Cerra

Connor A Smith

Jessica J Peck

Niranjan Manjunath

Lily Shuting Zhang

Kevin Lee

Miao Ren

Shih-Sang Chiu

Hayden J Lee

Some examples of the disclosure are directed to systems and methods for presenting content in a three-dimensional environment by one or more electronic devices in a multi-user communication session. In some examples, a first electronic device and a second electronic device are communicatively linked in a multi-user communication session, wherein the first electronic device and the second electronic device are configured to display a three-dimensional environment, respectively. In some examples, the first electronic device and the second electronic device are grouped in a first spatial group within the multi-user communication session. In some examples, if the second electronic device determines that the first electronic device changes states (and/or vice versa), the user of the first electronic device and the user of the second electronic device are no longer grouped into the same spatial group within the multi-user communication session.

System and method of spatial groups in multi-user communication sessions

Some examples of the disclosure are directed to systems and methods for managing locations of users in a spatial group within a communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device and a second electronic device are in communication within a communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device. In some examples, in response to detecting an input corresponding to a request to display shared content in the three-dimensional environment, if the shared content is a first type of content, the first electronic positions the avatar a first distance away from the viewpoint, and if the shared content is a second type of content, the first electronic device positions the avatar a second distance away from the viewpoint.

Systems and methods of managing spatial groups in multi-user communication sessions

Some examples of the disclosure are directed to systems and methods for facilitating display of content and avatars in a multi-communication session including a first electronic device and a second electronic device. In some examples, the first electronic device presents a computer-generated environment including an avatar corresponding to a user of the second electronic device and a first object, wherein the computer-generated environment is presented based on a first set of display parameters satisfying a first set of criteria, including a spatial parameter for the user of the second electronic device, a spatial parameter for the first object, and a display mode parameter for the first object. In response to detecting a change in one or more of the first set of display parameters, the first electronic device updates presentation of the computer-generated environment in accordance with the one or more changes of the first set of display parameters.

System and method of managing spatial states and display modes in multi-user communication sessions

This relates to an intelligent automated assistant in a video communication environment. An example includes, during a video communication session between at least two devices, receiving a voice input at one device, generating and transmitting to a server a textual representation of the voice input, receiving from the server a shared transcription including both the textual representation of the voice input and one or more additional textual representations generated by another device, and determining and presenting one or more candidate tasks based on the shared transcription.

Digital assistant interaction in a video communication session environment

This relates to an intelligent automated assistant in a video communication session environment. An example method includes, during a video communication session between at least two user devices, and at a first user device: receiving a first user voice input; in accordance with a determination that the first user voice input represents a communal digital assistant request, transmitting a request to provide context information associated with the first user voice input to the first user device; receiving context information associated with the first user voice input; obtaining a first digital assistant response based at least on a portion of the context information received from the second user device and at least a portion of context information associated with the first user voice input that is stored on the first user device; providing the first digital assistant response to the second user device; and outputting the first digital assistant response.

Embodiments provide a context-aware digital assistant at multiple user devices participating in a video communication session by using context information from a first user device to determine a digital assistant response at a second user device. In this manner, users participating in the video communication session may interact with the digital assistant during the video communication session as if the digital assistant is another participant in the video communication session. Embodiments further describe automatically determining candidate digital assistant tasks based on a shared transcription of user voice inputs received at user devices participating in a video communication session. In this manner, a digital assistant of a user device participating in a video communication session may proactively determine one or more tasks that a user of the user device may want the digital assistant to perform based on conversations held during the video communication session.

Growing community of inventors

San Jose, CA, United States of America

Willem Mattelaer