Apple Inc.

Connor A Smith

Bruno M Sommer

Kevin Lee

Joseph P Cerra

Tucker Bull Morgan

Miao Ren

Luis R Deliz Centeno

Christopher D Mckenzie

Nicholas W Henderson

Willem Mattelaer

Shih Sang Chiu

Jonathan R Dascola

Aaron Mackay Burns

Alexis Henri Palangie

Nathan Gitter

Shih-Sang Chiu

Shaun D Budhram

Wesley M Holder

Clément Pierre Nicolas Boissière

Allessandra E McGinnis

Timofey Grechkin

Jack R Dashwood

Stephen Olivier Lemay

Giancarlo Yerkes

William A Sorrentino, Iii

Jason D Rickwald

Israel Pastrana Vicente

Jesse Chand

Tommy Rochette

Kaely Coon

Rupert Burton

Hayden J Lee

Rajat Bhardwaj

Joanne Lee

Facilitating collaboration in a multi-user communication session may include, at a first device, providing a toolkit of system-level tools for interacting within the session with a second device. A first user interaction with a first tool is detected which results in a virtual modification to an environment of the first device. In response to the first user interaction, the virtual modification is provided for presentation in a second environment representation of the session corresponding to the second device.

Toolbox and context for user interactions

In one implementation, a method of resolving focal conflict in a computer-generated reality (CGR) environment is performed by a device including a processor, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, an image of a scene including a real object in a particular direction at a first distance from the device. The method includes displaying, on the display, a CGR environment including a virtual object in the particular direction at a second distance from the device. In accordance with a determination that the second distance is less than the first distance, the CGR environment includes the virtual object overlaid on the scene. In accordance with a determination that the second distance is greater than the first distance, the CGR environment includes the virtual object with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

Method and device for resolving focal conflict

Various implementations provide advantages of real-world environments, such as real-world office spaces in which workers have desks or office spaces located within the same floor, hallway, common area, etc., in remote circumstances. Communications sessions between the devices of remote users share content amongst the users. This may involve sharing audio content so that the users can talk to one another or hear the real or virtual sounds from one another's areas (e.g., offices). This may involve sharing visual content of the users, their avatars, or real or virtual objects so that the users can see one another and objects within one another's areas. Some implementations determine to initiate or continue sharing content based on one more criterion. A communication session between users or the sharing of content within a communication session may be initiated or continued based on a spatial relationship amongst anchors of users within a common coordinate system.

Multi-user content sharing using anchors in 3D environments

Some examples of the disclosure are directed to methods for application-based spatial refinement in a multi-user communication session including a first electronic device and a second electronic device. While the first electronic device is presenting a three-dimensional environment, the first electronic device receives an input corresponding to a request to move a shared object in the three-dimensional environment. In accordance with a determination that the shared object is an object of a first type, the first electronic device moves the shared object and an avatar of a user in the three-dimensional environment in accordance with the input. In accordance with a determination that the shared object is an object of a second type, different from the first type, and the input is a first type of input, the first electronic device moves the shared object in the three-dimensional environment in accordance with the input, without moving the avatar.

System and method of application-based three-dimensional refinement in multi-user communication sessions

Various implementations present a viewing session on an electronic device based on a view of an avatar (e.g., a representation of a content creator) that is based recorded positional data and the identification of an anchor in the viewing environment during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may obtain recorded data (e.g., recorded user data) including recorded positional data of a user moving relative to a coordinate space of an anchor (a room or object) during a recording in a physical environment. Then the process may identify the anchor (e.g., the actual statue or the replica) in a viewing environment based on the recorded data. Then the process may present a view of a moving avatar corresponding to the user based on the recorded positional data and the identification of the anchor in the viewing environment.

User representation based on an anchored recording

In some embodiments, an electronic device selectively de-emphasizes a three-dimensional environment in which content is presented. In some embodiments, an electronic device modifies the boundaries of content in a user interface. In some embodiments, an electronic device shares content with users in a three-dimensional environment.

Methods for presenting and sharing content in an environment

Avatars may be displayed in a multiuser communication session using various spatial modes. One technique for presenting avatars includes presenting avatars such that an attention direction of the avatar is retargeted to match the intent of the remote user corresponding to the avatar. Another technique for presenting avatars includes a pinned mode in which a spatial relationship between one or more avatars remains displayed in a consistent spatial relationship to a local user regardless of movements of the local user. Another technique for presenting avatars includes providing user-selectable presentation modes between a room scale mode and a stationary mode for presenting a representation of a multiuser communication session.

Avatar spatial modes

Various implementations present a playback session on an electronic device based on a viewer's position relative to a position of an object (e.g., a representation of a content creator) during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may acquire content at a first device in a physical environment including a person, the content based on sensor data of the physical environment captured via one or more sensors, determine recorded positional data including positions of the first device associated with a path of the person as the first device is moved within the physical environment during the acquiring of the content, and provide the content for playback at a second device based on the acquired sensor data and the positional data.

Content playback based on a path

The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for real-time communications.

Devices, methods, and graphical user interfaces for real-time communication

Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, while the physical muting mode is active, a system obtains a first set of context data for one or more physical elements in a physical setting and causes display of a virtual object representing the one or more physical elements in a first position using at least a portion of the first set of context data. After the virtual object representing the one or more physical elements is displayed in the first position, the physical muting mode is deactivated. In response to detecting the deactivation of the physical muting mode, the system causes display of a transitional motion of the virtual object representing the one or more physical elements from the first position to a second position.

Muting mode for a virtual object representing one or more physical elements

Some examples of the disclosure are directed to selective display of avatars corresponding to users of electronic devices in a multi-user communication session. In some examples, when immersive content is shared in the communication session, the avatars remain displayed when presenting the content in the three-dimensional environment. In some examples, when perspective-limited immersive content is shared in the communication session, the avatars cease being displayed when presenting the content in the three-dimensional environment. In some examples, when content presented in a full-screen mode is shared in the communication session, the avatars remain displayed when presenting the content in the full-screen mode in the three-dimensional environment. In some examples, when object-bounded content is shared in the communication session, the avatars remain displayed when presenting the object-bounded content in the three-dimensional environment.

System and method of three-dimensional immersive applications in multi-user communication sessions

Some examples of the disclosure are directed to systems and methods for presenting content in a three-dimensional environment by one or more electronic devices in a multi-user communication session. In some examples, a first electronic device and a second electronic device are communicatively linked in a multi-user communication session, wherein the first electronic device and the second electronic device are configured to display a three-dimensional environment, respectively. In some examples, the first electronic device and the second electronic device are grouped in a first spatial group within the multi-user communication session. In some examples, if the second electronic device determines that the first electronic device changes states (and/or vice versa), the user of the first electronic device and the user of the second electronic device are no longer grouped into the same spatial group within the multi-user communication session.

System and method of spatial groups in multi-user communication sessions

Some examples of the disclosure are directed to systems and methods for managing locations of users in a spatial group within a communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device and a second electronic device are in communication within a communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device. In some examples, in response to detecting an input corresponding to a request to display shared content in the three-dimensional environment, if the shared content is a first type of content, the first electronic positions the avatar a first distance away from the viewpoint, and if the shared content is a second type of content, the first electronic device positions the avatar a second distance away from the viewpoint.

Growing community of inventors

San Mateo, CA, United States of America

Connor A Smith