Apple Inc.

Luis R Deliz Centeno

Avi Bar-Zeev

Rahul Nair

Joseph P Cerra

Devin William Chalmers

Alexis Henri Palangie

Kevin Lee

Ryan S Burgoyne

Timothy Robert Oriol

Connor A Smith

Allessandra E McGinnis

Gregory Lutter

Jack R Dashwood

Paul Xiaopeng Wang

Alex Joseph Lehmann

Stephen E Dey

Chang Zhang

Bruno M Sommer

Madeleine S Cordier

Benjamin R Blachnitzky

Tianjia Sun

Nicolai Philip Georg

Jian H Li

Yuhao Pan

Tucker Bull Morgan

Hongcheng Sun

Jonathan C Atler

Avi Bar-zeev

Lilli Ing-Marie Jonsson

Kevin Z Lo

Nahckjoon Kim

Jessica Trinh

Robert T Held

Leanid Vouk

Alhad A Palkar

Minhazul Islam

Joon-Sup Han

Paul N DuMontelle

Sang E Lee

In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Devices, methods, for interacting with graphical user interfaces

Various implementations present a viewing session on an electronic device based on a view of an avatar (e.g., a representation of a content creator) that is based recorded positional data and the identification of an anchor in the viewing environment during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may obtain recorded data (e.g., recorded user data) including recorded positional data of a user moving relative to a coordinate space of an anchor (a room or object) during a recording in a physical environment. Then the process may identify the anchor (e.g., the actual statue or the replica) in a viewing environment based on the recorded data. Then the process may present a view of a moving avatar corresponding to the user based on the recorded positional data and the identification of the anchor in the viewing environment.

User representation based on an anchored recording

Implementing a rotation-based graphical user interface may include detecting a physical object in an image; presenting the rotation-based graphical user interface in accordance with the detected physical object, wherein input to the graphical user interface corresponds to movement of the physical object; detecting a movement of the physical object; determining a characteristic of the movement of the physical object; initiating a scrolling motion through the graphical user interface in accordance with the movement characteristic satisfying a first criterion; detecting selection of a portion of the graphical user interface; and performing an action associated with the selected portion.

Rotation-based user interface

Various implementations disclosed herein include devices, systems, and methods for switching presentation of content between devices. In some implementations, a method includes obtaining information regarding an eye condition. In some implementations, the method includes determining whether a first display of a first electronic device that is presenting content satisfies a presentation criterion based on the eye condition and a characteristic of the content. In some implementations, the method includes, in accordance with a determination that the first display does not satisfy the presentation criterion, triggering a second electronic device with a second display that satisfies the presentation criterion to present the content.

Switching presentation of content between devices

A state of a multi-user communication session is saved in response to detection of an application state saving event, or a session state saving event. During runtime, application state saving events may be detected for each application executing during a session. Application state parameters are saved in response to each application state saving event, from which the application may be launched to the saved state. In response to a state saving event, the most recent application state information for each application executing in the session are collected and stored such that the multi-user communication session may be launched to the saved state, including each application executing in the session.

Automatic determination of application state in a multi-user environment

In an exemplary process for interacting with user interface objects using an eye gaze, a placement point for a selected object is designated at a first position based on a gaze position. In response to a user input, the placement point is moved to a second position that is not based on the gaze position, and the object is placed at the second position.

Gaze-based user interactions

Various implementations present a playback session on an electronic device based on a viewer's position relative to a position of an object (e.g., a representation of a content creator) during the recording of content (e.g., a memory). For example, at a first device having a processor, a process may acquire content at a first device in a physical environment including a person, the content based on sensor data of the physical environment captured via one or more sensors, determine recorded positional data including positions of the first device associated with a path of the person as the first device is moved within the physical environment during the acquiring of the content, and provide the content for playback at a second device based on the acquired sensor data and the positional data.

Content playback based on a path

Various implementations disclosed herein include devices, systems, and methods for modifying display of virtual content. In some implementations, the method is performed by an electronic device including a non-transitory memory, one or more processors, a display, an eye tracker and a movement sensor. In some implementations, the method includes displaying, via the display, virtual content. In some implementations, the method includes detecting, via the eye tracker, a movement of a gaze in a first direction. In some implementations, the method includes detecting, via the movement sensor, a movement of a head in a second direction while detecting the movement of the gaze in the first direction. In some implementations, the method includes, in accordance with a determination that the movement of the gaze in the first direction and the movement of the head in the second direction are corresponding opposing movements, modifying a display characteristic of the virtual content.

Modifying display of content based on gaze and head movement

Various implementations disclosed herein include devices, systems, and methods for presenting communication data. In various implementations, a first device associated with a first person includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining communication data associated with a second device corresponding to a second person. In some implementations, the method includes determining whether the first device and the second device are in a shared environment. In some implementations, the method includes in response to determining that the first device and the second device are not in a shared environment, displaying a representation of the second person based on the communication data associated with the second device.

Presenting communication data based on environment

In an exemplary process, a virtual object is displayed in an enhanced reality setting. A request to transfer the virtual object is received, wherein a determination is made whether a set of one or more virtual object transfer criteria is satisfied. Movement of the virtual object away from an avatar is displayed in accordance with a determination that the set of one or more virtual object transfer criteria is satisfied. Displaying movement includes determining whether a size of the virtual object satisfies a set of one or more size criteria. In accordance with a determination that the size of the virtual object satisfies the set of one or more size criteria, a reduction in the size of the virtual object is displayed. In accordance with a determination that the size of the virtual object does not satisfy the set of one or more size criteria, displaying of a reduction in the size of the virtual object is foregone.

Transferring a virtual object

In one implementation, a method of transferring the display of video content from a first location to a second location is performed at a first device including an image sensor, a first display, one or more processors, and non-transitory memory. The method includes detecting a second device in a field-of-view of the image sensor displaying video content at a first location in the physical environment on a second display. The method includes detecting a transfer trigger to display the video content at a second location in the physical environment. The method includes, in response to detecting the transfer trigger, displaying, on the first display, a transfer animation of the video content being moved from the first location to the second location.

Transfer of the display of content between devices with animation

Facilitating collaboration in a multiuser communication session includes detecting initiation of an interaction between a user of a first device and a virtual object in a multiuser communication session, where the first device and a second device are active in the multiuser communication session, and where state information is synchronized among the first device and second device in the multiuser communication session. In accordance with detecting the initiation of an interaction between the user and the virtual object, synchronization of state information is suspended by the first device, where the state information is related to the interaction between the user and the virtual object. A representation of the multiuser communication session at the first device and a representation of the multiuser communication session at the second device are inconsistent in accordance with the suspended synchronization of the state information.

Synchronization in a multiuser experience

The disclosure pertains to techniques for collaborating in a multiuser communication session, including, at a first device, receiving a request to launch a first application in a multiuser communication session with a second device; presenting an environment of the first application in the multiuser communication session; receiving, by one or more processes of the multiuser communication session, data from the first user, the data including input data and first communications data; providing, by the one or more processes, the input data to the first application; providing, by the one or more processes, the first communications data to the second device; receiving, by the one or more processes, second communications data from the second device; and presenting, by the one or more processes, the second communications data in the environment of the first application, wherein the first application is restricted from accessing the first communications data and second communications data.

Conversation privacy for third party applications

The disclosure pertains to techniques for collaborating in a multi user communications environment. One such technique includes receiving, at a first communication device, data associated with a multi user communication session between a first user of the first communication device and a second user of a second communication device, presenting, at the first communication device, a non-extended reality graphical user interface (GUI), the non-extended reality GUI including a non-extended reality representation of a virtual object included in the multi user communication session and a representation of the second user based on the data associated with the multi user communication session, and updating, at the first communication device, the non-extended reality GUI to illustrate an interaction between the representation of the second user and the virtual object in response to the data indicating the interaction.

Asymmetric presentation of an environment

Various implementations present a representation of a communication session involving multiple devices in different presentation modes based on spatial transforms between a physical environment and the representation of the communication session. For example, a representation of a communication session is presented based on the position of a first device within a first physical environment and a second spatial transform between the first physical environment and the representation of the communication session, in accordance with a determination to switch the first presentation mode to a second presentation mode. Then the representation of the communication session is presented based on the position of the first device within the first physical environment and the first spatial transform in accordance with a determination to switch the second presentation mode back to the first presentation mode.

Growing community of inventors

Fremont, CA, United States of America

Luis R Deliz Centeno