Apple Inc.

Shih-Sang Chiu

Benjamin Hunter Boesel

Stephen Olivier Lemay

William A Sorrentino, Iii

Kristi E Bauerly

Christopher D Mckenzie

David H Huang

Jonathan Perron

Giancarlo Yerkes

Jason D Rickwald

Israel Pastrana Vicente

Alexis Henri Palangie

Dorian D Dargan

Jordan A Cazamias

Jonathan Ravasz

Rupert Burton

Alan C Dye

Jonathan R Dascola

Pol Pla I Conesa

Jesse Chand

Connor A Smith

Zoey C Taylor

Jonathan P Ive

Martha Evans Hankey

Julian Jaede

Bas Ording

Tong Chen

Ieyuki Kawashima

Joseph P Cerra

Wesley M Holder

Gary Ian Butcher

Peter D Anton

Alexandre Da Veiga

Aaron Mackay Burns

Nicolas V Scapel

Jeffrey M Faulkner

Tommy Rochette

Nathan Gitter

Kaely Coon

Evgenii Krivoruchko

Willem Mattelaer

Miao Ren

Spencer H Ray

Timothy R Pease

Andrew R Bacon

Rajat Bhardwaj

Tyson Erze

In one implementation, a method of activating a user interface element is performed at a device including an input device, an eye tracker, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input corresponding to an input location. The method includes determining, using the eye tracker, a gaze location. The method includes, in response to determining that the input location is at least a threshold distance from the gaze location, activating a first user interface element at the gaze location and, in response to determining that it is not, activating a second user interface element at the input location.

Methods and systems for changing a display based on user input and gaze

The present disclosure generally relates to managing live communication sessions. A computer system optionally displays an option to invite the respective user to join the ongoing communication session. A computer system optionally one or more options to modify an appearance of an avatar representing the user of the computer system. A computer system optionally transitions a communication session from a spatial communication session to a non-spatial communication session. A computer system optionally displays information about a participant in a communication session.

User interfaces for managing live communication sessions

The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for real-time communications.

Devices, methods, and graphical user interfaces for real-time communication

In some embodiments, an electronic device emphasizes and/or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and/or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and/or physical environment of the electronic device.

Methods for adjusting and/or controlling immersion associated with user interfaces

The present disclosure relates to techniques for improving a user experience for modifying display of an avatar in XR environments. In some embodiments, the techniques include modifying a portion of an avatar based on one or more heuristics. In some embodiments, the techniques include modifying a portion of an avatar after tracking is lost.

Devices, methods, and graphical user interfaces for modifying avatars in three-dimensional environments

In some embodiments, an electronic device updates the spatial arrangement of one or more virtual objects in a three-dimensional environment. In some embodiments, an electronic device updates the positions of multiple virtual objects together. In some embodiments, an electronic device displays objects in a three-dimensional environment based on an estimated location of a floor in the three-dimensional environment. In some embodiments, an electronic device moves (e.g., repositions) objects in a three-dimensional environment.

Devices, methods, and graphical user interfaces for presenting virtual objects in virtual environments

The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.

Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments

Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.

Spatial video capture and replay

In some embodiments, an electronic device enhances interactions with virtual objects in a three-dimensional environment. In some embodiments, an electronic device enhances interactions with selectable user interface elements. In some embodiments, an electronic device enhances interactions with slider user interface elements. In some embodiments, an electronic device moves virtual objects in a three-dimensional environment and facilitates accessing actions associated with virtual objects.

Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments

In some embodiments, an electronic device facilitates cursor interactions in different regions in a three-dimensional environment. In some embodiments, an electronic device facilitates cursor interactions in content. In some embodiments, an electronic device facilitates cursor movement. In some embodiments, an electronic device facilitates interaction with multiple input devices. In some embodiments, a computer system facilitates cursor movement based on movement of a hand of a user of the computer system and a location of a gaze of the user in the three-dimensional environment. In some embodiments, a computer system facilitates cursor selection and scrolling of content in the three-dimensional environment.

Methods for cursor-based interactions with an electronic device

Some examples of the disclosure are directed to systems and methods for presenting content in a three-dimensional environment by one or more electronic devices in a multi-user communication session. In some examples, a first electronic device and a second electronic device are communicatively linked in a multi-user communication session, wherein the first electronic device and the second electronic device are configured to display a three-dimensional environment, respectively. In some examples, the first electronic device and the second electronic device are grouped in a first spatial group within the multi-user communication session. In some examples, if the second electronic device determines that the first electronic device changes states (and/or vice versa), the user of the first electronic device and the user of the second electronic device are no longer grouped into the same spatial group within the multi-user communication session.

System and method of spatial groups in multi-user communication sessions

In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on a viewpoint of a user in the three-dimensional environment. In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on viewpoints of a plurality of users in the three-dimensional environment. In some embodiments, the electronic device modifies an appearance of a real object that is between a virtual object and the viewpoint of a user in a three-dimensional environment. In some embodiments, the electronic device automatically selects a location for a user in a three-dimensional environment that includes one or more virtual objects and/or other users.

Methods for manipulating objects in an environment

Growing community of inventors

San Francisco, CA, United States of America

Shih-Sang Chiu