Apple Inc.

Christopher D Mckenzie

Stephen Olivier Lemay

Zoey C Taylor

Israel Pastrana Vicente

Shih-Sang Chiu

Jonathan Ravasz

Alexis Henri Palangie

Benjamin Hunter Boesel

Dorian D Dargan

Nathan Gitter

Jonathan R Dascola

Connor A Smith

Benjamin Hylak

Peter D Anton

Pol Pla I Conesa

Jonathan Perron

William A Sorrentino, Iii

Aaron Mackay Burns

Tong Chen

Matan Stauber

Jesse Chand

Peter L Hajas

Wesley M Holder

Evgenii Krivoruchko

Miquel Estany Rodriguez

James J Owen

Fredric R Vinna

Julian K Shutzberg

Kristi E S Bauerly

Nicholas W Henderson

Brian K Shiraishi

David J Meyer

Daniel J Brewer

James M Dessero

David M Teitelbaum

William A Sorrentino

Jeffrey S Allen

Angel Suet Yan Cheung

Gregory T Scott

So Tanaka

Bharat C Dandu

Shi-Shang Chiu

Shi-Sang Chiu

William A Iii Sorrentino

In some embodiments, a computer system enables a user to invoke display of transport controls (and/or other controls associated with controlling playback of content) using gaze inputs, gesture inputs, or a combination of these. In some embodiments, in response to detecting a first user input, the computer system displays a first set of controls in a reduced-prominence state (e.g., in a manner that is not unduly distracting to the user), and in response to detecting a second user input, the computer system displays a second set of controls in an increased-prominence state (e.g., in a more visually prominent state). The second set of controls optionally includes more controls than the first set of controls.

Devices, methods, and graphical user interfaces for displaying sets of controls in response to gaze and/or gesture inputs

In some embodiments, a computer system changes a visual prominence of a respective virtual object in response to detecting a threshold amount of overlap between a first virtual object and a second virtual object. In some embodiments, a computer system changes a visual prominence of a respective virtual object based on a change in spatial location of a first virtual object with respect to a second virtual object. In some embodiments, a computer system applies visual effects to representations of physical objects, virtual environments, and/or physical environments. In some embodiments, a computer system changes a visual prominence of a virtual object relative to a three-dimensional environment based on display of overlapping objects of different types in the three-dimensional environment. In some embodiments, a computer system changes a level of opacity of a first virtual object overlapping a second virtual object in response to movement of the first virtual object.

Methods for managing overlapping windows and applying visual effects

In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.

Methods for displaying and repositioning objects in an environment

Some examples of the disclosure are directed to methods for application-based spatial refinement in a multi-user communication session including a first electronic device and a second electronic device. While the first electronic device is presenting a three-dimensional environment, the first electronic device receives an input corresponding to a request to move a shared object in the three-dimensional environment. In accordance with a determination that the shared object is an object of a first type, the first electronic device moves the shared object and an avatar of a user in the three-dimensional environment in accordance with the input. In accordance with a determination that the shared object is an object of a second type, different from the first type, and the input is a first type of input, the first electronic device moves the shared object in the three-dimensional environment in accordance with the input, without moving the avatar.

System and method of application-based three-dimensional refinement in multi-user communication sessions

Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.

Input recognition based on distinguishing direct and indirect user interactions

In some embodiments, an electronic device selectively de-emphasizes a three-dimensional environment in which content is presented. In some embodiments, an electronic device modifies the boundaries of content in a user interface. In some embodiments, an electronic device shares content with users in a three-dimensional environment.

Methods for presenting and sharing content in an environment

Computer display system or portion thereof showing an animated graphical user interface having a three dimensional appearance

In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on a viewpoint of a user in the three-dimensional environment. In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on viewpoints of a plurality of users in the three-dimensional environment. In some embodiments, the electronic device modifies an appearance of a real object that is between a virtual object and the viewpoint of a user in a three-dimensional environment. In some embodiments, the electronic device automatically selects a location for a user in a three-dimensional environment that includes one or more virtual objects and/or other users.

Methods for manipulating objects in an environment

In some embodiments, an electronic device updates the spatial arrangement of one or more virtual objects in a three-dimensional environment. In some embodiments, an electronic device updates the positions of multiple virtual objects together. In some embodiments, an electronic device displays objects in a three-dimensional environment based on an estimated location of a floor in the three-dimensional environment. In some embodiments, an electronic device moves (e.g., repositions) objects in a three-dimensional environment.

Devices, methods, and graphical user interfaces for presenting virtual objects in virtual environments

In some embodiments, an electronic device enhances interactions with virtual objects in a three-dimensional environment. In some embodiments, an electronic device enhances interactions with selectable user interface elements. In some embodiments, an electronic device enhances interactions with slider user interface elements. In some embodiments, an electronic device moves virtual objects in a three-dimensional environment and facilitates accessing actions associated with virtual objects.

Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments

In some embodiments, an electronic device facilitates cursor interactions in different regions in a three-dimensional environment. In some embodiments, an electronic device facilitates cursor interactions in content. In some embodiments, an electronic device facilitates cursor movement. In some embodiments, an electronic device facilitates interaction with multiple input devices. In some embodiments, a computer system facilitates cursor movement based on movement of a hand of a user of the computer system and a location of a gaze of the user in the three-dimensional environment. In some embodiments, a computer system facilitates cursor selection and scrolling of content in the three-dimensional environment.

Methods for cursor-based interactions with an electronic device

A computer system detects whether the user satisfies attention criteria with respect to a first user interface object displayed in a first view of a three-dimensional environment. In response to detecting that the user does not satisfy the attention criteria with respect to the first user interface object, the computer system displays the first user interface object with a modified appearance. The computer system detects a first movement of a viewpoint of the user relative to a physical environment and detects that the user satisfies the attention criteria with respect to the first user interface object. In response, the computer system displays the first user interface object in a second view of the three-dimensional environment, including displaying the first user interface object with an appearance that emphasizes the first user interface object more than when the first user interface object was displayed with the modified appearance.

Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

A computer system displays a first and second user interface object in a three-dimensional environment. The first and second user interface objects have a first and second spatial relationship to a first and second anchor position corresponding to a location of a user's hand in a physical environment, respectively. While displaying the first and second user interface objects in the three-dimensional environment, the computer system detects movement of the user's hand in the physical environment, corresponding to a translational movement and a rotational movement of the user's hand relative to a viewpoint, and in response, translates the first and second user interface objects relative to the viewpoint in accordance with the translational movement of the user's hand, and rotates the first user interface object relative to the viewpoint in accordance with the rotational movement of the user's hand without rotating the second user interface object.

Growing community of inventors

Burlingame, CA, United States of America

Christopher D Mckenzie