Apple Inc.

Benjamin Hylak

Aaron Mackay Burns

Alexis Henri Palangie

Nathan Gitter

Jordan A Cazamias

Arun Rakesh Yoganandan

Benjamin R Blachnitzky

James J Owen

Nicolai Philip Georg

Christopher D Mckenzie

Zoey C Taylor

Adam G Poulos

James M Dessero

Jonathan Ravasz

Jeffrey S Allen

Stephen Olivier Lemay

William A Sorrentino, Iii

Michael J Rockwell

Grant H Mulliken

Ieyuki Kawashima

Benjamin Hunter Boesel

Miquel Estany Rodriguez

Shih-Sang Chiu

Nicholas W Henderson

Jonathan Perron

Mary A Pyc

Pau Sastre Miguel

Steven A Marchette

Katherine W Kolombatovich

William A Sorrentino

In some embodiments, a computer system changes a visual prominence of a respective virtual object in response to detecting a threshold amount of overlap between a first virtual object and a second virtual object. In some embodiments, a computer system changes a visual prominence of a respective virtual object based on a change in spatial location of a first virtual object with respect to a second virtual object. In some embodiments, a computer system applies visual effects to representations of physical objects, virtual environments, and/or physical environments. In some embodiments, a computer system changes a visual prominence of a virtual object relative to a three-dimensional environment based on display of overlapping objects of different types in the three-dimensional environment. In some embodiments, a computer system changes a level of opacity of a first virtual object overlapping a second virtual object in response to movement of the first virtual object.

Methods for managing overlapping windows and applying visual effects

In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.

Methods for displaying and repositioning objects in an environment

A computer system displays, in a three-dimensional environment, a computer-generated object; detects that a user's attention is directed to the object; and in response, displays a virtual shadow for the object with a first appearance, including displaying the shadow with a first value for a first visual property, while maintaining a pose of the object relative to the three-dimensional environment. While continuing to display the object in the three-dimensional environment, the computer system detects that the user's attention has ceased to be directed to the object; and in response, displays the shadow for the object with a second appearance that is different from the first appearance, while maintaining the pose of the object relative to the three-dimensional environment. Displaying the shadow for the object with the second appearance includes displaying the shadow with a second value for the first visual property. The second value is different from the first value.

Devices, methods, and graphical user interfaces for displaying shadow and light effects in three-dimensional environments

A computer system displays a first application user interface at a first location in a three-dimensional environment. While displaying the first application user interface at the first location in the three-dimensional environment, the computer system detects, at a first time, a first input corresponding to a request to close the first application user interface. In response to detecting the first input corresponding to a request to close the first application user interface: the computer system closes the first application user interface, including ceasing to display the first application user interface in the three-dimensional environment; and, in accordance with a determination that respective criteria are met, the computer system displays a home menu user interface at a respective home menu position that is determined based on the first location of the first application user interface in the three-dimensional environment.

Devices, methods, and graphical user interfaces for interacting with window controls in three-dimensional environments

Methods for displaying selectable options in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, one or more selectable options are displayed in a three-dimensional computer-generated environment in accordance with the determination that the one or more criteria have been satisfied, including a criteria that a hand of the user is oriented in a predetermined manner with respect to an electronic device. In some embodiments, a user is able to perform one-handed actuation of a selectable option with a plurality of user inputs and/or gestures that satisfy one or more activation criteria.

Method of displaying selectable options

Computer display system or portion thereof showing an animated graphical user interface having a three dimensional appearance

Devices, methods, and graphical interfaces for content applications displayed in an XR environment provide for an efficient and intuitive user experience. In some embodiments, a content application is displayed in a three-dimensional computer-generated environment. In some embodiments, different viewing modes and user interfaces are available for a content application in a three-dimensional computer-generated environment. In some embodiments, different interactions are available with content items displayed in the XR environment.

Devices, methods and graphical user interfaces for content applications

In one implementation, a method of assisting in the rehearsal of a presentation is performed at a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a difficulty level for a rehearsal of a presentation. The method includes displaying, on the display, one or more slides of the presentation. The method includes displaying, on the display in association with a volumetric environment, one or more virtual objects based on the difficulty level.

Virtual presentation rehearsal

Methods for displaying and organizing user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can be grouped together into a container. In some embodiments, user interfaces can be added to a container, removed from a container, or moved from one location in the container to another location. In some embodiments, a visual indication is displayed before a user interface is added to a container. In some embodiments, a user interface can replace an existing user interface in a container. In some embodiments, when moving a user interface in a computer-generated environment, the transparency of a user interface that is obscured can be modified.

Method of grouping user interfaces in an environment

Methods for displaying user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can have different immersion levels. In some embodiments, a user interface can have a respective immersion level based on its location in the three-dimensional environment or distance from the user. In some embodiments, a user interface can have a respective immersion level based on the state of the user interface. In some embodiments, a user interface can switch from one immersion level to another in response to the user's interaction with the user interface.

Method of displaying user interfaces in an environment and corresponding electronic device and computer readable storage medium

A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.

Multi-finger gesture based on finger manipulation data and extremity tracking data

In some embodiments, an electronic device changes the immersion level of a virtual environment and/or spatial effect in a three-dimensional environment based on the geometry of the physical environment around the device. In some embodiments, an electronic device modifies the virtual environment and/or spatial effect in response to detecting a movement of the device. In some embodiments, an electronic device moves a user interface of an application into and/or out of a virtual environment. In some embodiments, an electronic device selectively changes the display of a simulated environment and/or atmospheric effect in a three-dimensional environment based on movement of an object associated with a viewpoint of a user. In some embodiments, an electronic device provides feedback to a user in response to a user moving a virtual object to and/or into a simulated environment.

Methods for providing an immersive experience in an environment

A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.

Growing community of inventors

San Francisco, CA, United States of America

Benjamin Hylak