Apple Inc.

Jeffrey M Faulkner

Stephen Olivier Lemay

William A Sorrentino, Iii

Israel Pastrana Vicente

Giancarlo Yerkes

Peter D Anton

Jonathan R Dascola

Philipp Rockel

Kristi E S Bauerly

Robert T Tilton

Alan C Dye

Wesley M Holder

Pol Pla I Conesa

Jonathan P Ive

Lisa K Forssell

Nicholas W Henderson

Grant R Paul

Matthew J Sundstrom

Gregg S Suzuki

Ieyuki Kawashima

Dorian D Dargan

David Lui

David John Addey

Kristi Es Bauerly

Gary Ian Butcher

Richard R Dellinger

Pedro Mari

Bradley William Griffin

Allison W Dryer

Richard D Lyons

Jesse Chand

Benjamin Hunter Boesel

Kristi E Bauerly

Jay Moon

Shih-Sang Chiu

David H Huang

Andrew H Goulding

A computer system detects a hand at a first position in a first configuration while displaying a view of a three-dimensional environment. In response, the computer system displays a first visual indication at a first display location in the three-dimensional environment. The computer system detects a movement of the hand while displaying the first visual indication. In response, the computer system displays the first indication at a second display location if the movement maintains the configuration of the hand and moves the hand as a whole to a second position; or the computer system ceases to display the first visual indication and displays a second visual indication if the movement changes the configuration of the hand to a second configuration at the first position.

Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

In some embodiments, an electronic device emphasizes and/or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and/or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and/or physical environment of the electronic device.

Methods for adjusting and/or controlling immersion associated with user interfaces

An electronic device, while displaying a three-dimensional environment, including one or more virtual objects, detects gaze of a user directed toward a first virtual object in the three-dimensional environment. The gaze meets first criteria and the first virtual object is responsive to at least one gesture input. In response to detecting the gaze that meets the first criteria, in accordance with a determination that a hand is in a predefined ready state for providing gesture inputs, the electronic device displays an indication of one or more interaction options available for the first virtual object in the three-dimensional environment; and in accordance with a determination the hand is not in the predefined ready state for providing gesture inputs, the electronic device forgoes displaying the indication of one or more interaction options available for the first virtual object.

A computer system displays a first view of a user interface of a first application with a first size at a first position corresponding to a location of at least a portion of a palm that is currently facing a viewpoint corresponding to a view of a three-dimensional environment provided via a display generation component. While displaying the first view, the computer system detects a first input that corresponds to a request to transfer display of the first application from the palm to a first surface that is within a first proximity of the viewpoint. In response to detecting the first input, the computer system displays a second view of the user interface of the first application with a second size and an orientation that corresponds to the first surface at a second position defined by the first surface.

Devices, methods, and graphical user interfaces for displaying applications in three-dimensional environments

While displaying a three-dimensional scene including at least a first virtual object displayed with a first value corresponding to a first portion and a second value corresponding to a second portion of the first virtual object at a first location and a first physical surface at a second location, a computer system generates a first visual effect at the second location of the three-dimensional scene, including modifying a visual appearance of a first portion of the first physical surface in the three-dimensional scene in accordance with the first value for the first display property that corresponds to the first portion of the first virtual object; and modifying a visual appearance of a second portion of the first physical surface in the three-dimensional scene in accordance with the second value for the first display property that corresponds to the second portion of the first virtual object.

request to present first computer-generated content including first visual content and first audio content corresponding to the first visual content, displays the first visual content within the first portion of the three-dimensional environment and outputting the first audio content using a first audio output mode if the request is to present the first computer-generated content with a first level of immersion, and displays the first visual content within the second portion of the three-dimensional environment and outputting the first audio content using a second audio output mode if the request is to present the first computer-generated content with a second level of immersion greater than the first level of immersion, wherein using the second audio output mode instead of the first audio output mode changes a level of immersion of the first audio content.

A computer system with a display and a touch-sensitive surface receives a request to display a first user interface that includes a first item, and, in response to the request, displays the first user interface with a representation of the first item. Depending on whether the first item corresponds to a respective virtual three-dimensional object, the first item is displayed either with a visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object or without the visual indication. In response to a request to display a second user interface, the second user interface is displayed with a representation of the second item. Depending on whether the second item corresponds to a respective virtual three-dimensional object, the representation of the second item is displayed with or without the visual indication.

Devices, methods, and graphical user interfaces for system-wide behavior for 3D models

A computer system displays a first view of a three-dimensional environment. While displaying the first view, the computer system detects a first movement of a first hand that meets first criteria, and in response, displays a first virtual object that includes a first plurality of selectable controls at a first position in the first view, wherein the first position corresponds to a location of the first hand after the first movement in a physical environment. While displaying the first virtual object at the first position, the computer system detects a second movement of the first hand, and in response, displays movement of a representation of the first hand in the first view in accordance with the second movement of the first hand relative to a position of the first virtual object in the first view.

A computer system detects a wrist. In accordance with a determination that first criteria that require an inner side of the wrist facing toward a viewpoint are met, the computer system displays a first user interface object including a plurality of representations of different applications at a first position corresponding to a first location on the wrist. While displaying the first user interface object, the computer system detects that the wrist's position or orientation has changed to satisfying second criteria that requires an outer side of the wrist facing toward the viewpoint. In response, the computer system switches from displaying the first user interface object at the first position to displaying a second user interface object including a plurality of controls for controlling functions at a second position corresponding to a location on a back of a hand attached to the wrist.

A computer system displays a view of at least a portion of a simulated three-dimensional space, and a view of a user interface object located within the simulated three-dimensional space. The user interface object is a representation of a computing device that has a non-immersive display environment that provides access to a plurality of different applications. The user interface object includes a first user interface that corresponds to the non-immersive display environment of the computing device and is responsive to touch inputs from a user on the input device, and a pose of the user interface object in the simulated three-dimensional space corresponds to a pose of the input device in a physical space surrounding the input device. In response to a touch input that corresponds to a respective location in the first user interface, an appearance of the first user interface is updated.

Systems, methods, and graphical user interfaces for interacting with virtual reality environments

While displaying a view of a virtual environment that does not include a visual representation of a first portion of a physical object present in a physical environment in which a user is located, a computer system detects movement of the user in the physical environment. In accordance with a determination that the user is within a threshold distance of the first portion of the physical object which has an extent that is potentially visible to the user based on a field of view of the user for the virtual environment, the computer system changes an appearance of the view of the virtual environment in a manner that indicates a physical characteristic of the first portion of the physical object, without indicating a second portion of the physical object that is potentially visible to the user based on the field of view of the user.

In some embodiments, an electronic device navigates between user interfaces based at least on detecting a gaze of the user. In some embodiments, an electronic device enhances interactions with control elements of user interfaces. In some embodiments, an electronic device scrolls representations of categories and subcategories in a coordinated manner. In some embodiments, an electronic device navigates back from user interfaces having different levels of immersion in different ways.

Methods for navigating user interfaces

A computer system, while displaying a view of a computer-generated environment, detects movement of a physical object, and in response: in accordance with a determination that a user is within a threshold distance of a first portion of the physical object and that the physical object meets preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion, without changing an appearance of virtual content displayed at a position corresponding to the physical object's second portion; and in accordance with a determination that the user is within the threshold distance and that the physical object does not meet the preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion.

A computing system, while displaying a first view of a first computer-generated three-dimensional environment including a representation of a respective portion of a physical environment, and a first representation of one or more projections of light in a first portion of the first computer-generated three-dimensional environment, detects, from a first user, a query directed to a virtual assistant. In response, the computer system displays animated changes of the first representation of the one or more projections of light in the first portion of the first computer-generated three-dimensional environment, including displaying a second representation of the one or more projections of light that is focused on a first sub-portion of the first portion, and then displays content responding to the query at a position corresponding to the first sub-portion of the first portion.

Growing community of inventors

San Francisco, CA, United States of America

Jeffrey M Faulkner