Apple Inc.

David Lui

Xiao Jin Yu

Giancarlo Yerkes

Tyler L Casella

Hon-ming Chen

Grant R Paul

Shuai Song

Stephen Olivier Lemay

Jonathan R Dascola

Norman Nuo Wang

David John Addey

Nicolas V Scapel

Lisa K Forssell

Jeffrey M Faulkner

Kyle Ellington Fisher

Philipp Rockel

Wei Lun Huang

Ross R Dexter

Mathew A Mason

A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.

Displaying a rendered volumetric representation according to different display modes

According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.

Device, method, and graphical user interface for presenting CGR files

Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

XR preferred movement along planes

An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.

Devices, methods, and graphical user interfaces for displaying objects in 3D contexts

In one embodiment, a method of generating a 3D object is performed by a device including a processor, non-transitory memory, and one or more input devices. The method includes receiving, via one or more input devices, a user input selecting a file representing two-dimensional (2D) content and having a file type. The method includes receiving, via the one or more input devices, a user input requesting generation of a three-dimensional (3D) object based on the file. The method includes generating, based on the file type, a 3D object representing the 2D content.

Device, method, and graphical user interface for generating CGR objects

In one embodiment, a method of presenting a computer-generated reality (CGR) file includes receiving a user input to present a CGR scene including one or more CGR objects, wherein the CGR scene is associated with a first anchor and a second anchor. The method includes capturing an image of a physical environment and determining that the image of the physical environment lacks a portion corresponding to the first anchor. The method includes detecting a portion of the image of the physical environment corresponding to the second anchor. The method includes, in response to determining that image of the physical environment lacks a portion corresponding to the first anchor and detecting a portion of the image of the physical environment corresponding to the second anchor, displaying the CGR scene at a location of the display corresponding to the second anchor.

An electronic device displays an environment that includes a virtual object that is associated with a first action that is triggered based on satisfaction of a first set of criteria. In response to a first input detected while the environment is displayed: the first action is performed in accordance with a determination that the first input satisfies the first set of criteria, and, in accordance with a determination that the first input does not satisfy the first set of criteria but instead satisfies a second set of criteria, the first action is not performed and instead a first visual indication of one or more inputs that if performed would cause the first set of criteria to be satisfied is displayed.

A computer system with a display, a touch-sensitive surface, and one or more cameras displays a virtual object in a first user interface region. In response to detecting a first input at a location that corresponds to the virtual object and in accordance with a determination that the first input meets first criteria, the virtual object is displayed in a second user interface region. In response to detecting a second input, in accordance with a determination that the second input corresponds to a request to manipulate the virtual object in the second user interface region, a display property of the virtual object is changed, and in accordance with a determination that the second input corresponds to a request to display the virtual object in an augmented reality environment, the virtual object is displayed with a representation of a field of view of the one or more cameras.

Devices, methods, and graphical user interfaces for system-wide behavior for 3D models

An electronic device, while displaying a first user interface region and a first media item, detects a first input corresponding to a sharing user interface. In response, the device displays the sharing user interface, which includes a second user interface object for initiating a process for displaying a second representation of a first media item in an augmented reality environment. In response to detecting a sequence of one or more inputs including selection of the second user interface object, the device displays the second representation of the first media item in a second user interface that includes content of at least a portion of a field of view of the device's one or more cameras.

Devices, methods, and graphical user interfaces for displaying objects in 3D context

One exemplary implementation involves performing operations at a device with one or more processors, a camera, and a computer-readable storage medium, such as a desktop computer, laptop computer, tablet, or mobile phone. The device receives a data object corresponding to three dimensional (3D) content from a separate device. The device receives input corresponding to a user selection to view the 3D content in a computer generated reality (CGR) environment, and in response, displays the CGR environment at the device. To display the CGR environment the device uses the camera to capture images and constructs the CGR environment using the data object and the captured images.

Displaying 3D content shared from other devices

An electronic device detects a first manipulation input directed to a respective virtual object of a plurality of virtual objects. In response to detecting the first manipulation input, in accordance with a determination that the plurality of virtual objects are displayed with at least a portion of a field of view of the one or more cameras, the device changes a display property of the respective virtual object based on the first manipulation input, and, in accordance with a determination that the plurality of virtual objects are displayed in a user interface that does not include the field of view of the one or more cameras, the electronic device changes a display property of the plurality of virtual objects based on the first manipulation input.

A computer system having a display generation component and one or more input devices displays a representation of a virtual three-dimensional object in a user interface region. In response to an input for rotating the object, when the input corresponds to a request to rotate the object about a first axis, the object is rotated by an amount that is determined based on a magnitude of the input and is constrained by a limit on the movement restricting rotation by more than a threshold amount. When the input corresponds to a request to rotate the object about a second axis, the object is rotated relative to the second axis by an amount that is determined based on a magnitude of the input, wherein, for an input with a magnitude above a respective threshold, the device rotates the object by more than the threshold amount of rotation.

A computer system having a display generation component, one or more input devices, and one or more cameras receives a request to display a virtual object in a first user interface region that includes a field of view of the one or more cameras. In response to the request, in accordance with a determination that object-placement criteria are not met, the representation of the virtual object is displayed with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras. In accordance with a determination that the object-placement criteria are met, the representation of the virtual object is displayed with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane.

Growing community of inventors

San Jose, CA, United States of America

David Lui