Apple Inc.

Tyler L Casella

Norman Nuo Wang

David Lui

Benjamin Breckin Loggins

Xiao Jin Yu

Daniel Mark Delwood

Ross R Dexter

Eric Steven Peyton

Edwin W Foo

Peter Gregory Zion

Omar Shaik

Christopher H Dempsey

Ken Wakasa

Timothy Robert Oriol

Zachary Z Becker

Jacques P Gasselin De Richebourg

Michelle Chua

David Adam Lipton

Wei Lun Huang

Eric Gregory Thivierge

Ryan S Burgoyne

Karen Natalie Wong

Hon-ming Chen

Kyle Ellington Fisher

Shuai Song

Clement P Boissiere

Eric Chiu

Mahdi Nabiyouni

A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.

Displaying a rendered volumetric representation according to different display modes

Three-dimensional data can be synchronized between a first electronic device and a second electronic device. A content creation application may be running on the first electronic device and may utilize a data file describing a three-dimensional content item. A two-dimensional representation of the content item may be displayed on the first electronic device. A user may request to preview the two-dimensional representation of the content item in three-dimensions. The first electronic device may initiate a data transfer with the second electronic device. The three-dimensional data of the data file may be transferred, via a communication link, from the content creation of the first electronic device to a three-dimensional graphic rendering application at the second electronic device. The three-dimensional graphic rendering application may generate a preview of the content item in three-dimensions based on the received three-dimensional data.

System and method for interactive three-dimensional preview

A three-dimensional preview of content can be generated and presented at an electronic device in a three-dimensional environment. The three-dimensional preview of content can be presented concurrently with a two-dimensional representation of the content in a content generation environment presented in the three-dimensional environment. While the three-dimensional preview of content is presented in the three-dimensional environment, one or more affordances can be provided for interacting with the one or more computer-generated virtual objects of the three-dimensional preview. The one or more affordances may be displayed with the three-dimensional preview of content in the three-dimensional environment. The three-dimensional preview of content may be presented on a three-dimensional tray and the one or more affordances may be presented in a control bar or other grouping of controls outside the perimeter of the tray and/or along the perimeter of the tray.

Devices, methods and graphical user interfaces for three-dimensional preview of objects

System and method for interactive three- dimensional preview

According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.

Device, method, and graphical user interface for presenting CGR files

In some implementations, a method includes: while presenting an object via the display device, determining an operation set associated with the object that includes a plurality of input-response pairings, wherein each input-response pairing includes an input type and an associated response; obtaining, via the one or more input devices, a user input directed to the object; and, in response to detecting the user input: mapping the user input to an input-response pairing within the operation set associated with the object; and performing an operation on the object based on the user input and the input-response pairing.

Method and device for assigning an operation set

A method includes determining an eye focus depth and determining a focus point relative to a viewing location in a virtual environment based on the eye focus depth, wherein the virtual environment includes a computer-generated object. The method also includes, upon determining that the focus point is located within a threshold distance from the computer-generated object, activating a function of a computer-executable code development interface relative to the computer-generated object.

Focus-based debugging and inspection for a display system

In one embodiment, a method of generating a 3D object is performed by a device including a processor, non-transitory memory, and one or more input devices. The method includes receiving, via one or more input devices, a user input selecting a file representing two-dimensional (2D) content and having a file type. The method includes receiving, via the one or more input devices, a user input requesting generation of a three-dimensional (3D) object based on the file. The method includes generating, based on the file type, a 3D object representing the 2D content.

Device, method, and graphical user interface for generating CGR objects

In one embodiment, a method of presenting a computer-generated reality (CGR) file includes receiving a user input to present a CGR scene including one or more CGR objects, wherein the CGR scene is associated with a first anchor and a second anchor. The method includes capturing an image of a physical environment and determining that the image of the physical environment lacks a portion corresponding to the first anchor. The method includes detecting a portion of the image of the physical environment corresponding to the second anchor. The method includes, in response to determining that image of the physical environment lacks a portion corresponding to the first anchor and detecting a portion of the image of the physical environment corresponding to the second anchor, displaying the CGR scene at a location of the display corresponding to the second anchor.

A device implementing dynamic library access based on proximate programmable item detection includes a sensor and a processor configured to detect, using the sensor, a programmable physical item in a proximate area. The processor is further configured to, responsive to detecting the programmable physical item, provide an indication of available functions for programming the programmable physical item. The processor is further configured to receive input of code that comprises at least one of the available functions for programming the programmable physical item. The processor is further configured to program the programmable physical item based at least in part on the code. In one or more implementations, the processor may be further configured to translate the code into a set of commands for programming the programmable physical item and to transmit the set of commands to the programmable physical item.

Dynamic library access based on proximate programmable item detection

A device implementing an adaptive assembly guidance system includes an image sensor and a processor configured to capture, using the image sensor, an image of a set of connectable components. The processor is further configured to process the captured image to detect individual connectable components of the set of connectable components and to detect a current configuration of the set of connectable components. The processor is further configured to determine, based at least in part on the detected individual connectable components of the set of connectable components, a recommended configuration of the set of connectable components. The processor is further configured to display information for assembling the set of connectable components into the recommended configuration from the current configuration.

Adaptive assembly guidance system

One exemplary implementation involves performing operations at a device with one or more processors, a camera, and a computer-readable storage medium, such as a desktop computer, laptop computer, tablet, or mobile phone. The device receives a data object corresponding to three dimensional (3D) content from a separate device. The device receives input corresponding to a user selection to view the 3D content in a computer generated reality (CGR) environment, and in response, displays the CGR environment at the device. To display the CGR environment the device uses the camera to capture images and constructs the CGR environment using the data object and the captured images.

Growing community of inventors

San Jose, CA, United States of America

Tyler L Casella