Apple Inc.

Norman Nuo Wang

Jacques P Gasselin De Richebourg

Tyler L Casella

Timothy Robert Oriol

Ross R Dexter

Domenico P Porcino

James J Cwik

Geoffrey Grant Stahl

Bruno M Sommer

David Lui

Benjamin Breckin Loggins

Daniel Mark Delwood

Edwin W Foo

Xiao Jin Yu

Ken Wakasa

Tobias Eble

Alexander Barraclough Brown

Michael R Siracusa

Edwin Iskandar

Wei Lun Huang

Richard Darin Roe

Sabine Webel

Sunny K Chow

Johnny Trenh

Megan M Gardner

Shruti Singhal

Clement P Boissiere

Ivan Gavrenkov

Michael Ryan Brennan

Pal Kristian Engstad

Olivier Denis Roger Gutknecht

Various implementations disclosed herein include devices, systems, and methods for compositing an affordance in association with a CGR object representing a physical article. In various implementations, a device includes a display, a non-transitory memory, and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a computer-generated reality (CGR) object in a CGR environment. In some implementations, the CGR object represents a physical article. In some implementations, the method includes compositing an affordance in association with the CGR object. In some implementations, the method includes detecting an input directed to the affordance. In some implementations, the method includes, in response to detecting the input, adding an identifier identifying the physical article to a user selection queue.

Controlling a user selection queue

According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.

Device, method, and graphical user interface for presenting CGR files

A method may include receiving a communication from a device at an artificial intelligence controller including state information for a software application component running on the device, the state information including information corresponding to at least one potential state change available to the software application component, and metrics associated with at least one end condition, interpreting the state information using the artificial intelligence controller, and selecting an artificial intelligence algorithm from a plurality of artificial intelligence algorithms for use by the software application component based on the interpreted state information; and transmitting, to the device, an artificial intelligence algorithm communication, the artificial intelligence algorithm communication indicating the selected artificial intelligence algorithm for use in the software application component on the device.

Artificial intelligence controller that procedurally tailors itself to an application

A method includes determining an eye focus depth and determining a focus point relative to a viewing location in a virtual environment based on the eye focus depth, wherein the virtual environment includes a computer-generated object. The method also includes, upon determining that the focus point is located within a threshold distance from the computer-generated object, activating a function of a computer-executable code development interface relative to the computer-generated object.

Focus-based debugging and inspection for a display system

Various implementations disclosed herein include devices, systems, and methods for presenting content based on environmental data. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining environmental data associated with a physical environment in which the device is located. In some implementations, the method includes selecting, from a plurality of presentation modes, a first presentation mode for content based on the environmental data. In some implementations, the method includes presenting the content in accordance with the first presentation mode.

Content presentation based on environmental data

The subject technology provides for parsing a line of code in a project of an integrated development environment (IDE). The subject technology executes indirectly, using the interpreter, the parsed line of code. The interpreter references a translated source code document generated by a source code translation component from a machine learning (ML) document written in a particular data format. The translated source code document includes code in a chosen programming language specific to the IDE, and the code of the translated source code document is executable by the interpreter. Further the subject technology provides, by the interpreter, an output of the executed parsed line of code.

Integrating machine learning models into an interpreted software development environment

In one embodiment, a method of presenting a computer-generated reality (CGR) file includes receiving a user input to present a CGR scene including one or more CGR objects, wherein the CGR scene is associated with a first anchor and a second anchor. The method includes capturing an image of a physical environment and determining that the image of the physical environment lacks a portion corresponding to the first anchor. The method includes detecting a portion of the image of the physical environment corresponding to the second anchor. The method includes, in response to determining that image of the physical environment lacks a portion corresponding to the first anchor and detecting a portion of the image of the physical environment corresponding to the second anchor, displaying the CGR scene at a location of the display corresponding to the second anchor.

A device implementing dynamic library access based on proximate programmable item detection includes a sensor and a processor configured to detect, using the sensor, a programmable physical item in a proximate area. The processor is further configured to, responsive to detecting the programmable physical item, provide an indication of available functions for programming the programmable physical item. The processor is further configured to receive input of code that comprises at least one of the available functions for programming the programmable physical item. The processor is further configured to program the programmable physical item based at least in part on the code. In one or more implementations, the processor may be further configured to translate the code into a set of commands for programming the programmable physical item and to transmit the set of commands to the programmable physical item.

Dynamic library access based on proximate programmable item detection

A device implementing an adaptive assembly guidance system includes an image sensor and a processor configured to capture, using the image sensor, an image of a set of connectable components. The processor is further configured to process the captured image to detect individual connectable components of the set of connectable components and to detect a current configuration of the set of connectable components. The processor is further configured to determine, based at least in part on the detected individual connectable components of the set of connectable components, a recommended configuration of the set of connectable components. The processor is further configured to display information for assembling the set of connectable components into the recommended configuration from the current configuration.

Adaptive assembly guidance system

One exemplary implementation involves performing operations at a device with one or more processors, a camera, and a computer-readable storage medium, such as a desktop computer, laptop computer, tablet, or mobile phone. The device receives a data object corresponding to three dimensional (3D) content from a separate device. The device receives input corresponding to a user selection to view the 3D content in a computer generated reality (CGR) environment, and in response, displays the CGR environment at the device. To display the CGR environment the device uses the camera to capture images and constructs the CGR environment using the data object and the captured images.

Displaying 3D content shared from other devices

A method of sharing content rendered on a device, including executing an application which generates audiovisual content, retrieving the application's audiovisual content from a graphics memory, and transmitting the retrieved content to a destination device via a network.

Techniques for secure screen, audio, microphone and camera recording on computer devices and distribution system therefore

This disclosure relates generally to the field of image processing and, more particularly, to various techniques and animation tools for allowing 2D and 3D graphics rendering and animation infrastructures to be able to dynamically render customized animations&#x2014;without the need for the customized animations to be explicitly tied to any particular graphical entity. These so-called entity agnostic animations may then be integrated into 'mixed' graphical scenes (i.e., scenes with both two-dimensional and three-dimensional components), where they may be: applied to any suitable graphical entity; visualized in real-time by the programmer; edited dynamically by the programmer; and shared across various computing platforms and environments that support the entity agnostic animation tools described herein. The entity agnostic animations created by the techniques described herein may be output directly to the current scene file that a programmer is working on, or they may be output to standalone, reusable entity agnostic animation object files.

Growing community of inventors

Saratoga, CA, United States of America

Norman Nuo Wang