Apple Inc.

Shem Nguyen

Novaira Masood

Arnold H Cachelin

Soravis Prakkamakul

Mark E Drummond

Zachary Z Becker

Bo Morgan

Austin Caleb Germer

Pravalika Avvaru

Eric Geusz

Eric John Geusz

Christopher I Word

Some examples of the disclosure are directed to object manipulators and associated processes for manipulating an object representation in a three-dimensional environment. The object representation may correspond to a scan of a real-world object in a real-world environment. The object manipulators may include an object cleanup manipulator and a text annotation manipulator. The object cleanup manipulator may be selectable to display one or more control affordances providing functionality for selectively removing portions of the object representation in the three-dimensional environment and/or selectively adjusting one or more parameters of the object representation in the three-dimensional environment. The text annotation manipulator may be selectable to display one or more control affordances providing functionality for selectively generating one or more text labels in the three-dimensional environment. The one or more text labels may be associated with the object representation in the three-dimensional environment.

System and method of three-dimensional object cleanup and text annotation

Some examples described in this disclosure are performed at a first electronic device (e.g., a computer system) that is in communication with a display and one or more input devices. In some examples, the first electronic device detects a change in a physical environment of the first electronic device due to movement of one or more physical objects in the physical environment indicative of a user input. In some examples, the first electronic device performs a first action at the first electronic device or at a second electronic device in communication with the first electronic device in accordance with the change in the physical environment due to movement of the one or more physical objects in the physical environment.

Devices and methods for controlling electronic devices or systems with physical objects

Some examples of the disclosure are directed to media editing methods and graphical user interfaces. In some examples, the media editing user interface includes a plurality of user interface options and tools for capturing and editing media generated by a plurality of media recording devices. In some examples, states of the media recording devices are modified to add respective content to a media stream. In some examples, the media editing user interface includes representations of media content from the orientation of a respective media recording device. In some examples, the media editing user interface can present controls to alter contents of the media stream and publish and/or export the contents of the media stream.

Systems, methods and graphical user interfaces for media capture and editing applications

Various implementations disclosed herein include devices, systems, and methods for training of an action determining component of a computer character. In some implementations, actions are taken by the character in a 3D environment according to an action determining component of the character, where the character is rewarded or penalized for interactions associated with an object/concept in the 3D environment according to an assigned object/concept reward or penalty. In some implementations, the reward or the penalty assigned to the object/concept is modified, and the character is then rewarded or penalized for interactions associated with the object/concept according to the modified reward or the modified penalty. The action determining component of the character is trained using a reinforcement learning technique that accounts for rewards or penalties obtained by virtual character for interactions associated with the object/concept.

Training a character through interactions

A device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. The device performs a method that includes detecting, in a set of one or more images, appearance features that define an appearance of an object represented in the set of one or more images. The appearance includes one or more shading effects associated with the object. The method includes generating a feature map for the object that encodes the detected appearance features of the object. The method includes displaying, based on the feature map, a computer-generated graphical object with one or more simulated shading effects that are within a degree of similarity to the one or more shading effects associated with the object.

Shader for graphical objects

Various implementations disclosed herein include devices, systems, and methods for identifying virtual object kits that may be used to generate a target virtual object. In some implementations, a method includes obtaining a plurality of virtual object kits that generate variations of respective virtual object types. Each virtual object kit is associated with a characteristic parameter. For each virtual object kit, a subset of possible virtual object variations of the virtual object type is generated by assigning corresponding values to the characteristic parameter based on a distribution criterion. A subset of the plurality of virtual object kits is identified based on the target virtual object being within a similarity threshold of one or more virtual object variations generated using the subset of the plurality of virtual object kits in response to a request to assemble a target virtual object.

Growing community of inventors

Oakland, CA, United States of America

Shem Nguyen