Apple Inc.

Etienne H Guerard

Zachary Z Becker

Michelle Chua

Bradley Warren Peebler

Adam James Bolton

Adam Michael O'Hern

Piotr J Stanczyk

Robin-Yann Joram Storm

David Andrew Brasgalla

Gerald Louis Guyomard

Jason Klivington

Charles A Mezak

Arwen V Bradley

Cameron J Dunn

Graham R Clarke

Behkish J Manzari

Rudolph Van Der Merwe

Eric Steven Peyton

Matan Stauber

Amir Hoffnung

Jacques P Gasselin De Richebourg

Douglas P Mitchell

Eric Gregory Thivierge

David John Addey

Pau Sastre Miguel

Omar Shaik

Ran Margolin

Olivier Marie Jacques Pinon

Stephen J Ward

Sanaa Squalli

Various implementations disclosed herein include devices, systems, and methods that facilitate the creation of a 3D model for object detection based on a scan of the object. Some implementations provide a user interface that a user interacts with to facilitate a scan of an object to create 3D model of the object for later object detection. The user interface may include an indicator that provides visual or audible feedback to the user indicating the direction that the capturing device is facing relative to the object being scanned. The direction of the capture device may be identified using sensors on the device (e.g., inertial measurement unit (IMU), gyroscope, etc.) or other techniques (e.g., visual inertial odometry (VIO)) and based on the user positioning the device so that the object is in view.

Object scanning for subsequent object detection

Devices, methods, and non-transitory program storage devices are disclosed to provide for the application of color treatments and/or color normalization operations to digital assets (DAs) in a set of DAs that are to be displayed as part of a multimedia presentation. The determination of the color treatment may be based on comparing one or more characteristics of an audio media item associated with the set of DAs to a corresponding one or more characteristics of a plurality of predetermined color treatments. Color normalization may be applied to the set of DAs prior to the determined color treatment. Techniques disclosed herein may also determine one or more parameters for a multimedia presentation of the set of DAs based on a characteristic of the associated audio media item. The parameters for the multimedia presentation may comprise one or more of: preferred DA sequences, portions, clusters, layouts, themes, transition types, or transition durations.

Color treatment and color normalization for digital assets

Display screen or portion thereof with icon

Various implementations disclosed herein include a method performed by a device. While executing a CGR application, the method includes displaying a three-dimensional object in a three-dimensional space, wherein the three-dimensional space is defined by a three-dimensional coordinate system. The method also includes: detecting a first user input directed to the three-dimensional object; and in response to detecting the first user input, displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object, wherein each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space.

Device, method, and graphical user interface for manipulating 3D objects on a 2D screen

Various implementations disclosed herein include a method performed by a device. The method includes displaying a three-dimensional object in a three-dimensional space. The method includes displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object. Each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space. The method includes detecting a first user input directed to a first spatial manipulation affordance of the spatial manipulation affordance. The first spatial manipulation affordance is associated with a first axis of the three-dimensional space. The method includes, in response to detecting the first user input directed to the first spatial manipulation affordance, translationally moving the three-dimensional object along the first axis of the three-dimensional space.

In some implementations, a method includes: obtaining a request to display a virtual object at a location within a computer-generated environment; and, in response to detecting the request to display the virtual object the location within the computer-generated environment: determining a real-world pose for the electronic device relative to a first coordinate space associated with a physical environment; determining a viewing vector by transforming the real-world pose from the first coordinate space to a second coordinate space associated with the computer-generated environment; in accordance with a determination that the viewing vector satisfies viewing criteria, displaying the virtual object at the location within the computer-generated environment according to a first view mode; and in accordance with a determination that the viewing vector satisfies second viewing criteria, displaying the virtual object at the location within the computer-generated environment according to a second view mode.

Method and device for orientation-based view switching

In one embodiment, a method of generating a computer-generated reality (CGR) file includes receiving, via one or more input devices, user input generating a computer-generated reality (CGR) scene, a user input associating an anchor with the CGR scene, user input associating one or more CGR objects with the CGR scene, wherein the CGR objects are to be displayed in association with the anchor, and user input associating a behavior with the CGR scene, wherein the behavior includes one or more triggers and actions and wherein the actions are performed in response to detecting any of the triggers. The method includes generating a CGR file including data regarding the CGR scene, the CGR file including data regarding the anchor, the CGR objects, and the behavior.

Device, method, and graphical user interface for composing CGR files

A method includes displaying a spatial manipulation user interface element including a first set of spatial manipulation affordances respectively associated with a first set of spatial manipulations of a three-dimensional object. The first set of spatial manipulations is based on a first virtual camera perspective. The method includes, in response to detecting a user input changing the first virtual camera perspective to a second virtual camera perspective, changing display of the three-dimensional object from the first virtual camera perspective to the second virtual camera perspective, and displaying a second set of spatial manipulation affordances respectively associated with a second set of spatial manipulations. The second set of spatial manipulations is based on the second virtual camera perspective, and includes a spatial manipulation excluded from the first set of spatial manipulations. The first set of spatial manipulations includes a spatial manipulation excluded from the second set of spatial manipulations.

Techniques and devices for generating multiple output video variations for an input video based on a shared resource architecture. The shared resource architecture reuses and shares computational and gating results from one or more operations to create the multiple output video variations. The shared resource architecture applies a frame-time normalization of the trimmed and stabilized video to produce a trimmed stabilized normalized video and, thereafter, uses the trimmed stabilized normalized video to precompute one or more video parameters that can be shared with multiple output video variations. The shared resource architecture can then generate multiple output video variations using the shared video parameters.

Seamless output video variations for an input video

Techniques and devices for creating a Forward-Reverse Loop output video and other output video variations. A pipeline may include obtaining input video and determining a start frame within the input video and a frame length parameter based on a temporal discontinuity minimization. The selected start frame and the frame length parameter may provide a reversal point within the Forward-Reverse Loop output video. The Forward-Reverse Loop output video may include a forward segment that begins at the start frame and ends at the reversal point and a reverse segment that starts after the reversal point and plays back one or more frames in the forward segment in a reverse order. The pipeline for the generating Forward-Reverse Loop output video may be part of a shared resource architecture that generates other types of output video variations, such as AutoLoop output videos and Long Exposure output videos.

Seamless forward-reverse video loops

Growing community of inventors

Cupertino, CA, United States of America

Etienne H Guerard