Apple Inc.

Adam Michael O'Hern

Zachary Z Becker

Timothy Robert Oriol

Michelle Chua

Samuel Lee Iglesias

Bradley Warren Peebler

Adam James Bolton

Etienne H Guerard

Robin-Yann Joram Storm

Clement P Boissiere

Gerald Louis Guyomard

Scott Bassett

Philip M Simmons

Mark E Drummond

Mohamed Selim Ben Himane

Siva Chandra Mouli Sivapurapu

Payal Jotwani

Bo Morgan

Peter L Hajas

Daniel Laszlo Kovacs

Aashi Manglik

Charles Magahern

Michael E Buerli

Justin T Voss

Dan Feng

Mu Qiao

Mark A Ebbole

Eddie G Mendoza

James Moll

Noah Gamboa

A device obtains a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.

Displaying an environment from a selected point-of-view

In one implementation, a method of casting a scene is performed at a first device including a display, an input device, one or more processors, and non-transitory memory. The method includes displaying, on the display, a graphical user interface for composing an XR scene, wherein the graphical user interface includes an assets region displaying a list of assets of the XR scene and a casting affordance. The method includes detecting, via the input device, a user input selecting the casting affordance. The method includes, in response to detecting the user input selecting the casting affordance, determining a second device to receive a container file, wherein the second device is a stereoscopic device. The method includes storing the assets of the XR scene as the container file. The method includes transmitting the container file to the second device.

Container file viewing

In one implementation, a method of displaying files is performed at a device including a display, an input device, one or more processors, and non-transitory memory. The method includes displaying, in a first area of the display, a plurality of file representations respectively representing a plurality of files. The method includes detecting, via the input device, selection of a first file representation representing a first file from the plurality of file representations, wherein the first file is a first container file including a plurality of first constituent files. The method includes determining a first file type. The method includes while displaying the plurality of file representations, displaying, in a second area of the display, a first set of first constituent file representations respectively representing each of the plurality of first constituent files having the first file type.

In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.

Virtual paper

Various implementations disclosed herein include devices, systems, and methods for indicating a distance to a selectable portion of a virtual surface. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a graphical environment that includes a virtual surface, wherein at least a portion of the virtual surface is selectable. In some implementations, the method includes determining a distance between a collider object and the selectable portion of the virtual surface. In some implementations, the method includes displaying a depth indicator in association with the collider object. In some implementations, a visual property of the depth indicator is selected based on the distance between the collider object and the selectable portion of the virtual surface.

User interface for interacting with an affordance in an environment

Various implementations disclosed herein include a method performed by a device. While executing a CGR application, the method includes displaying a three-dimensional object in a three-dimensional space, wherein the three-dimensional space is defined by a three-dimensional coordinate system. The method also includes: detecting a first user input directed to the three-dimensional object; and in response to detecting the first user input, displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object, wherein each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space.

Device, method, and graphical user interface for manipulating 3D objects on a 2D screen

Various implementations disclosed herein include a method performed by a device. The method includes displaying a three-dimensional object in a three-dimensional space. The method includes displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object. Each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space. The method includes detecting a first user input directed to a first spatial manipulation affordance of the spatial manipulation affordance. The first spatial manipulation affordance is associated with a first axis of the three-dimensional space. The method includes, in response to detecting the first user input directed to the first spatial manipulation affordance, translationally moving the three-dimensional object along the first axis of the three-dimensional space.

Implementations use a first device (e.g., an HMD) to provide a CGR environment that augments the input and output capabilities of a second device, e.g., a laptop, smart speaker, etc. In some implementations, the first device communicates with a second device in its proximate physical environment to exchange input or output data. For example, an HMD may capture an image of a physical environment that includes a laptop. The HMD may detect the laptop, send a request the laptop's content, receive content from the laptop (e.g., the content that the laptop is currently displaying and additional content), identify the location of the laptop, and display a virtual object with the received content in the CGR environment on or near the laptop. The size, shape, orientation, or position of the virtual object (e.g., a virtual monitor or monitor extension) may also be configured to provide a better user experience.

Augmented devices

A method includes displaying a spatial manipulation user interface element including a first set of spatial manipulation affordances respectively associated with a first set of spatial manipulations of a three-dimensional object. The first set of spatial manipulations is based on a first virtual camera perspective. The method includes, in response to detecting a user input changing the first virtual camera perspective to a second virtual camera perspective, changing display of the three-dimensional object from the first virtual camera perspective to the second virtual camera perspective, and displaying a second set of spatial manipulation affordances respectively associated with a second set of spatial manipulations. The second set of spatial manipulations is based on the second virtual camera perspective, and includes a spatial manipulation excluded from the first set of spatial manipulations. The first set of spatial manipulations includes a spatial manipulation excluded from the second set of spatial manipulations.

Growing community of inventors

Campbell, CA, United States of America

Adam Michael O'Hern