Apple Inc.

Microsoft Technology Licensing, LLC

Aaron Mackay Burns

Alexis Henri Palangie

Benjamin R Blachnitzky

Arun Rakesh Yoganandan

Nathan Gitter

Benjamin Hylak

Pol Pla I Conesa

Nicolai Philip Georg

Ben J Sugden

Tom G Salter

Alexandre Da Veiga

Bruno M Sommer

Laura K Massey

Kenneth Liam Kiemele

Christian Klein

Christian Michael Sadak

John Benjamin Hesketh

Michael Robert Thomas

Brad Kenneth Herman

Jue Wang

Timothy Robert Oriol

Zachary Z Becker

Connor A Smith

Reza Abbasian

Gregg Robert Wygonik

David A Carson

Jeffrey Sipko

Donna Katherine Long

Michelle Chua

Stephen Olivier Lemay

Jonathan R Dascola

William A Sorrentino, Iii

Brian James Mount

Israel Pastrana Vicente

Kathleen Patricia Mulcahy

Grant H Mulliken

Aaron Daniel Krauss

Brian E Keane

Michael Scavezze

Gerhard A Schneider

Benjamin Hunter Boesel

Adolfo Hernandez Santisteban

Peter L Hajas

David M Schattel

Adam G Poulos

Jordan A Cazamias

Anette L Freiin Von Kapri

Roger Sebastian Sylvan

Charlene Mary Jeune

Shiraz Akmal

Bryant Daniel Hawthorne

Jia Wang

Roger Sebastian Kevin Sylvan

Sophors Khut

Shih Sang Chiu

Charilaos Papadopoulos

Benjamin John Sugden

Ryan S Carlin

Greg Alt

Tony Ambrus

Quentin Simon Charles Miller

James J Owen

Scott Robert Ramsby

Christopher D Mckenzie

Shih-Sang Chiu

Ian Douglas McIntyre

James Tichenor

Wesley M Holder

Todd Omotani

Jonathan Ravasz

Thomas Salter

Ezgi Demirayak

Ricardo Arturo Espinoza Reyes

Riccardo Giraldi

Jamie R Cabaccang

Timothy David Kviz

Nikolai Michael Faaland

Matthew Steven Johnson

Abby Lin Lee

Bede Jordan

Mary A Pyc

Jeff Cole

Pau Sastre Miguel

Jamie Marconi

Katelyn Doran

Felicia Stephanie Williams

Scott M Andrus

Steven A Marchette

Jeff Sutherland

Bharat Ahluwalia

Tim Psiaki

John Benjamin George Hesketh

Robert Ferrese

Brent J Elmer

Russ McMackin

Adolfo H Santisteban

Christopher L Nolet

Samantha Koire

Scott G Wade

The method includes: while presenting virtual content, detecting a control device within a physical environment; determining whether a ray projecting from a portion of the control device intersects with the virtual content; presenting a first visualization associated with the ray projected from the portion of the control device with a first set of appearance characteristics according to a determination that the ray projected from the portion of the control device does not intersect with the virtual content; and presenting a second visualization associated with the ray projected from the portion of the control device different from the first visualization with a second set of appearance characteristics different from the first set of appearance characteristics according to a determination that the ray projected from the portion of the control device intersects with the virtual content.

Method and device for dynamically adjusting a pointer visualization

In one implementation, a method of visualizing text is performed by a device including a display, one or more processors, and non-transitory memory. The method includes detecting a text input device at a first location within a volumetric environment. The method includes detecting selection of a text input field of a user interface displayed within the volumetric environment. The method includes displaying, on the display, a representation of the text input field at a second location within the volumetric environment associated with the first location of the text input device.

Method and device for typing visualization

In one implementation, a method of processing input for multiple devices is performed by a first electronic device one or more processors and non-transitory memory. The method includes determining a gaze direction. The method includes selecting a target electronic device based on determining that the gaze direction is directed to the target electronic device. The method includes receiving, via an input device, one or more inputs. The method includes processing the one or more inputs based on the target electronic device.

Method and device for processing user input for multiple devices

In one implementation, a method of resolving focal conflict in a computer-generated reality (CGR) environment is performed by a device including a processor, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, an image of a scene including a real object in a particular direction at a first distance from the device. The method includes displaying, on the display, a CGR environment including a virtual object in the particular direction at a second distance from the device. In accordance with a determination that the second distance is less than the first distance, the CGR environment includes the virtual object overlaid on the scene. In accordance with a determination that the second distance is greater than the first distance, the CGR environment includes the virtual object with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

Method and device for resolving focal conflict

An electronic device such as a head-mounted device may present extended reality content such as a representation of a three-dimensional environment. The representation of the three-dimensional environment may be changed between different viewing modes having different immersion levels in response to user input. The three-dimensional environment may represent a multiuser communication session. A multiuser communication session may be saved and subsequently viewed as a replay. There may be an interactive virtual object within the replay of the multiuser communication session. The pose of the interactive virtual object may be manipulated by a user while the replay is paused. Some multiuser communication sessions may be hierarchical multiuser communication sessions with a presenter and audience members. The presenter and audience members may receive generalized feedback based on the audience members during the presentation. A participant may have their role changed between audience member and presenter during the presentation.

Interactive element in a replay

In one implementation. a method for dynamically selecting an operation modality for a physical object. The method includes: obtaining a user input vector that includes at least one user input indicator value associated with one of a plurality of different input modalities; obtaining tracking data associated with a physical object; generating a first characterization vector for the physical object, including a pose value and a user grip value, based on the user input vector and the tracking data, wherein the pose value characterizes a spatial relationship between the physical object and a user of the computing system and the user grip value characterizes a manner in which the physical object is being held by the user; and selecting, based on the first characterization vector, a first operation modality as a current operation modality for the physical object.

Method and device for dynamically selecting an operation modality for an object

A method is performed at an electronic device with a non-transitory memory, one or more processors, and a display. The method includes obtaining positional information regarding an auxiliary device. The method includes determining an anchor point of the auxiliary device on a volumetric computer-generated object. Determining the anchor point includes setting the anchor point to a first position of the auxiliary device in accordance with a determination that dimensions of the volumetric computer-generated satisfy a first criterion. Determining the anchor point further includes setting the anchor point to a second position of the auxiliary device in accordance with a determination that the dimensions of the volumetric computer-generated object satisfy a second criterion different from the first criterion. The first position is different from the second position. The method includes anchoring, based on the positional information, the volumetric computer-generated object to the anchor point of the auxiliary device.

Anchoring to multiple positions of an auxiliary device

Methods for displaying selectable options in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, one or more selectable options are displayed in a three-dimensional computer-generated environment in accordance with the determination that the one or more criteria have been satisfied, including a criteria that a hand of the user is oriented in a predetermined manner with respect to an electronic device. In some embodiments, a user is able to perform one-handed actuation of a selectable option with a plurality of user inputs and/or gestures that satisfy one or more activation criteria.

Method of displaying selectable options

Systems and processes for operating a digital assistant are provided. An example method includes, at an electronic device having one or more processors and memory, receiving a biometric signature of a user, determining, based on the biometric signature, a wellness level associated with the user, in accordance with a determination that the wellness level associated with the user is below a predetermined threshold, providing a first output to the user to stop engaging with the first electronic device, wherein the first electronic device is capable of producing a virtual environment, and after a predetermined time, causing a second output to be provided to the user with a second electronic device to begin engaging with the first electronic device.

User suggestions based on engagement

Devices, methods, and graphical interfaces for content applications displayed in an XR environment provide for an efficient and intuitive user experience. In some embodiments, a content application is displayed in a three-dimensional computer-generated environment. In some embodiments, different viewing modes and user interfaces are available for a content application in a three-dimensional computer-generated environment. In some embodiments, different interactions are available with content items displayed in the XR environment.

Devices, methods and graphical user interfaces for content applications

In one implementation, a method of assisting in the rehearsal of a presentation is performed at a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a difficulty level for a rehearsal of a presentation. The method includes displaying, on the display, one or more slides of the presentation. The method includes displaying, on the display in association with a volumetric environment, one or more virtual objects based on the difficulty level.

Virtual presentation rehearsal

Presentations in multi-user communication sessions

Methods for displaying and organizing user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can be grouped together into a container. In some embodiments, user interfaces can be added to a container, removed from a container, or moved from one location in the container to another location. In some embodiments, a visual indication is displayed before a user interface is added to a container. In some embodiments, a user interface can replace an existing user interface in a container. In some embodiments, when moving a user interface in a computer-generated environment, the transparency of a user interface that is obscured can be modified.

Method of grouping user interfaces in an environment

A method includes determining a first gaze position within a content manipulation region based on eye tracking data from an eye tracker. The method includes determining a selection point associated with a physical surface, based on spatial selector data from a spatial selector tracker. The method includes displaying a computer-generated representation of a trackpad on the physical surface, based on the first gaze position and the selection point. In some implementations, a method includes displaying a user interface including a plurality of content manipulation regions, a plurality of affordances respectively associated with the plurality of content manipulation regions, and a computer-generated representation of a trackpad. The method includes detecting, via a spatial selector tracker, an input directed to a first affordance associated with a first content manipulation region. The method includes associating the computer-generated representation of the trackpad with the first content manipulation region, based on the input.

Content manipulation via a computer-generated representation of a trackpad

Methods for displaying user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can have different immersion levels. In some embodiments, a user interface can have a respective immersion level based on its location in the three-dimensional environment or distance from the user. In some embodiments, a user interface can have a respective immersion level based on the state of the user interface. In some embodiments, a user interface can switch from one immersion level to another in response to the user's interaction with the user interface.

Method of displaying user interfaces in an environment and corresponding electronic device and computer readable storage medium

Growing community of inventors

Sunnyvale, CA, United States of America

Aaron Mackay Burns