Apple Inc.

Bart Colin Trzynadlowski

Devin William Chalmers

Thomas G Salter

Gregory Patrick Lane Lutter

Anshu Kameswar Chimalamarri

Rahul Nair

Anselm Grundhoefer

Thomas J Moore

Jean-Charles Bernard Marcel Bazin

David H Huang

A method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes obtaining a scene graph that includes a plurality of nodes. Each of the plurality of nodes represents an object. The method includes identifying, within the plurality of nodes, a first subset of nodes based on each of the first subset of nodes satisfying a relevancy criterion with respect to a viewable region associated with the display. The first subset of nodes respectively represents a first subset of objects. The method includes assessing the first subset of objects in order to determine whether a spatial selector intersects with a particular object of the first subset of the objects. The method includes selecting the particular object based on determining that the spatial selector intersects with the particular object.

Selective hit testing based on a relevancy criterion

Various implementations disclosed herein include devices, systems, and methods that detects user interactions with a content object of a set of views of a three-dimensional (3D) environment and provides a different set of views with a different positional constraint. For example, an example process may include associating a content object with a region of a physical environment, providing a first set of views of the physical environment, wherein the content object is displayed using a first positional constraint when included in the first set of views, detecting an interaction associated with the region of the physical environment, and in accordance with detecting the interaction, providing a second set of views of the physical environment, wherein the content object is displayed using a second positional constraint when included in the second set of views, the second positional constraint different than the first positional constraint.

Transitioning content in views of three-dimensional environments using alternative positional constraints

Various implementations disclosed herein include devices, systems, and methods for conversational augmentation. In various implementations, a device includes a display, a processor and a non-transitory memory. In some implementations, the method includes, while a user of the device is in a current conversation with a person, detecting a reference to a previous conversation. In some implementations, the method includes determining whether there are user-curated notes that satisfy a relevance threshold associated with the current conversation. In some implementations, the method includes presenting a portion of the user-curated notes that satisfies the relevance threshold associated with the current conversation.

Conversational augmentation

In one implementation, a method for spatially designating private content. The method includes: presenting, via a display device, an indication of a private viewing region relative to a location of the computing system; determining a first location for presentation of graphical content; and presenting, via the display device, the graphical content at the first location. The method further includes: transmitting a characterization vector associated with the graphical content to at least one other device for display thereon according to a determination that the first location of the graphical content is outside of the private viewing area; and forgoing transmission of the characterization vector associated with the graphical content to the at least one other device according to a determination that the first location of the graphical content is inside of the private viewing area.

Method and device for spatially designating private content

In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.

Method and device for displaying a task list

Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as 'too fast', “too far”, “too dark”), and provides a notification (e.g., “too fast-slow down”, “too far-move closer”, “too dark-turn on a light”) at the electronic device based on the condition causing the inaccuracy in the localization.

Localization accuracy response

Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as 'too fast', 'too far', 'too dark'), and provides a notification (e.g., &#x201c;too fast-slow down&#x201d;, &#x201c;too far-move closer&#x201d;, &#x201c;too dark-turn on a light&#x201d;) at the electronic device based on the condition causing the inaccuracy in the localization.

A method is performed at an electronic device including one or more processors, a non-transitory memory, and a first input device. The method includes detecting, via the first input device, an input directed to a first location within a physical environment. The first location is identified by an extremity tracking function based on the input. The method includes determining an interaction event based on a function of a semantic identifier that is associated with a portion of the first location. The method includes presenting computer-generated content that is a function of the interaction event.

Growing community of inventors

Reno, NV, United States of America

Bart Colin Trzynadlowski