Meta Platforms Technologies, LLC

Dose Health, LLC

Other

Facebook Technologies, LLC

Hayden Schoen

James Tichenor

Michal Hlavac

Barrett Fox

Arthur Zwiegincew

Gregory Alt

Merlyn Deng

Todd K Harris

Alex Marcolina

Paul Hines

Yeliz Karadayi

Camila Cortes De Almeida E De Vincenzo

Joe Jensen

Steven Wesner

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An 'augment' is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Artificial reality augments and surfaces

When a notification is to be shown, an artificial reality notification system can add the notification to a pre-defined location in the user's field of view (e.g., top, side, or bottom) where it stays as a head leashed virtual object until the user's gaze is direct to the notification. When the user's gaze is directed at the notification, the artificial reality notification system can make the notification world locked, allowing the user to move her head to bring the notification to the center of her field of view, move closer to the notification to make it larger, move around the notification to see aspects from different angles, etc. The notification can be dismissed if the user never directs her gaze at it for a first threshold amount of time or when the user looks away from the world-locked version for a second threshold amount of time.

Look to pin on an artificial reality device

A user uses 'snap points' to activate virtual objects and/or to transition virtual objects from body-locked or head-locked (i.e., “leashed”) to world-locked. A snap point is a specific location in the user's artificial-reality (XR) world. When the user assumes a position near to where he was when he previously defined a snap point, the object ceases to be leashed and instead locks to the snap point (i.e., the object becomes “world-locked”). Until the user's distance from where he was when he defined the snap point exceeds a threshold value, the object remains stably world-locked at the snap point. When the user moves more than the threshold, the object releases from the snap point, returns to its previously defined leashed mode, and follows the user through the XR world as previously.

Activating a snap point in an artificial reality environment

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

Integration of artificial reality interaction modes

When a notification is to be shown, an artificial reality notification system can add the notification to a pre-defined location in the user's field of view (e.g., top, side, or bottom) where it stays as a head leashed virtual object until the user's gaze is direct to the notification. When the user's gaze is directed at the notification, the artificial reality notification system make the notification world locked, allowing the user to move her head to bring the notification to the center of her field of view, move closer to the notification to make it larger, move around the notification to see aspects from different angles, etc. The notification can be dismissed if the user never directs her gaze at it for a first threshold amount of time or when the user looks away from the world-locked version for a second threshold amount of time.

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An 'augment' is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a 'surface' that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

Artificial realty augments and surfaces

Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.

Growing community of inventors

Tacoma, WA, United States of America

Hayden Schoen