Meta Platforms Technologies, LLC

Matthew Luther

Matthaeus Krenn

Norah Riley Smith

Matthew Alan Insley

Anastasia Victor-Faichney

Samuel Matthew Levatich

Andrew C Johnson

Difei Wang

Ahad Habib Basravi

Irvi Stefo

Amir Mesguich Havilio

Nicholas Wallen

Ronald Omega Forbes, Jr

Eduardo Alberto Cuervo Laffaye

Paulo Melchiori

Amber Choo

Nathan Furtwangler

Jesse John Mullen

Aspects of the present disclosure are directed to application multitasking in a shell with a three-dimensional environment. Implementations immerse a user in a three-dimensional environment via an artificial reality system, such as a display environment for a system shell. The system shell can execute applications (e.g., system shell applications, remoted applications, etc.). An executing application can correspond to a displayed virtual object (e.g., panel). The system shell can concurrently execute two, three, or more applications and the three-dimensional environment can concurrently display two, three, or more corresponding virtual objects that display contents for the executing applications. Implementations of a mode manager can manage a mode for the three-dimensional environment/system shell. Example modes include cooperative mode and exclusive mode. Implementations of cooperative mode permit concurrent display of multiple virtual objects from different applications while the exclusive mode permits display of virtual objects only from the executing application entering exclusive mode.

Application multitasking in a three-dimensional environment

A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment is provided. The method includes rendering the system UI in the XR environment as a 3D virtual element. The method further includes tracking a position of a hand of a user and a pre-defined stable point on the user. The method further includes identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

Facilitating system user interface (UI) interactions in an artificial reality (XR) environment

In one embodiment, a method includes rendering, for one or more displays of a VR display device, a first output image of a VR environment. The VR environment includes a personal UI associated with a first user. The personal UI has a first form factor and a first pose with respect to the first user, is a virtual object comprising one or more 2D virtual displays, and is operable to execute a plurality of applications. The method includes determining whether to adapt the personal UI based on a detected change in a context of the first user with respect to the VR environment. The method includes rendering a second output image of the VR environment, where the personal UI is adapted to have a second form factor and a second pose with respect to the first user responsive to determining to adapt the personal UI based on the detected change in the context of the first user.

Adaptable personal user interfaces in cross-application virtual reality settings

Growing community of inventors

Los Gatos, CA, United States of America

Matthew Luther