Meta Platforms Technologies, LLC

Samuel Matthew Levatich

Norah Riley Smith

Matthew Alan Insley

Andrew C Johnson

Matthaeus Krenn

Matthew Luther

Anastasia Victor-Faichney

Etienne Pinchon

Ahad Habib Basravi

Irvi Stefo

Difei Wang

Jennifer Lynn Spurlock

Brandon Furtwangler

Jason Charles Leimgruber

Michael Medlock

A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment is provided. The method includes rendering the system UI in the XR environment as a 3D virtual element. The method further includes tracking a position of a hand of a user and a pre-defined stable point on the user. The method further includes identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

Facilitating system user interface (UI) interactions in an artificial reality (XR) environment

A virtual trackpad engine is configured to perform a technique for accessing and manipulating distant virtual objects in an XR environment. The technique includes generating, in an extended reality (XR) environment, a virtual model corresponding to a hand of a user. The technique also includes generating a virtual trackpad in the XR environment, where a surface of the virtual trackpad is mapped to a surface of a distant virtual object in the XR environment. Further, the technique includes determining if the virtual trackpad is activated and responsive to a determination that the virtual trackpad is activated, tracking a movement of the virtual hand. The technique further includes determining an action to be performed in relation to the distant virtual object that corresponds to the movement and, subsequently, performing the action.

Mapped direct touch virtual trackpad and invisible mouse

The disclosed computer-implemented method may include generating a virtual item within a virtual environment. The method may also include detecting, using various hardware sensors, a current position of a physical object that is to be portrayed within the virtual environment. The method may next include generating a virtual representation of the physical object within the virtual environment. The virtual representation of the physical object may be configured to at least partially follow movements of the physical object relative to the virtual item. The method may also include presenting the virtual item and the generated virtual representation of the physical object within the virtual environment, where the virtual representation of the physical object is at least partially, controllably decoupled from the movements of the physical object relative to the virtual item. Various other methods, systems, and computer-readable media are also disclosed.

Controlling interactions with virtual objects

Growing community of inventors

Seattle, WA, United States of America

Samuel Matthew Levatich