Meta Platforms Technologies, LLC

Norah Riley Smith

Matthew Alan Insley

Samuel Matthew Levatich

Andrew C Johnson

Matthaeus Krenn

Matthew Luther

Anastasia Victor-Faichney

Ahad Habib Basravi

Irvi Stefo

Difei Wang

Jennifer Lynn Spurlock

Brandon Furtwangler

Etienne Pinchon

Jason Charles Leimgruber

Michael Medlock

A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment is provided. The method includes rendering the system UI in the XR environment as a 3D virtual element. The method further includes tracking a position of a hand of a user and a pre-defined stable point on the user. The method further includes identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

Facilitating system user interface (UI) interactions in an artificial reality (XR) environment

A wrist-pose isolation system can infer a wrist pose (e.g., the user's hand position relative to her forearm) and can reduce wrist-induced jitter for projection casting in an XR environment. A user's projection cast can be determined as a combination of a 'low-wrist contribution' component (e.g., a body-and-arm component) and a “high-wrist contribution” component (e.g., the pose of the wrist with respect to the arm). Using input from a gesture-tracking system, the contribution of the user's wrist pose to the user's current projection cast is calculated as a “wrist-contribution vector.” A projection cast direction can be determined as the interpolation of the current low-wrist contribution component and the high-wrist contribution component. This interpolation can be performed by weighting each by a specified amount and combining them.

Wrist-stabilized projection casting

The disclosed computer-implemented method may include generating a virtual item within a virtual environment. The method may also include detecting, using various hardware sensors, a current position of a physical object that is to be portrayed within the virtual environment. The method may next include generating a virtual representation of the physical object within the virtual environment. The virtual representation of the physical object may be configured to at least partially follow movements of the physical object relative to the virtual item. The method may also include presenting the virtual item and the generated virtual representation of the physical object within the virtual environment, where the virtual representation of the physical object is at least partially, controllably decoupled from the movements of the physical object relative to the virtual item. Various other methods, systems, and computer-readable media are also disclosed.

Controlling interactions with virtual objects

A wrist-pose isolation system can infer a wrist pose (e.g., the user's hand position relative to her forearm) and can reduce wrist-induced jitter for projection casting in an XR environment. A user's projection cast can be determined as a combination of a 'low-wrist contribution' component (e.g., a body-and-arm component) and a 'high-wrist contribution' component (e.g., the pose of the wrist with respect to the arm). Using input from a gesture-tracking system, the contribution of the user's wrist pose to the user's current projection cast is calculated as a &#x201c;wrist-contribution vector.&#x201d; A projection cast direction can be determined as the interpolation of the current low-wrist contribution component and the high-wrist contribution component. This interpolation can be performed by weighting each by a specified amount and combining them.

Growing community of inventors

Oakland, CA, United States of America

Norah Riley Smith