Intent-based user interface modifications in an artificial reality environment

Abstract

Aspects of the present disclosure can modify a user interface of an artificial reality system based on an ascertained intent of the user. For example, some implementations can 'lock' a user's virtual hand to a virtual object displayed on the user interface when a user intends to interact with it with their physical hand, instead of tracking the physical hand with the virtual hand. While the virtual hand is “locked” to the virtual object, some implementations can further A) render another representation of the physical hand, separate from the virtual hand, corresponding to the actual location of the physical hand, B) render a visual affordance on the virtual hand based on movement of the physical hand, and/or C) restrict the amount of wrist rotation that is shown by the virtual hand when the physical hand interacts with the virtual object.