Menu placement dictated by user ability and modes of feedback

Abstract

Methods and systems are provided for placing or moving a virtual menu (e.g., virtual object) to an adjusted virtual position within a virtual reality scene based on the ability of a user. The method includes capturing, by a computing system, head mounted display (HMD) gameplay by a user of a video game being executed on the computing system. The HMD presents virtual reality scene to the user. The method includes monitoring, by the computing system, physical actions of the user while the user is wearing the HMD and interacting with the virtual reality scene during the gameplay. The method includes identifying, by the computing system, an attempt by the user to make an input at a virtual object in the virtual reality scene based on the physical actions. The method includes generating, by the computing system, a movement of the virtual object from an initial virtual position in the virtual reality scene to an adjusted virtual position in the virtual reality scene. The movement has a virtual distance and a virtual direction that is predicted for the user based a model of interactivity of the user to enable said input with the virtual object. In this way, a virtual menu (e.g., virtual object) is dynamically placed or moved to a virtual position in the virtual reality scene that can be accessible by the user.