User interaction in head-mounted display with eye tracking

Abstract

A virtual reality (VR) system includes a console an imaging device, a head mounted display (HMD) and a user input device. The console includes a virtual reality (VR) engine, a tracking module and an application store. The HMD includes a display element configured to display content to a user wearing the HMD. The virtual reality engine is configured to determine a vector for a virtual object thrown at a target in response to physical input from the user, a gaze vector for the eyes of the user and a virtual object position vector for the target and modify the vector for the virtual object based on at least one of the gaze vector and the virtual object position vector. The virtual reality engine may also be configured to determine a virtual object position vector for a virtual object to be thrown at a target, a gaze vector for the eyes of the user and a virtual object position vector for a virtual rendering of the user's hand and enabling user input to pick up the virtual object based on at least one of the gaze vector and the virtual object position vector of the virtual rendering of the user's hand.