Head mounted display system capable of displaying a virtual scene and a real scene in a picture-in-picture mode, related method and related non-transitory computer readable storage medium

Abstract

A head mounted display system includes a wearable body, an image capturing unit, a display unit and a processing unit. The wearable body can be worn by a user. The image capturing unit is mounted on the wearable body for capturing a real scene of a real environment. The display unit is mounted on the wearable body and for displaying a virtual scene of a virtual environment and the real scene in a picture-in-picture mode. The processing unit is coupled to the display unit and the image capturing unit. The present disclosure allows the user to see the virtual scene and the real scene combined in a same video frame synchronously and help the user to understand a current position or a current state of the user in the real environment, which effectively ensures the user's safety and prevents injuries caused by collision when the user experiences the virtual environment.