Augmented reality device, and method for controlling augmented reality device

Abstract

An augmented reality (AR) device includes: an eye tracking sensor configured to obtain gaze information of a user; a communication interface; a camera; a display engine; a display; a memory storing one or more instructions; and a processor configured to execute the one or more instructions to: transmit, through the communication interface, gaze coordinates corresponding to a real-world object based on the gaze information to an image processing device that displays the real-world object, recognize, based on an image captured through the camera, a gesture to call a virtual image of the real-world object specified in the image processing device according to screen coordinates corresponding to the gaze coordinates, receive, through the communication interface, object information of the specified real-world object from the image processing device in response to transmitting an event notification corresponding to the recognized gesture to the image processing device, and control the display engine to provide a virtual image corresponding to the object information among prepared virtual images to a depth layer of the display corresponding to a type of the specified real-world object.