Pose recognition method, device and system for an object of interest to human eyes

Abstract

The present disclosure belongs to the field of 3D gaze point recognition and computer vision, and more particularly discloses a pose recognition method, device and system for an object of interest to human eyes, which respectively identifies centers of left and right pupils of a user by using a left eye camera and a right eye camera on an eye tracker to extract information of the user's eyes; maps the obtained centers of the left and right pupils to a left scene camera to obtain a 2D gaze point; extracts bounding boxes of objects in the left scene camera by using target recognition and tracking algorithms, and then determines an object of interest to the user according to a positional relationship between the 2D gaze point and the bounding boxes of the objects; performs 3D reconstruction and pose estimation of the object of interest to the user to obtain a pose of the object of interest in the left scene camera; and converts the pose of the object of interest in the left scene camera to a pose in the world coordinate system, thereby determining a pose of the object of interest to the user. The present disclosure can identify the object of interest to the user and estimate the pose of the object, and has the advantages of high recognition accuracy and high pose estimation accuracy.