Chengdu Idealsee Technology Co., Ltd.

Xinyu Li

Haitao Song

Yinqiu Liu

Qinhua Huang

Yang Liu

Disclosed are a binocular see-through AR head-mounted device and an information displaying method thereof. Sight mapping relationship &#x3b7; is preset in the head-mounted device, human eye spatial sight information data of a user is tracked and calculated by a sight tracking system, virtual information that needs to be displayed is displayed on the left and right lines of sight of the human eyes on the basis of a binocular see-through AR head-mounted device virtual image imaging principle and a human eye binocular vision principle, thus implementing accurate overlap of the virtual information to the proximity of the position of the fixation point of the human eyes, allowing a high degree of integration of the virtual information with the environment, and implementing enhanced virtual reality in the true sense. The present invention provides a simple solution, requires only the sight tracking system to complete the process, obviates the need for excessive hardware facilities, and is inexpensive.

Binocular see-through AR head-mounted display device and information displaying method thereof

A binocular see-through AR head-mounted display device is disclosed. Based on that the mapping relationships fand fare pre-stored in the head-mounted device, the position of the target object in the camera image is obtained through an image tracking method, and is mapped to the screen coordinate system of the head-mounted device for calculating the left/right image display position. Through a monocular distance finding method, the distance between the target object and the camera is real-time calculated referring to the imaging scale of the camera, so as to calculate a left-right image distance, thereby calculating the right or the right image display position. Correspondingly, the present invention also provides an information display method for a binocular see-through AR head-mounted display device and an augmented reality information display system. The present invention is highly reliable with low cost.

Binocular see-through AR head-mounted display device and information display method therefor

A binocular see-through AR head-mounted display device and an information display method therefor are disclosed. The present invention uses the scene depth image and the user stared point to calculate the position of the target object stared by the user and maps coordinates to the screen coordinate system to determine the overlapping position of AR information. In addition, the present invention can tolerate small changes of human eye sight, and the AR information can be stably stacked in the same position with good robustness. The present invention can distinguish the target object stared by the user from the background, and when the user eye sight is put on different parts of the target object, the AR information is still superimposed at the same position without frequent movement with changes of the eye sight.

Disclosed is a video playing method based on augmented reality technology. In combination with augmented reality technology, a rectangular plane 3D model which completely covers a target picture in a current scene image is drawn, and at the same time, after a video file related to the target picture is separated into an audio stream and a video stream, a video image frame in the video stream is taken as a texture and is mapped to the 3D model frame by frame, and graphic rendering is performed; and finally, a scene image captured by a video camera and the rendered 3D model are fused and output, and the audio stream data is output synchronously. Correspondingly, also disclosed are a video playing system based on augmented reality technology and mobile terminal. The picture information in newspapers and periodicals, magazines and other print media can be easily converted into video information, and the video completely fits the picture in the spatial position, so that a user obtains a new audio-visual experience of combining emotion with scenery; and newspapers and periodicals, magazines and other paper media can also realize diversified propagation of information by virtue of the technology of the present invention, and provide a precise fast video push service.

Growing community of inventors

Sichuan, China

Xinyu Li