Arashi Vision Inc.

Wenjie Jiang

Jingkang Liu

Jinlin Cai

Cong Chen

Rui Xu

Yibin Guo

Li Zhu

Shun Jia

Chenglong Yin

Ruidong Gao

Pengwei Lyu

A present invention provides a video display method based on an unmanned aerial vehicle viewing angle, including: acquiring attitude information of an unmanned aerial vehicle; acquiring a video of the surroundings of the unmanned aerial vehicle under the corresponding attitude; acquiring a display viewing angle of the video; and displaying the video according to the display viewing angle, wherein the video includes a spherical panoramic video, an annular panoramic video, or a wide-angle video, and the display viewing angle and the attitude of the unmanned aerial vehicle are independent of each other.

Video display method and display system based on unmanned aerial vehicle viewing angle

A target tracking method, a computer-readable storage medium, and a computer device. The method comprises: matching a target tracking box with target candidate boxes to determine a target candidate box in best matching with the target tracking box; matching one or more remaining target candidate boxes, except for the best matching target candidate box, with a second target candidate box detected previously to determine a corresponding matching relationship; according to the best matching target candidate box and the corresponding matching relationship, obtaining distances and overlapping relationships respectively between the best matching target candidate box and the one or more remaining target candidate boxes and between the best matching target candidate box and the second target candidate box, so as to determine a shielding relationship between a target and other objects in the current video frame; and determining, according to the shielding relationship, whether to restart target tracking.

Target tracking method, computer-readable storage medium, and computer device

The present application is applicable to the field of video processing. Provided are a target tracking method for a panoramic video, a readable storage medium, and a computer device. The method comprises: using a tracker to track and detect a target to be tracked to obtain a predicted tracking position of said target in the next panoramic video frame, calculating the reliability of the predicted tracking position, and using an occlusion detector to calculate an occlusion score of the predicted tracking position; determining whether the reliability of the predicated tracking position is greater than a preset reliability threshold value, and determining whether the occlusion score of the predicted tracking position is greater than a preset occlusion score threshold value; and using a corresponding tracking strategy according to the reliability and the occlusion score. By means of the present application, whether a tracking failure is caused by the loss of a target or occlusion can be determined, such that a corresponding tracking recovery strategy can be used, and tracking can be automatically recovered when tracking fails, thereby achieving the effect of performing tracking continuously for a long time. In addition, the method of the present invention has a low operation complexity and a good real-time performance.

Target tracking method for panorama video, readable storage medium and computer equipment

The present invention is applicable to the technical field of panoramic videos. Provided are a panoramic video clip method, apparatus and device, and a storage medium. The method comprises acquiring a panoramic video photographed by means of a panoramic camera, and recording an advancing-direction viewing angle of the panoramic camera during moving photographing; carrying out a frame extraction operation on the acquired panoramic video to obtain a corresponding panoramic video frame, carrying out significant target detection on the panoramic video frame, tracking a detected significant target by using a preset target tracking algorithm, and acquiring a viewing angle at which the tracked significant target is located; and clipping the panoramic video according to the advancing-direction viewing angle and the viewing angle at which the significant target is located, so as to generate a target video corresponding to the panoramic video. A panoramic video is automatically clipped, and the fluency of transitions, and the effectiveness and the degree to which content in a target video is interesting are also ensured.

Panorama video editing method, apparatus,device and storage medium

The present invention provides a generation method for a 3D asteroid dynamic map and a portable terminal. The method comprises: obtaining a panorama image; identifying the panorama image and segmenting into a sky region, a human body region, and a ground region; calculating a panoramic depth map for the sky region, the human body region, and the ground region; respectively transforming the panorama image and the panoramic depth map to generate an asteroid image and an asteroid depth map; generating an asteroid view under a virtual viewpoint; and rendering to generate a 3D asteroid dynamic map. By automatically generating the asteroid view under the virtual viewpoint, and synthesizing and rendering same, the technical solution of the present invention generates the asteroid dynamic map having a 3D effect from the panorama image.

Generation method for 3D asteroid dynamic map and portable terminal

Provided are an automatic video editing method and a portable terminal, the method comprising: obtaining a video to be edited; extracting key frames of the video to be edited; inputting the key frames to a pre-trained scene classification method and a pre-trained target detection method, and respectively obtaining scene type markers and target object markers of the key frames; selecting multiple video segments from the video to be edited which satisfy preset editing criteria; respectively calculating average scores of the multiple video segments by means of a pre-trained image quality scoring method; respectively obtaining the video segment having the highest average score of each shot type for splicing.

Automatic video editing method and portable terminal

The present invention relates to the field of panoramic cameras, and provides a method for tracking a target in a panoramic video, and a panoramic camera. The method is used to track a target in a panoramic video on the basis of a multi-scale correlation filter, and employs automatic electronic pan-tilt-zoom technology. The present invention provides more robust tracking, faster processing speeds, a greater range of application in different tracking scenarios, and can be used to ensure that a tracked target is always at the center of the screen.

Method for tracking target in panoramic video, and panoramic camera

The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.

Anti-shake method for panoramic video, and portable terminal

Provided in the present invention are a method for achieving a bullet time capturing effect and a panoramic camera. The method comprises: acquiring a panoramic video captured when a panoramic camera rotates around a capture target; acquiring from within the panoramic video hemispherical images close to the side of the capture target; splicing the hemispherical images to generate a spliced image; and fixing a viewpoint of the spliced image, thus achieving a bullet time capturing effect. According to the present invention, only one panoramic camera is needed to be able to capture the bullet time capturing effect, so that the capturing cost of the bullet time capturing effect in the present invention is low. Meanwhile, since the bullet time capturing effect is obtained by means of a panoramic video being captured when a panoramic camera rotates around a capture target and processing being carried out on the panoramic video, the precision is high.

Method for achieving bullet time capturing effect and panoramic camera

A panorama image alignment method method comprises: obtaining multipath spherical images; calculating rotation Euler angles between each spherical image and a middle portion, a left portion and a right portion of an adjacent spherical image according to a middle portion, a left portion and a right portion of each spherical image to obtain a first left portion rotation matrix and a second right portion rotation matrix; obtaining a first left panorama image, a first right panorama image, a second left panorama image and a second right panorama image; aligning the second left panorama image to the first left panorama image, obtaining a second left portion rotation matrix by means of calculation, and then obtaining a rotation matrix of a left panorama; aligning the second right panorama image to the first right panorama image, obtaining a second right portion rotation matrix by means of calculation, and obtaining a rotation matrix of a right panorama.

Panorama image alignment method and device based on multipath images, and portable terminal

The present application is applicable in the field of videos. Provided are a method and system for panoramic video stabilization, and a portable terminal. The method comprises: acquiring in real time the timestamp of a current state, an accelerometer count value, and an angular velocity value of a portable terminal; estimating the rotation vector of the current state by utilizing an Extended Kalman Filtering combined with the accelerometer count value and the angular velocity value; calculating a current rotation matrix via the Rodrigues' rotation formula on the basis of the rotation vector of the current state; and rotating a panoramic image on the basis of the current rotation matrix and producing a stabilized video frame. The present invention allows the stabilization of a jittering video frame and alleviates VR motion sickness.

Growing community of inventors

Shenzhen, China

Wenjie Jiang