Video-based behavior recognition device and operation method therefor

Abstract

The present disclosure provides a video-based behavior recognition device comprising a synthesized channel frame provision unit generating highlight information by comparing channel frames corresponding to the respective channels among a plurality of channels and synthesizing the channel frames and the highlight information to provide a synthesized channel frame, a neural network unit providing a middle frame on the basis of the synthesized channel frame and a multi-frame convolution neural network, and a behavior recognition result provision unit providing a behavior recognition result on the basis of the middle frame and a weighted value generated according to the middle frame, and a method operating thereof. In the present disclosure, the behavior recognition result is provided on the basis of the multi-frame convolution neural network and the synthesized channel frame synthesized from the channel frames provided for the respective channels, and, thereby, an event occurrence in a video is more effectively detected.