Constructor Technology Ag

Constructor Education and Research Genossenschaft

Andrei Boiarov

Stanislav Protasov

Serg Bell

Sergey Ulasen

Nikolay Dobrovolskiy

Ilya Shimchik

Kseniia Alekseitseva

Anton Kivich

Systems and methods for automatic generation of highlights of video. The system includes a video processor to select one type of the video to be analyzed and split video clips from the video. The video processor recognizes positive clips, negative clips, and auxiliary clips. A spatio-temporal encoder is configured to select, from the recognized clips, a main positive clip, a main negative clip, and auxiliary positive and negative clips, and generate a three-dimensional (3D) embedding vector of each clip. The selected clips are processed by a ranking network having a self-attention layer. The self-attention layer, using a query head, a key head and the value head produces self-attention resultant vector on which an activation function is performed. A rank value is thus obtained for the selected clip. Based on the rank value, video highlights are generated.

System and method for automatic video summarization

Growing community of inventors

Sofia, Bulgaria

Andrei Boiarov