Branded Entertainment Network, Inc.

Nicolas M Bertagnolli

Tyler Folkman

Richard Ray Butler

Schubert R Carvalho

This invention classifies actions performed within a video clip, by receiving a video clip for analysis, where the video clip comprises a time sequence of video frames, applies a bottleneck attention mechanism to the frames in the clip to generate a reduced sequence of key-frames, applies a 2 dimensional (2D) convolutional neural network to the sequence of keyframes to obtain a 3D embedding tensor for each keyframe, applies a multi-headed attention mechanism to the 3D embedding tensors to generate a final action context, and apples a classification mechanism to the final action context to obtain a probability for each action class that indicates the likelihood that an action specified by the action class occurred in the video clip.

Growing community of inventors

Orem, UT, United States of America

Nicolas M Bertagnolli