Detecting multi-object anomalies utilizing a low rank sparsity model

Abstract

Methods and systems for detecting anomalies in transportation related video footage. In an offline training phase, receiving video footage of a traffic location can be received. Also, in an offline training phase, event encodings can be extracted from the video footage and collected or compiled into a training dictionary. One or more input video sequences captured at the traffic location or a similar traffic location can be received in an online detection phase. Then, an event encoding corresponding to the input video sequence can be extracted. The event encoding can be reconstructed with a low rank sparsity prior model applied with respect to the training dictionary. The reconstruction error between actual and reconstructed event encodings can then be computed in order to determine if an event thereof is anomalous by comparing the reconstruction error with a threshold.