Video filtering object extraction and application via large language model

Abstract

Described herein are systems and methods that detect and filter objects from media content. In particular, a detection system accesses classifiers that can detect objects when applied to a video. The detection system receives a text input from a user interface identifying filtering criteria for outputs of the classifiers and inputs the filtering criteria to a filtering language model that produces a filtering object. The detection system presents the filtering object at the user interface. In response to a user accepting the filtering object, the detection system applies the classifiers to the video, which produces a set of detected objects. The detection system applies the filtering object to the detected objects by removing a subset of the detected objects that do not satisfy the filtering criteria and presents the video with the filtered set of detected objects highlighted within the video.