System and methods for multiple instance segmentation and tracking

Abstract

This disclosure provides for methods and a system for multiple instance segmentation and tracking. According to an aspect a method is provided. The method includes sending an image to a backbone network and generating image feature outputs. The method further includes sending the image feature outputs to a spatial attention module for generating a feature map associated with objects in the image. The method further includes sending the feature map to a category feature module for generating an instance category output indicating the objects. The method further includes sending the image feature outputs to a mask generating module for generating masks. The method further includes generating: the instance category output via the category feature module, and the masks via the mask generating module. In some embodiments, the method further includes generating re-identification embedding information associated with the objects based on image feature outputs.