Category discovery using machine learning

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing novel category discovery. One of the methods includes generating first local feature tensors from a first training image; obtaining previous local feature tensors generated from a previous training image; generating a first similarity tensor representing a similarity between the first local feature tensors and the previous local feature tensors; obtaining a second similarity tensor for a second training image; processing, using a neural network, the first training image to generate a first training output representing a class prediction for the first training image; obtaining a second training output representing a class prediction for the second training image; and generating an update to the neural network from (i) a similarity between the first similarity tensor and the second similarity tensor and (ii) a similarity between the first training output and the second training output.