Method and system for time-series adaptive domain-aware captioning

Abstract

A method and a system for generating domain-aware captions for time-series images that are capable of adapting to new domains without retraining are provided. The method includes: receiving information that relates to a first time-series image that is associated with a target domain; generating a generic caption for the first time-series image; extracting, from a memory based on the generic caption, a plurality of image-caption pairs; generating, for each respective one of the plurality of image-caption pairs, a corresponding domain-agnostic caption that includes information that describes a shape of the respective image; and adapting the generic caption into a domain-specific caption for the first time-series image that relates to the target domain. The generating of domain-agnostic captions and domain-specific captions may be performed by using models that are respectively trained based on synthetic time series images having captions that correspond to a set of parameters.