Method and system for multi-modal image super-resolution

Abstract

This disclosure relates generally to a method and system for multi-modal image super-resolution. Conventional methods for multi-modal image super-resolution are performed using joint image based filtering, deep learning and dictionary based approaches which require large datasets for training. Embodiments of the present disclosure provide a joint optimization based transform learning framework wherein a high-resolution (HR) image of target modality is reconstructed from a HR image of guidance modality and a low-resolution (LR) image of target modality. A set of parameters, transforms, coefficients and weight matrices are learnt jointly from a training data which includes a HR image of guidance modality, a LR image of target modality and a HR image of target modality. The learnt set of parameters are used for reconstructing a HR image of target modality. The disclosed joint optimization transform learning framework is used in remote sensing, environment monitoring and so on.