Semi-supervised learning leveraging cross-domain data for medical imaging analysis

Abstract

Systems and methods for performing a medical imaging analysis task are provided. An input medical image in a first modality is received. Features are extracted from the input medical image using a first machine learning based encoding network. A medical imaging analysis task is performed on the input medical image based on the extracted features by, in one embodiment, decoding the extracted features to generate results of the medical imaging analysis task using a machine learning based decoding network. Results of the medical imaging analysis task are output. In one embodiment, the first machine learning based encoding network is jointly trained with a second machine learning based encoding network with an unsupervised loss using unannotated pairs of training images. Each of the unannotated pairs comprise a first training image in the first modality and a second training image in a second modality. In one embodiment, the first machine learning based encoding network is also jointly trained with the machine learning based decoding network with a supervised loss using annotated training images.