Dynamic multimodal segmentation selection and fusion

Abstract

Techniques are described that facilitate dynamic multimodal segmentation selection and fusion in medical imaging. In one example embodiment, a computer processing system receives a segmentation dataset comprising a combination of different image segmentations of an anatomical object of interest respectively segmented via different segmentation models from different medical images captured of the (same) anatomical object, wherein the different medical images and the different image segmentations vary with respect to at least one of, capture modality, acquisition protocol, or acquisition parameters. The system employs a dynamic ranking protocol as opposed to a static ranking protocol to determine ranking scores for the different image segmentations that control relative contributions of the different image segmentations in association with combining the different image segmentations into a fused segmentation for the anatomical object. The system further combines the different image segmentations based on the ranking scores to generate the fused image segmentation.