Combining domain knowledge and foundation models for one-shot medical image feature localization

Abstract

One-shot medical image feature localization techniques are provided that employ pretrained foundation models and domain knowledge. In an example, a computer-implemented method can comprise determining positions of target features within a target medical image of an anatomical region of a subject based on reference spatial relationships between the target features as defined in reference spatial information, and based on matching reference pixel features respectively associated with the target features with corresponding subsets of pixel features of the target medical image, wherein the reference pixel features comprise template image pixel features extracted from labeled versions of the target features as included in a template medical image depicting the anatomical region of a reference subject. The method further comprises generating label information for the target features identifying the target features and their positions and associating the label information with the target medical image.