Multi arm machine learning models with attention for lesion segmentation

Abstract

Embodiments disclosed herein generally relate to multi-arm machine learning models for lesion detection. Particularly, aspects of the present disclosure are directed to accessing a three-dimensional magnetic resonance imaging (MRI) images. Each of the three-dimensional MRI images depict a same volume of a brain of a subject. The volume of the brain includes at least part of one or more lesions. Each three-dimensional MRI image of the three-dimensional MRI images is processed using one or more corresponding encoder arms of a machine-learning model to generate an encoding of the three-dimensional MRI image. The encodings of the three-dimensional MRI images are concatenated to generate a concatenated representation. The concatenated representation is processed using a decoder arm of the machine-learning model to generate a prediction that identifies one or more portions of the volume of the brain predicted to depict at least part of a lesion.