Systems and methods for the segmentation of multi-modal image data

Abstract

There is provided a computer implemented method of automatic segmentation of three dimensional (3D) anatomical region of interest(s) (ROI) that includes predefined anatomical structure(s) of a target individual, comprising: receiving 3D images of a target individual, each including the predefined anatomical structure(s), each 3D image is based on a different respective imaging modality. In one implementation, each respective 3D image is inputted into a respective processing component of a multi-modal neural network, wherein each processing component independently computes a respective intermediate, and the intermediate outputs are inputted into a common last convolutional layer(s) for computing the indication of segmented 3D ROI(s). In another implementation, each respective 3D image is inputted into a respective encoding-contracting component a multi-modal neural network, wherein each encoding-contracting component independently computes a respective intermediate output. The intermediate outputs are inputted into a single common decoding-expanding component for computing the indication of segmented 3D ROI(s).