Automatic clinical workflow that recognizes and analyzes 2d and doppler modality echocardiogram images for automated cardiac measurements and the diagnosis, prediction and prognosis of heart disease

Abstract

An automated workflow performed by software executing on at least one processor includes receiving a plurality of echocardiogram images taken by an ultrasound device. A first filter separates the plurality of echocardiogram images by 2D images and Doppler modality images based on analyzing image metadata. A first neural network classifies the 2D images by view type, and a second neural network classifies the Doppler modality images by view type. A third neural network segments cardiac chambers in the 2D images and a fourth neural network segments the Doppler modality images to generate waveform traces, producing segmented 2D images and segmented Doppler modality images. Using both the sets of images, measurements of cardiac features for both left and right sides of the heart are calculated. The calculated measurements are compared with international cardiac guidelines to generate conclusions and a report is output highlighting the measurements that fall outside of the guidelines.