Method and system for assisting pathologist identification of tumor cells in magnified tissue images

Abstract

A method, system and machine for assisting a pathologist in identifying the presence of tumor cells in lymph node tissue is disclosed. The digital image of lymph node tissue at a first magnification (e.g., 40×) is subdivided into a multitude of rectangular 'patches.' A likelihood of malignancy score is then determined for each of the patches. The score is obtained by analyzing pixel data from the patch (e.g., pixel data centered on and including the patch) using a computer system programmed as an ensemble of deep neural network pattern recognizers, each operating on different magnification levels of the patch. A representation or 'heatmap' of the slide is generated. Each of the patches is assigned a color or grayscale value in accordance with (1) the likelihood of malignancy score assigned to the patch by the combined outputs of the ensemble of deep neural network pattern recognizers and (2) a code which assigns distinct colors (or grayscale values) to different values of likelihood of malignancy scores assigned to the patches.