Merck Sharp + Dohme Corp.

Gregory Goldmacher

Antong Chen

Bo Zhou

Yiqiao Liu

A method or system for training a convolutional neural network (CNN) for medical imaging analysis. The system pre-trains the CNN's encoder using a dataset of unlabeled 3D medical images. Each 3D image includes an annotated slice delineating a boundary of a lesion and multiple non-annotated 2D slices above and below the annotated slice. The system then fine-tunes the pre-trained encoder using an annotated 2D image dataset. The annotated 2D image dataset includes multiple 2D slices of lesions, each including an annotation that delineates a boundary of a corresponding lesion.

3D segmentation of lesions in CT images using self-supervised pretraining with augmentation

A system and method are disclosed for segmenting a set of two-dimensional CT slices corresponding to a lesion. In an embodiment, for each of at least a subset of the set of CT slices, the system inputs the CT slice into a plurality of branches of a trained segmentation block. Each branch of the segmentation block includes a convolutional neural network (CNN) with filters at a different scale, and produces a plurality of levels of output. The system generates, for each CT slice in the subset, feature maps for each level of output. The system generates a segmentation of each CT slice in the subset based on the feature maps of each level of output. The system aggregates the segmentations of each slice in the subset to generate a three-dimensional segmentation of the lesion. The system provides data representing the three-dimensional segmentation for display.

Progressively-trained scale-invariant and boundary-aware deep neural network for the automatic 3D segmentation of lung lesions

A system and method are disclosed for segmenting a set of two-dimensional CT slices corresponding to a lesion. In an embodiment, for each of at least a subset of the set of CT slices, the system inputs the CT slice into a plurality of branches of a trained segmentation block. Each branch of the segmentation block includes a convolutional neural network (CNN) with filters at a different scale, and produces one or more levels of output. The system generates, for each CT slice in the subset, feature maps for each level of output. The system generates a segmentation of each CT slice in the subset based on the feature maps of each level of output. The system aggregates the segmentations of each slice in the subset to generate a three-dimensional segmentation of the lesion. The system transmits data representing the three-dimensional segmentation to a user interface for display.

Growing community of inventors

Landsdale, PA, United States of America

Gregory Goldmacher