Siemens Aktiengesellschaft

Siemens Medical Solutions Usa, Inc.

Siemens Healthcare Gmbh

Siemens Healthineers Ag

Siemens Corporation

Siemens Corporate Research, Inc.

Gareth Funka-Lea

Yefeng Zheng

Dorin Comaniciu

Jan Boese

Mingqing Chen

Ying Sun

Shaohua Kevin Zhou

Matthias John

Mehmet Akif Gulsun

Haofu Liao

Yucheng Tang

Leo John Grady

Terrence Chen

Saikiran Rapaka

Günter Lauritsch

Christopher Rohkohl

Noha Youssry El-Zehiry

Fernando Vega-Higuera

Charles Henri Florin

Kerstin Mueller

Karim Amer

Puneet Sharma

Andreas Greiser

Edgar Mueller

Viorel Mihalef

Norbert Strobel

Jens Gühring

Wen Wu

Razvan Ioan Ionasec

Thomas J O'Donnell

Peng Wang

Huseyin Tek

Nikolaos Paragios

Romain Moreau-Gobard

Ravi Kumar

James Williams

Hua Zhong

Alexey Tsymbal

Dime Vitanovski

Yuri Boykov

Guenter Lauritsch

Athira Jane Jacob

Athira Jacob

Ravi Bansal

Jeffrey Stoll

Tianzhou Wang

Luca Valente

Mickael Sonni Albert Ibrahim Ide

Jianhua Shen

For three-dimensional segmentation from two-dimensional intracardiac echocardiography imaging, the three-dimension segmentation is output by a machine-learnt multi-task generator. Rather than the brute force approach of training the generator from 2D ICE images to output a 2D segmentation, the generator is trained from 3D information, such as a sparse ICE volume assembled from the 2D ICE images. Where sufficient ground truth data is not available, computed tomography or magnetic resonance data may be used as the ground truth for the sample sparse ICE volumes. The generator is trained to output both the 3D segmentation and a complete volume (i.e., more voxels represented than in the sparse ICE volume). The 3D segmentation may be further used to project to 2D as an input with an ICE image to another network trained to output a 2D segmentation for the ICE image. Display of the 3D segmentation and/or 2D segmentation may guide ablation of tissue in the patient.

Three-dimensional segmentation from two-dimensional intracardiac echocardiography imaging

A computer-implemented method for updating a boundary segmentation, the method including receiving image data and an original boundary segmentation including a plurality of boundary points. A plurality of edges in the image data is detected and used to generate an edge map. A confidence for a boundary point in the original boundary segmentation is computed where the confidence is based on a distance between the boundary point and an edge point associated with at least one of the plurality of edges of the edge map, and based on the confidence a classification of the boundary point is determined. An updated boundary segmentation based on the classification of the boundary point is generated and then output.

Updating boundary segmentations

The disclosure relates to a method for determining a boundary about an area of interest in an image set. The includes obtaining the image set from an imaging modality and processing the image set in a convolutional neural network. The convolutional neural network is trained to perform the acts of predicting an inverse distance map for the actual boundary in the image set; and deriving the boundary from the inverse distance map. The disclosure also relates to a method of training a convolutional neural network for use in such a method, and a medical imaging arrangement.

Method of computing a boundary

For three-dimensional segmentation from two-dimensional intracardiac echocardiography imaging, the three-dimension segmentation is output by a machine-learnt multi-task generator. The machine-learnt multi-task generator is trained from 3D information, such as a sparse ICE volume assembled from the 2D ICE images. The machine-learnt multi-task generator is trained to output both the 3D segmentation and a complete volume. The 3D segmentation may be used to project to 2D as an input with an ICE image to another network trained to output a 2D segmentation for the ICE image. Display of the 3D segmentation and/or 2D segmentation may guide ablation of tissue in the patient.

A method and apparatus for extracting centerline representations of vascular structures in medical images is disclosed. A vessel orientation tensor for each of a plurality of voxels associated with the target vessel, such as a coronary artery, in a medical image, such as a coronary tomography angiography (CTA) image, using a trained vessel orientation tensor classifier. A flow field is estimated for the plurality of voxels associated with the target vessel in the medical image based on the vessel orientation tensor estimated for each of the plurality of voxels. A centerline of the target vessel is extracted based on the estimated flow field for the plurality of vessels associated with the target vessel in the medical image by detecting a path that carries maximum flow.

Method and system for extracting centerline representation of vascular structures in medical images via optimal paths in computational flow fields

A method and apparatus for machine learning based detection of vessel orientation tensors of a target vessel from a medical image is disclosed. For each of a plurality of voxels in a medical image, such as a computed tomography angiography (CTA), features are extracted from sampling patches oriented to each of a plurality of discrete orientations in the medical image. A classification score is calculated for each of the plurality of discrete orientations at each voxel based on the features extracted from the sampling patches oriented to each of the plurality of discrete orientations using a trained vessel orientation tensor classifier. A vessel orientation tensor at each voxel is calculated based on the classification scores of the plurality of discrete orientations at that voxel.

Method and system for machine learning based estimation of anisotropic vessel orientation tensor

A method and apparatus for learning based classification of vascular branches to distinguish falsely detected branches from true branches is disclosed. A plurality of overlapping fixed size branch segments are sampled from branches of a detected centerline tree of a target vessel extracted from a medical image of a patient. A plurality of 1D profiles are extracted along each of the overlapping fixed size branch segments. A probability score for each of the overlapping fixed size branch segments is calculated based on the plurality of 1D profiles extracted for each branch segment using a trained deep neural network classifier. The trained deep neural network classifier may be a convolutional neural network (CNN) trained to predict a probability of a branch segment being fully part of a target vessel based on multi-channel 1D input. A final probability score is assigned to each centerline point in the branches of the detected centerline tree based on the probability scores of the overlapping branch segments containing that centerline point. The branches of the detected centerline tree of the target vessel are pruned based on the final probability scores of the centerline points.

Method and system for machine learning based classification of vascular branches

The left ventricle epicardium is estimated in medical diagnostic imaging. C-arm x-ray data is used to detect an endocardium at different phases. The detected endocardium at the different phases is compared to sample endocardiums at different phases. The sample endocardiums have corresponding sample epicardiums. The transformation between the most similar sample endocardium or endocardiums over time and the detected endocardium over time is applied to the corresponding sample epicardium or epicardiums. The transformed sample epicardium over time is the estimated epicardium over time for the C-arm x-ray data.

Left ventricle epicardium estimation in medical diagnostic imaging

A method and system for contrast inflow detection in a sequence of fluoroscopic images is disclosed. Vessel segments are detected in each frame of a fluoroscopic image sequence. A score vector is determined for the fluoroscopic image sequence based on the detected vessel segments in each frame of the fluoroscopic image sequence. It is determined whether a contrast agent injection is present in the fluoroscopic image sequence based on the score vector. If it is determined that a contrast agent injection is present in the fluoroscopic image sequence, a contrast inflow frame, at which contrast agent inflow begins, is detected in the fluoroscopic image sequence based on the score vector.

Method and system for contrast inflow detection in 2D fluoroscopic images

A system and method for regression-based segmentation of the mitral valve in 2D+t cardiac magnetic resonance (CMR) slices is disclosed. The 2D+t CMR slices are acquired according to a mitral valve-specific acquisition protocol introduced herein. A set of mitral valve landmarks is detected in each 2D CMR slice and mitral valve contours are estimated in each 2D CMR slice based on the detected landmarks. A full mitral valve model is reconstructed from the mitral valve contours estimated in the 2D CMR slices using a trained regression model. Each 2D CMR slice may be a cine image acquired over a full cardiac cycle. In this case, the segmentation method reconstructs a patient-specific 4D dynamic mitral valve model from the 2D+t CMR image data.

Method and system for regression-based 4D mitral valve segmentation from 2D+t magnetic resonance imaging slices

Background information is subtracted from projection data in medical diagnostic imaging. The background is removed using data acquired in a single rotational sweep of a C-arm. The removal may be by masking out a target, leaving the background, in the data as constructed into a volume. For subtraction, the masked background information is projected to a plane and subtracted from the data representing the plane.

Subtraction of projection data in medical diagnostic imaging

A method and system for extracting coronary artery centerlines from 3D medical image volumes is disclosed. Heart chambers are segmented in a 3D volume. Coronary artery centerlines are initialized in the 3D volume coronary artery based on the segmented heart chambers. The coronary artery centerlines are locally refined based on a vesselness measure. A length of each coronary artery centerline is shrunk to verify that the coronary artery centerline is within a coronary artery. The coronary artery centerline is the extended using data-driven vessel tracing.

Method and system for coronary artery centerline extraction

A method and system for adaptive discriminant learning and measurement fusion for image based catheter tracking is disclosed. An adaptive discriminant model is trained online based on a tracked object, such as a pigtail catheter tip, in at least one previous frame of a fluoroscopic image sequence. The object is tracked in the current frame of the fluoroscopic image sequence based at least on the adaptive discriminant model trained online. The object may be tracked in the current frame based on a fusion of three types of measurement models including the adaptive discriminant model trained online, an object detection model trained offline, and an online appearance model.

Method and system for catheter tracking in fluoroscopic images using adaptive discriminant learning and measurement fusion

A method and system for segmentation and removal of pulmonary arteries, pulmonary veins, and a left atrial appendage from 3D medical image data, such as 3D computed tomography (CT) volumes, is disclosed. A global shape model is segmented for each of pulmonary arteries, pulmonary veins, and a left atrial appendage in a 3D volume. The segmented global shape model for each of the pulmonary arteries, pulmonary veins, and left atrial appendage is locally refined based in local voxel intensities in the 3D volume, resulting in a respective mask for each structure. The mask is used to remove voxels belonging to the pulmonary arteries, pulmonary veins, and left atrial appendage from the 3D volume in order to better visualize coronary arteries and bypass arteries.

Method and system for segmentation and removal of pulmonary arteries, veins, left atrial appendage

Growing community of inventors

Cranbury, NJ, United States of America

Gareth Funka-Lea