Siemens Healthcare Gmbh

Pascal Ceccaldi

Mariappan S Nadar

Boris Mailhe

Youngjin Yoo

Benjamin L Odry

Xiao Chen

Mahmoud Mostapha

Peter Mountney

Eli Gibson

Serkan Cimen

Daniel Toth

Tommaso Mansi

Sebastien Piat

Tanja Kurzendorfer

Andrei Chekkoury

Sandro Braun

Nguyen Nguyen

Systems and methods for quantifying a shift of an anatomical object of a patient are provided. A 3D medical image of an anatomical object of a patient is received. An initial location of landmarks on the anatomical object in the 3D medical image is determined using a first machine learning network. A 2D slice depicting the initial location of the landmarks is extracted from the 3D medical image. The initial location of the landmarks in the 2D slice is refined using a second machine learning network. A shift of the anatomical object is quantified based on the refined location of the landmarks in the 2D slice. The quantified shift of the anatomical object is output.

Automated estimation of midline shift in brain ct images

For medical imaging such as MRI, machine training is used to train a network for segmentation using both the imaging data and protocol data (e.g., meta-data). The network is trained to segment based, in part, on the configuration and/or scanner, not just the imaging data, allowing the trained network to adapt to the way each image is acquired. In one embodiment, the network architecture includes one or more blocks that receive both types of data as input and output both types of data, preserving relevant features for adaptation through at least part of the trained network.

Protocol-aware tissue segmentation in medical imaging

Systems and methods for automatic segmentation of lesions from a 3D input medical image are provided. A 3D input medical image depicting one or more lesions is received. The one or more lesions are segmented from one or more 2D slices extracted from the 3D input medical image using a trained 2D segmentation network. 2D features are extracted from results of the segmentation of the one or more lesions from the one or more 2D slices. The one or more lesions are segmented from a 3D patch extracted from the 3D input medical image using a trained 3D segmentation network. 3D features are extracted from results of the segmentation of the one or more lesions from the 3D patch. The extracted 2D features and the extracted 3D features are fused to generate final segmentation results. The final segmentation results are output.

Automatic detection of lesions in medical images using 2D and 3D deep learning networks

Method and system for image registration or image segmentation. The method includes receiving an image which is to be processed by a first machine-learning model to perform, for example, image registration or segmentation, and using a second machine-learning model to determine if the received image is of a quality suitable for the first machine-learning model to act upon.

Method and system for image analysis

For saliency mapping, a machine-learned classifier is used to classify input data. A perturbation encoder is trained and/or applied for saliency mapping of the machine-learned classifier. The training and/or application (testing) of the perturbation encoder uses less than all feature maps of the machine-learned classifier, such as selecting different feature maps of different hidden layers in a multiscale approach. The subset used is selected based on gradients from back-projection. The training of the perturbation encoder may be unsupervised, such as using an entropy score, or semi-supervised, such as using the entropy score and a difference of a perturbation mask from a ground truth segmentation.

Saliency mapping by feature reduction and perturbation modeling in medical imaging

In a system and method for analyzing images, an input image is provided to a computer and is processed therein with a first deep learning model so as to generate an output result for the input image; and applying a second deep learning model is applied to the input image to generate an output confidence score that is indicative of the reliability of any output result from the first deep learning model for the input image.

Method and system for generating a confidence score using deep learning model

For artifact reduction in a magnetic resonance imaging system, deep learning trains an image-to-image neural network to generate an image with reduced artifact from input, artifacted MR data. For application, the image-to-image network may be applied in real time with a lower computational burden than typical post-processing methods. To handle a range of different imaging situations, the image-to-image network may (a) use an auxiliary map as an input with the MR data from the patient, (b) use sequence metadata as a controller of the encoder of the image-to-image network, and/or (c) be trained to generate contrast invariant features in the encoder using a discriminator that receives encoder features.

Artifact reduction by image-to-image network in magnetic resonance imaging

A method of training a computer system for use in determining a transformation between coordinate frames of image data representing an imaged subject. The method trains a learning agent according to a machine learning algorithm, to determine a transformation between respective coordinate frames of a number of different views of an anatomical structure simulated using a 3D model. The views are images containing labels. The learning agent includes a domain classifier comprising a feature map generated by the learning agent during the training operation. The classifier is configured to generate a classification output indicating whether image data is synthesized or real images data. Training includes using unlabeled real image data to training the computer system to determine a transformation between a coordinate frame of a synthesized view of the imaged structure and a view of the structure within a real image. This is done whilst deliberately reducing the ability of the domain classifier to discriminate between a synthesized image and a real image of the structure.

Method, learning apparatus, and medical imaging apparatus for registration of images

Systems and methods are provided for synthesizing protocol independent magnetic resonance images. A patient is scanned by a magnetic resonance imaging system to acquire magnetic resonance data. The magnetic resonance data is input to a machine learnt generator network trained to extract features from input magnetic resonance data and synthesize protocol independent images using the extracted features. The machine learnt generator network generates a protocol independent segmented magnetic resonance image from the input magnetic resonance data. The protocol independent magnetic resonance image is displayed.

Image standardization using generative adversarial networks

Systems and methods are provided for generating segmented output from input regardless of the resolution of the input. A single trained network is used to provide segmentation for an input regardless of a resolution of the input. The network is recursively trained to learn over large variations in the input data including variations in resolution. During training, the network refines its prediction iteratively in order to produce a fast and accurate segmentation that is robust across resolution differences that are produced by MR protocol variations.

Deep reinforcement learning for recursive segmentation

Systems and methods are provided for correcting motion artifacts in magnetic resonance images. An image-to-image neural network is used to generate motion corrected magnetic resonance data given motion corrupted magnetic resonance data. The image-to-image neural network is coupled within an adversarial network to help refine the generated magnetic resonance data. The adversarial network includes a generator network (the image-to-image neural network) and a discriminator network. The generator network is trained to minimize a loss function based on a Wasserstein distance when generating MR data. The discriminator network is trained to differentiate the motion corrected MR data from motion artifact free MR data.

Motion artifact reduction of magnetic resonance images with an adversarial trained network

Systems and methods are provided for generating a protocol independent image. A deep learning generative framework learns to recognize the boundaries and classification of tissues in an MRI image. The deep learning generative framework includes an encoder, a decoder, and a discriminator network. The encoder is trained using the discriminator network to generate a latent space that is invariant to protocol and the decoder is trained to generate the best output possible for brain and/or tissue extraction.

Growing community of inventors

Princeton, NJ, United States of America

Pascal Ceccaldi