Siemens Healthcare Gmbh

Ping an Technology (Shenzhen) Co., Ltd.

Siemens Aktiengesellschaft

Siemens Medical Solutions USA, Inc.

The University of British Columbia

Siemens Healthineers Ag

Chang Gung Memorial Hospital, Linkou

Institut National De Recherche En Informatique Et En Automatique

Shun P Miao

Rui Liao

Tommaso Mansi

Le Lu

Dorin Comaniciu

Bogdan Georgescu

Daphne Yu

Kaloian Petkov

Daguang Xu

Julian Krebs

Ali Kamen

Vivek Kumar Singh

Sasa Grbic

Li Zhang

Adam Patrick Harrison

Florin Cristian Ghesu

Terrence Chen

Shaohua Kevin Zhou

Tiziano Passerini

Klaus Engel

Christophe Chefd'hotel

Sandra Sudarsky

Dakai Jin

Puneet Sharma

Shanhui Sun

Yefeng Zheng

Boris Mailhe

Marcus Pfister

Michael Suehling

Zhoubing Xu

Peter Mountney

Thomas Pheiffer

Nicholas Ayache

Mingqing Chen

Alexander Brost

Michael Sühling

Kang Zheng

Yirui Wang

Ahmet Tuysuzoglu

Pierre De Tournemire

Jiannan Zheng

Fakai Wang

Chen Liu

Weijian Li

Yuhang Lu

Jinzheng Cai

Ryan Leonard Spilker

Yue Zhang

Ke P Yan

Daniel Toth

Sebastien Piat

Dong Yang

Chang-Fu Kuo

Xianjun Sam Zheng

Herve Delingette

Erin Girard

Tanja Kurzendorfer

Tobias Heimann

Youbao Tang

Pavlo Dyban

Zhen Wang

He Zhang

Chen-I Hsieh

Changfu Kuo

Xiaoyun Zhou

Zengming Shen

Sébastien Piat

Haomin Chen

Joseph Lucas

Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Method and system for image registration using an intelligent artificial agent

A method of opportunistic screening of osteoporosis includes obtaining a plain film chest X-ray (CXR); extracting regions of interest (ROIs) from the plain film CXR; and providing individual bone mineral density (BMD) scores corresponding to the extracted ROIs and a joint BMD corresponding to the plain film CXR based on a multi-ROI model by performing: inputting the extracted ROIs into a backbone network to generate individual feature vectors, each individual feature vector corresponding to one of the extracted ROIs; concatenating the individual feature vectors into a joint feature vector; individually decoding the individual feature vectors by a shared fully connected (FC) layer to generate the individual BMDs, each individual BMD corresponding to one of the individual feature vectors; and decoding the joint feature vector by a separate FC layer to generate the joint BMD.

Method, system, and storage medium for opportunistic screening of osteoporosis using plain film chest X-ray (CXR)

Knowledge distillation method for fracture detection includes obtaining medical images including region-level labeled images, image-level diagnostic positive images, and image-level diagnostic negative images, in chest X-rays; performing a supervised pre-training process on the region-level labeled images and the image-level diagnostic negative images to train a neural network to generate pre-trained weights; and performing a semi-supervised training process on the image-level diagnostic positive images using the pre-trained weights. A teacher model is employed to produce pseudo ground-truths (GTs) on the image-level diagnostic positive images for supervising training of a student model, and the pseudo GTs are processed by an adaptive asymmetric label sharpening (AALS) operator to produce sharpened pseudo GTs to provide positive detection responses on the image-level diagnostic positive images.

Knowledge distillation with adaptive asymmetric label sharpening for semi-supervised fracture detection in chest x-rays

The present disclosure describes a computer-implemented method for image landmark detection. The method includes receiving an input image for the image landmark detection, generating a feature map for the input image via a convolutional neural network, initializing an initial graph based on the generated feature map, the initial graph representing initial landmarks of the input image, performing a global graph convolution of the initial graph to generate a global graph, where landmarks in the global graph move closer to target locations associated with the input image, and iteratively performing a local graph convolution of the global graph to generate a series of local graphs, where landmarks in the series of local graphs iteratively move further towards the target locations associated with the input image.

Structured landmark detection via topology-adapting deep graph learning

The present disclosure provides a computer-implemented method, a device, and a computer program product for radiographic bone mineral density (BMD) estimation. The method includes receiving a plain radiograph, detecting landmarks for a bone structure included in the plain radiograph, extracting an ROI from the plain radiograph based on the detected landmarks, estimating the BMD for the ROI extracted from the plain radiograph by using a deep neural network.

Estimating bone mineral density from plain radiograph by assessing bone texture with deep learning

A vertebra localization and identification method includes: receiving one or more images of vertebrae of a spine; applying a machine learning model on the one or more images to generate three-dimensional (3-D) vertebra activation maps of detected vertebra centers; performing a spine rectification process on the 3-D vertebra activation maps to convert each 3-D vertebra activation map into a corresponding one-dimensional (1-D) vertebra activation signal; performing an anatomically-constrained optimization process on each 1-D vertebra activation signal to localize and identify each vertebra center in the one or more images; and outputting the one or more images, wherein on each of the one or more outputted images, a location and an identification of each vertebra center are specified.

Method and device for vertebra localization and identification

A method and system for deep learning based cardiac electrophysiological model personalization is disclosed. Electrophysiological measurements of a patient, such as an ECG trace, are received. A computational cardiac electrophysiology model is personalized by calculating patient-specific values for a parameter of the computational cardiac electrophysiology model based at least on the electrophysiological measurements of the patient using a trained deep neural network (DNN). The parameter of the computational cardiac electrophysiology model corresponds to a spatially varying electrical cardiac tissue property.

System and method for deep learning based cardiac electrophysiology model personalization

An image segmentation method includes generating a CTN (contour transformer network) model for image segmentation, where generating the CTN model includes providing an annotated image, the annotated image including an annotated contour, providing a plurality of unannotated images, pairing the annotated image to each of the plurality of unannotated images to obtain a plurality of image pairs, feeding the plurality of image pairs to an image encoder to obtain a plurality of first-processed image pairs, and feeding the plurality of first-processed image pairs to a contour tuner to obtain a plurality of second-processed image pairs.

Method and system for image segmentation using a contour transformer network model

The present disclosure provides a method, a device, and a computer program product using a self-supervised anatomical embedding (SAM) method. The method includes randomly selecting a plurality of images; for each image of the plurality of images, performing random data augmentation to obtain a patch pair, generating global and local embedding tensors for each patch of the patch pair, and selecting positive pixel pairs from the patch pair and obtaining positive embedding pairs; for each positive pixel pair, computing global and local similarity maps, finding global hard negative embeddings, selecting global random negative embeddings, pooling the global hard negative embeddings and the global random negative embeddings to obtain final global negative embeddings, and finding local hard negative embeddings using the global and local similarity maps, and randomly sampling final local negative embeddings from the local hard negative embeddings; and minimizing a final info noise contrastive estimation (InfoNCE) loss.

Method, device, and computer program product for self-supervised learning of pixel-wise anatomical embeddings in medical images

For registration of medical images with deep learning, a neural network is designed to include a diffeomorphic layer in the architecture. The network may be trained using supervised or unsupervised approaches. By enforcing the diffeomorphic characteristic in the architecture of the network, the training of the network and application of the learned network may provide for more regularized and realistic registration.

Medical imaging diffeomorphic registration based on machine learning

For non-invasive EP mapping, a sparse number of electrodes (e.g., 10 in a typical 12-lead ECG exam setting) are used to generate an EP map without requiring preoperative 3D image data (e.g. MR or CT). An imager (e.g., a depth camera) captures the surface of the patient and may be used to localize electrodes in any positioning on the patient. Two-dimensional (2D) x-rays, which are commonly available, and the surface of the patient are used to segment the heart of the patient. The EP map is then generated from the surface, heart segmentation, and measurements from the electrodes.

Non-invasive electrophysiology mapping based on affordable electrocardiogram hardware and imaging

A method and system for 3D/3D medical image registration. A digitally reconstructed radiograph (DRR) is rendered from a 3D medical volume based on current transformation parameters. A trained multi-agent deep neural network (DNN) is applied to a plurality of regions of interest (ROIs) in the DRR and a 2D medical image. The trained multi-agent DNN applies a respective agent to each ROI to calculate a respective set of action-values from each ROI. A maximum action-value and a proposed action associated with the maximum action value are determined for each agent. A subset of agents is selected based on the maximum action-values determined for the agents. The proposed actions determined for the selected subset of agents are aggregated to determine an optimal adjustment to the transformation parameters and the transformation parameters are adjusted by the determined optimal adjustment. The 3D medical volume is registered to the 2D medical image using final transformation parameters resulting from a plurality of iterations.

Dilated fully convolutional network for 2D/3D medical image registration

A method for performing computer-aided diagnosis (CAD) based on a medical scan image includes: pre-processing the medical scan image to produce an input image, a flipped image, and a spatial alignment transformation corresponding to the input image and the flipped image; performing Siamese encoding on the input image to produce an encoded input feature map; performing Siamese encoding on the flipped image to produce an encoded flipped feature map; performing a feature alignment using the spatial alignment transformation on the encoded flipped feature map to produce an encoded symmetric feature map; and processing the encoded input feature map and the encoded symmetric feature map to generate a diagnostic result indicating presence and locations of anatomical abnormalities in the medical scan image.

Device and method for computer-aided diagnosis based on image

Growing community of inventors

Bethesda, MD, United States of America

Shun P Miao