Shanghai United Imaging Intelligence Co., Ltd.

Siemens Healthcare Gmbh

Siemens Aktiengesellschaft

Siemens Healthcare Diagnostics Gmbh

Siemens Corporation

Other

Siemens Medical Solutions Usa, Inc.

Siemens Energy, Inc.

Siemens Mobility Gmbh

Friedrich-alexander-universit&#xc4;t Erlangen-n&#xdc;rnberg

Terrence Chen

Shanhui Sun

Yao-Jen Chang

Zhang Chen

Xiao Chen

Dorin Comaniciu

Vivek Kumar Singh

Stefan Kluckner

Kai Ma

Benjamin S Pollack

Ziyan Wu

Wen Wu

Yikang Liu

Birgi Tamersoy

Arun Innanje

Peng Wang

Norbert Strobel

Abhishek Sharma

Martin Ostermeier

Ralf Nanke

Andreas Wimmer

Jan Ernst

Ali Kamen

Srikrishna Karanam

Peter Durlak

Andreas Krauss

Tommaso Mansi

Michael Wels

Alexander Brost

Simone Prummer

Susanne Oepping

Bogdan Georgescu

Shaohua Kevin Zhou

Puneet Sharma

Ying Zhu

Meng Zheng

Klaus J Kirchberg

Patrick Wissmann

Yimo Guo

Ahmet Tuysuzoglu

Jiangping Wang

Guillaume Dumont

Oliver Lehmann

Hanchao Yu

Rui Liao

Shun P Miao

Grzegorz Soza

Gareth Funka-Lea

Viorel Mihalef

Xiaoguang Lu

Alexander Michael Gigler

Brian Teixeira

Susanne Dornberger

Kevin P Bailey

Ruhan Sa

Qiaoying Huang

Thomas Pohl

Eberhard Ritzhaupt-Kleissl

Subhabrata Bhattacharya

Marcus Pfister

Atilla Peter Kiraly

Sasa Grbic

Tiziano Passerini

David D Liu

Maximilian Fleischer

Wei Zhang

Ankur Kapoor

Matthias John

Daphne Yu

Chao Yuan

Claus Neubauer

Günter Lauritsch

Joachim Hornegger

Yunqiang Chen

Thomas J O'Donnell

Andreas Meyer

Anton Nekovar

Mingqing Chen

Charles Henri Florin

Michael Fuhrmann

Jiang Tian

Olivier Ecabert

Ralph Grothmann

Markus Rossmeier

Martin Bischoff

Ulrich Bill

Oliver Hennig

John Paulus, Jr

Guenter Lauritsch

Sara Good

Oliver Baruth

Jeremy Ralph Wiles

Sarfaraz Hussein

Renbin Peng

Jeffrey Stoll

Benjamin Planche

Johann Kim

Tobias Heimann

Puyang Wang

Martin Willibald Koch

Described herein are systems, methods, and instrumentalities associated with using a multi-layer perceptron (MLP) neural network to process medical images of an anatomical structure. The processing may include padding an input image in accordance with the training of the MLP neural network, splitting the input image (e.g., the padded input image) into patches of a same size, and processing the patches through the MLP neural network over one or more iterations. During an iteration of the processing, the patches may be processed separately and re-combined into an intermediate image before the intermediate image is shifted to concatenate portions of the image that are derived from different patches. This way, global features of the anatomical structure may be learned and used to improve the quality of the image generated by the MLP neural network, without incurring significant computation or memory costs.

Systems and methods for processing medical images with multi-layer perceptron neural networks

A method and a system for managing healthcare records of a user are provided. The method includes storing an electronic medical record related to the user in form of a non-fungible token (NFT) written to a blockchain, associating a smart contract to the NFT in the blockchain, authorizing a request to access the electronic medical record related to the user based on the defined ownership of the electronic medical record stored in the blockchain, identifying one or more NFTs from the blockchain comprising one or more electronic medical records related to the user based on processing of the identifier information in associated one or more smart contracts therewith, in response to the request, and sending the one or more electronic medical records corresponding to the identified one or more NFTs to a requestor associated with the request.

Patient care record management system

Deblurring and denoising a medical image such as X-ray fluoroscopy images may be challenging, and deep-learning based techniques may be employed to meet the challenge. An artificial neural network (ANN) may be trained using training images with synthetic noise and as well as training images with real noise. The parameters of the ANN may be adjusted during the training based on at least a first loss designed to maintain continuity between consecutive medical images generated by the ANN and a second loss designed to maintain similarity of patches inside a medical image generated by the ANN. The parameters of the ANN may be further adjusted based on a third loss that may be calculated from ground truth associated with the synthetic training images. Transfer learning between the synthetic images and the real images may be accomplished using these techniques.

Systems and methods for deblurring and denoising medical images

Described herein are systems, methods, and instrumentalities associated with segmenting and/or determining the shape of an anatomical structure. An artificial neural network (ANN) is used to perform these tasks based on a statistical shape model of the anatomical structure. The ANN is trained by evaluating and backpropagating multiple losses associated with shape estimation and segmentation mask generation. The model obtained using these techniques may be used for different clinical purposes including, for example, motion estimation and motion tracking.

Image segmentation and tracking based on statistical shape model

Described herein are systems, methods, and instrumentalities associated with using an invertible neural network to complete various medical imaging tasks. Unlike traditional neural networks that may learn to map input data (e.g., a blurry reconstructed MRI image) to ground truth (e.g., a fully-sampled MRI image), the invertible neural network may be trained to learn a mapping from the ground truth to the input data, and may subsequently apply an inverse of the mapping (e.g., at an inference time) to complete a medical imaging task. The medical imaging task may include, for example, MRI image reconstruction (e.g., to increase the sharpness of a reconstructed MRI image), image denoising, image super-resolution, and/or the like.

Systems and methods for processing medical images with invertible neural networks

A 3D anatomical model of one or more blood vessels of a patient may be obtained using CT angiography, while a 2D image of the blood vessels may be obtained based on fluoroscopy. The 3D model may be registered with the 2D image based on a contrast injection site identified on the 3D model and/or in the 2D image. A fused image may then be created to depict the overlaid 3D model and 2D image, for example, on a monitor or through a virtual reality headset. The injection site may be determined automatically or based on a user input that may include a bounding box drawn around the injection site on the 3D model, a selection of an automatically segmented area in the 3D model, etc.

Systems and methods for medical image fusion

Embodiments provide a method of using image-based tube top circle detection based on multiple candidate selection to localize the tube top circle region in input images. According to embodiments provided herein, the multi-candidate selection enhances the robustness of tube circle detection by making use of multiple views of the same tube to improve the robustness of tube top circle detection. With multiple candidates extracted from images under different viewpoints of the same tube, the multi-candidate selection algorithm selects an optimal combination among the candidates and provides more precise measurement of tube characteristics. This information is invaluable in an IVD environment in which a sample handler is processing the tubes and moving the tubes to analyzers for testing and analysis.

Image-based tube top circle detection with multiple candidates

An automated process for data annotation of medical images includes obtaining image data from an imaging sensor, partitioning the image data, identifying an object of interest in the partitioned image data, generating an initial contour with one or more control points with respect to the object of interest, identifying a manual adjustment of one of the control points, automatically adjust a position of at least one other control point within a predetermined range of the manually adjusted control point to a new position, the new position of the at least one other control point and manually adjusted control point defining a new contour, and generating an updated image with the new contour and corresponding control points.

Interactive contour refinements for data annotation

An anatomy-aware contouring editing method includes receiving an image, wherein the image represents an anatomically recognizable structure; identifying a first image segment representing part of the anatomically recognizable structure; annotating the first image segment to generate a label of the part; drawing a contour along a boundary of the part; receiving a first input from a user device indicative of a region of contour failure, wherein the region of contour failure includes a portion of a contour that requires editing; editing the contour for generating an edited contour based on the first input and anatomical information; and updating another contour of another part of the anatomically recognizable structure based on the edited contour, wherein the another part is anatomically related to the part.

Anatomy-aware contour editing method and system for implementing said method

Described herein are systems, methods, and instrumentalities associated with image segmentation such as tubular structure segmentation. An artificial neural network is trained to segment tubular structures of interest in a medical scan image based on annotated images of a different type of tubular structures that may have a different contrast and/or appearance from the tubular structures of interest. The training may be conducted in multiple stages during which a segmentation model learned from the annotated images during a first stage may be modified to fit the tubular structures of interest in a second stage. In examples, the tubular structures of interest may include coronary arteries, catheters, guide wires, etc., and the annotated images used for training the artificial neural network may include blood vessels such as retina blood vessels.

Tubular structure segmentation

Described herein are systems, methods, and instrumentalities associated with medical image enhancement. The medical image may include an object of interest and the techniques disclosed herein may be used to identify the object and enhance a contrast between the object and its surrounding area by adjusting at least the pixels associated with the object. The object identification may be performed using an image filter, a segmentation mask, and/or a deep neural network trained to separate the medical image into multiple layers that respectively include the object of interest and the surrounding area. Once identified, the pixels of the object may be manipulated in various ways to increase the visibility of the object. These may include, for example, adding a constant value to the pixels of the object, applying a sharpening filter to those pixels, increasing the weight of those pixels, and/or smoothing the edge areas surrounding the object of interest.

Systems and methods for enhancing medical images

The present disclosure provides a system and method for fetus monitoring. The method may include obtaining ultrasound data relating to a fetus collected by an ultrasound imaging device; generating a 4D image of the fetus based on the ultrasound data; directing a display component of a virtual reality (VR) device to display the 4D image to an operator; detecting motion of the fetus based on the ultrasound data; and directing a haptic component of the VR device to provide haptic feedback with respect to the motion to the operator.

Systems and methods for fetus monitoring

Click based contour editing includes detecting a selection input with respect to an image presented on a graphical user interface; designating an area of the image corresponding to the selection input as a region of interest; detecting at least one other selection input on the graphical user interface with respect to the image; determining if the at least one other selection input is within the region of interest or outside of the region of interest; and if the at least one other selection input is within the region of interest, excluding the portion of the image corresponding to the other input; or if the other selection input is outside of the region of interest, including the portion of the image corresponding to an area of the image associated with the other selection input.

Click based contour editing

Deep learning based systems, methods, and instrumentalities are described herein for registering images from a same imaging modality and different imaging modalities. Transformation parameters associated with the image registration task are determined using a neural ordinary differential equation (ODE) network that comprises multiple layers, each configured to determine a respective gradient update for the transformation parameters based on a current state of the transformation parameters received by the layer. The gradient updates determined by the multiple ODE layers are then integrated and applied to initial values of the transformation parameters to obtain final parameters for completing the image registration task. The operations of the ODE network may be facilitated by a feature extraction network pre-trained to determine content features shared by the input images. The input images may be resampled into different scales, which are then processed by the ODE network iteratively to improve the efficiency of the ODE operations.

Image registration

Described herein are systems, methods, and instrumentalities associated with processing complex-valued MRI data using a machine learning (ML) model. The ML model may be learned based on synthetically generated MRI training data and by applying one or more meta-learning techniques. The MRI training data may be generated by adding phase information to real-valued MRI data and/or by converting single-coil MRI data into multi-coil MRI data based on coil sensitivity maps. The meta-learning process may include using portions of the training data to conduct a first round of learning to determine updated model parameters and using remaining portions of the training data to test the updated model parameters. Losses associated with the testing may then be determined and used to refine the model parameters. The ML model learned using these techniques may be adopted for a variety of tasks including, for example, MRI image reconstruction and/or de-noising.

Systems and methods for MRI data processing

Growing community of inventors

Princeton, NJ, United States of America

Terrence Chen