Siemens Healthcare Gmbh

Siemens Healthineers Ag

Florin Cristian Ghesu

Dorin Comaniciu

Bogdan Georgescu

Tommaso Mansi

Shaohua Kevin Zhou

Dominik Neumann

Wen Hong Liu

Sasa Grbic

Ali Kamen

Yefeng Zheng

Vivek Kumar Singh

Li Zhang

Rui Liao

Shun P Miao

Anna Jerebko

Michael Kelm

Michael Wels

Daguang Xu

Olivier Pauly

Julian Krebs

Michael Sühling

Pierre De Tournemire

Cosmin Ionut Bercea

Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Method and system for image registration using an intelligent artificial agent

Intelligent multi-scale image parsing determines the optimal size of each observation by an artificial agent at a given point in time while searching for the anatomical landmark. The artificial agent begins searching image data with a coarse field-of-view and iteratively decreases the field-of-view to locate the anatomical landmark. After searching at a coarse field-of view, the artificial agent increases resolution to a finer field-of-view to analyze context and appearance factors to converge on the anatomical landmark. The artificial agent determines applicable context and appearance factors at each effective scale.

Intelligent multi-scale medical image landmark detection

Multi-scale deep reinforcement learning generates a multi-scale deep reinforcement model for multi-dimensional (e.g., 3D) segmentation of an object. In this context, segmentation is formulated as learning an image-driven policy for shape evolution that converges to the object boundary. The segmentation is treated as a reinforcement learning problem, and scale-space theory is used to enable robust and efficient multi-scale shape estimation. By learning an iterative strategy to find the segmentation, the learning challenges of end-to-end regression systems may be addressed.

Multi-scale deep reinforcement machine learning for N-dimensional segmentation in medical imaging

A method and system for automated spatially-consistent multi-scale detection of anatomical landmarks in medical images is disclosed. A discrete scale-space representation of a medical image of a patient is generated. A plurality of anatomical landmarks are detected at a coarsest scale-level of the discrete scale-space representation of the medical image using a respective trained search model trained at the coarsest scale-level for each of the plurality of anatomical landmarks. Spatial coherence of the detected anatomical landmarks is enforced by fitting a learned robust shape model of the plurality of anatomical landmarks to the detected anatomical landmarks at the coarsest scale-level to robustly determine a set of the anatomical landmarks within a field-of-view of the medical image. The detected landmark location for each of the landmarks in the set of anatomical landmarks is refined at each remaining scale-level of the discrete scale-space representation of the medical image using, for each landmark, a respective trained search model trained at each remaining scale-level and constrained based on the predicted landmark location at a previous scale-level.

Spatially consistent multi-scale anatomical landmark detection in incomplete 3D-CT data

Intelligent image parsing for anatomical landmarks and/or organs detection and/or segmentation is provided. A state space of an artificial agent is specified for discrete portions of a test image. A set of actions is determined, each specifying a possible change in a parametric space with respect to the test image. A reward system is established based on applying each action of the set of actions and based on at least one target state. The artificial agent learns an optimal action-value function approximator specifying the behavior of the artificial agent to maximize a cumulative future reward value of the reward system. The behavior of the artificial agent is a sequence of actions moving the agent towards at least one target state. The learned artificial agent is applied on a test image to automatically parse image content.

Intelligent medical image landmark detection

Growing community of inventors

Erlangen, Germany

Florin Cristian Ghesu