Siemens Healthcare Gmbh

Roman Schaffert

Anja Borsdorf

Jian Min Wang

Markus Weiss

The disclosure relates to a computer-implemented method for the provision of a transformation instruction for registering a 2D image with a 3D image. The method includes: receiving the 2D image and the 3D image; generating input data based on the 2D image having contour pixels and the 3D image having contour voxels; applying a trained function to the input data for identification of contour pixels of the 2D image and contour voxels of the 3D image, wherein at least one parameter of the trained function is adjusted based on a comparison of training contour pixels with comparison contour pixels and a comparison of training contour voxels corresponding thereto with comparison contour voxels; determining the transformation instruction based on the identified contour pixels of the 2D image and the contour voxels corresponding thereto of the 3D image for registering the 2D image with the 3D image; and providing the transformation instruction.

Registering a two-dimensional image with a three-dimensional image

A method for determining or updating a registration between a 3D image of a region of interest and a set of at least two 2D images of the same region of interest includes selecting at least one respective contour point in the 3D image for each 2D image. A 2D position of a respective depiction of each contour point is determined in the respective 2D image. At least one condition for the registration parameters that needs to be fulfilled is determined, for each contour point, to map the respective contour point to the respective 2D position in the respective 2D image. An updated set of registration parameters is determined by solving a set of equations or an optimization problem that depends on the conditions.

Determining a registration between a 3D image and a set of at least two 2D images

A method includes, following specification of an initial transformation as a test transformation that is to be optimized, determining a 2D gradient x-ray image and a 3D gradient dataset of the image dataset, carrying out, for each image element of the gradient comparison image, a check for selection as a contour point, and determining an environment best corresponding to a local environment of the contour point and extending around a comparison point in the gradient x-ray image for all contour points in the at least one gradient comparison image. Local 2D displacement information is determined by comparing the contour points with the associated comparison points, and motion parameters of a 3D motion model describing a movement of the target region between the acquisition of the image dataset and the x-ray image are determined from the displacement information and a registration transformation describing the registration.

Growing community of inventors

Erlangen, Germany

Roman Schaffert