Siemens Medical Solutions USA, Inc.

Siemens Aktiengesellschaft

Siemens Corporate Research, Inc.

Siemens Corporation

Ali Khamene

Frank Sauer

Sebastian Vogt

Chenyang Xu

Fred S Azar

Benedicte Bascle

Eike Rietzel

Charles Henri Florin

Leo John Grady

Nassir Navab

Rui Liao

John V Frangioni

Gabriel Haras

Gianluca Paladini

Bruce J Tromberg

Jens Gühring

Christoph Guetter

James P Williams

Yiyong Sun

Thomas Boettger

Shmuel Aharon

Mikael Rousson

Wolfgang Wein

Juan Carlos Celi

Albert E Cerussi

Fabrice Francis Michel

Stefan Käpplinger

Oliver Fluck

Oliver Kutter

Frederik Bender

Tina Ehtiati

Therese Velde

Sebastian Kassner

Barbara Ofstad

Christian Schaller

Lars Schimmang

Vida Kianzad

Martin W Masters

A system and method for instrument placement using an image based navigation system is disclosed. A target of interest is identified in a medical image of a patient. An image plane is displayed that goes through a center of the target. The image plane has a configurable orientation. The image plane is used to select a path for an instrument from a position on the patient's skin to the center of the target. A trajectory plane is viewed from a tip of the instrument to the center of the target. The trajectory plane reflects an orientation of the instrument. A particular trajectory plane is selected that is representative of a desired orientation of the instrument. An image of the particular trajectory plane is frozen. The instrument can then be inserted using a virtual guide and is navigated toward the target.

Method for augmented reality instrument placement using an image based navigation system

A method and apparatus for presenting three-dimensional data to a physician is provided to facilitate the flexible navigation of an endoscope and surgical instruments with respect to anatomical structures. In accordance with a first embodiment a first set of data corresponding to a three dimensional model of a patient's anatomy is received. This three-dimensional model may be rendered from images taken in CT or MRI scanning, as discussed above. In accordance with this embodiment, this model is then combined with a second set of data corresponding to a view obtained from an endoscope. In another embodiment, the view from the illustrative endoscope is displayed as an inset image on the display of the three-dimensional image. In yet another embodiment, the three-dimensional image comprises a graphical representation of at least a first surgical instrument, such as said endoscope. The surgeon may select among various combinations of views and may zoom in or out from any particular view.

Method and apparatus for minimally invasive surgery using endoscopes

A method of determining a three-dimensional (3D) position of a catheter tip includes: compensating a 2D position of the tip of the catheter for respiratory motion to generate a compensated 2D catheter position, generating weighted sample points around the compensated 2D catheter position, determining correspondent points of the weighted sample points in a 3D image, computing a weighted mean and a weighted covariance of each correspondent point, and determining the 3D position of the catheter tip in the 3D image from a fusion of the weighted means and weighted covariances.

Method for dynamic road mapping

A diffuse optical spectroscopy system comprises a laser breast scanner, a handheld probe connected to the laser breast scanner for scanning a breast, and a tracking device coupled to the handheld probe, wherein the tracking device determines locations of the handheld probe relative to the breast. The tracking device comprises a magnetic tracking device, an optical tracking device or a laser tracking device.

Three-dimensional breast anatomy imaging system

A method for deformable registration of 2 digital images includes providing a pair of digital images, including a fixed image and a moving image, extracting a set of edge images from each image of the pair of images, each edge set being extracted at a different resolution, selecting a pair of edge images with a lowest resolution, determining a mapping from edge points of the fixed image to edge points of moving image using a geodesic thin plate spline interpolation, applying the mapping to a next higher resolution edge point image of the moving image, selecting a pair of edge images at a next higher resolution, where a moving edge image is the moving edge image to which the mapping has been applied, repeating the steps at a next higher resolution for all edge images in the set of edge images, and applying the mapping to an entire moving image.

System and method for geodesic image matching using edge points interpolation

A method for deformable registration including determining a vector field from a two-dimensional matching of a volume of an object of interest and a two-dimensional image of the object of interest, providing a deformation profile, and finding a volume deformation that maps to a state of the two-dimensional image, wherein the deformation is parameterized by the vector field and control points of the deformation profile to find a control point configuration of the volume deformation.

Deformable 2D-3D registration

A method for unsupervised classification of histological images of prostatic tissue includes providing histological image data obtained from a slide simultaneously co-stained with NIR fluorescent and Hematoxylin-and-Eosin (H&E) stains, segmenting prostate gland units in the image data, forming feature vectors by computing discriminating attributes of the segmented gland units, and using the feature vectors to train a multi-class classifier, where the classifier classifies prostatic tissue into benign, prostatic intraepithelial neoplasia (PIN), and Gleason scale adenocarcinoma grades 1 to 5 categories.

System and method for unsupervised detection and gleason grading of prostate cancer whole mounts using NIR fluorscence

Methods and systems dedicated to automatic object segmentation from image data are provided. In a first step a fuzzy seed set is generated that is learned from training data. The fuzzy seed set is registered to image data containing an object that needs to be segmented from a background. In a second step a random walker segmentation is applied to the image data by using the fuzzy seed set as an automatic seeding for segmentation. Liver segmentation, lung segmentation and kidney segmentation examples are provided.

Methods and systems for fully automatic segmentation of medical images

A method for reconstructing an ear canal from optical coherence tomography (OCT) scan data of an ear comprises extracting frame numbers and line numbers of interference intensities corresponding to one or more markers on an OCT scan guide, receiving reference frame numbers and lines numbers for one or more markers, determining a starting position and direction for the OCT ear scan from the ear scan marker frame and line numbers and the reference marker frame and line numbers, for each scan line, finding a pixel number of a maximum interference intensity value, and determining an offset distance of said pixel from said scan guide, and reconstructing a surface of the ear canal from the distance offset data.

System and method for reconstruction of the human ear canal from optical coherence tomography scans

A method of registering 3-dimensional digitized images to 2-dimensional digitized images during a medical procedure includes providing a pair of correctly-registered training images L={l, l} and their joint intensity distribution p(i, i), wherein iand iare reference and floating images, respectively, providing a pair of observed images O={o, o} and their joint intensity distribution p(i, i), mapping a marginal intensity distribution of the observed pair O={o, o} to a marginal intensity distribution of the training pair L={l, l}, and estimating a set of parameters T that registers image oto image oby maximizing a weighted sum of a Jensen-Shannon divergence (JSD) of a joint intensity distribution of the observed pair and a joint intensity distribution of the training pair and a similarity measure between the observed images.

System and method for learning-based 2D/3D rigid registration for image-guided surgery using Jensen-Shannon divergence

A method for visualization of dynamic three-dimensional (3D) virtual objects comprises storing a plurality of static 3D key-models respectively describing a dynamic 3D object in at least one of a number of poses and shapes; and rendering the dynamic 3D object by interpolation of the 3D key-models by performing the interpolation in a vertex shader program of a programmable graphics processing unit (GPU).

Method and system for visualization of dynamic three-dimensional virtual objects

A patient positioning system for positioning a patient relative to radiographic equipment. The system includes: a 3D optical imaging system for optically scanning the patient, such 3D optical imaging system having a focal plane and providing, for each position on the object, data representative of the intensity of reflected energy received by the system from such position and data representative of distance from such position on the object to the focal plane; a table apparatus for supporting the patient and for moving the table relative to the radiographic equipment in response to positioning signals; and a processor responsive to data from the radiographic equipment and the data from the a 3D optical imaging system for producing the positioning signals. The system enables a method for displaying temporal changes in a patient positioned with a bore of radiographic equipment.

Automatic patient positioning system

A system and method for positioning a patient for radiotherapy is provided. The method comprises: acquiring a first x-ray image sequence of a target inside the patient at a first angle; acquiring first respiratory signals of the patient while acquiring the first x-ray image sequence; acquiring a second x-ray image sequence of the target at a second angle; acquiring second respiratory signals of the patient while acquiring the second x-ray image sequence; synchronizing the first and second x-ray image sequences with the first and second respiratory signals to form synchronized first and second x-ray image sequences; identifying the target in the synchronized first and second x-ray image sequences; and determining three-dimensional (3D) positions of the target through time in the synchronized first and second x-ray image sequences.

System and method for patient positioning for radiotherapy in the presence of respiratory motion

A system and method for tree structure based two-dimensional to three-dimensional registration are provided for receiving three-dimensional (3D) data indicative of vessels, segmenting the 3D data with a vessel tree, simulating two-dimensional (2D) data responsive to the segmented 3D data to form a simulated 2D image, receiving 2D data indicative of vessels, segmenting the received 2D data with a vessel tree, finding a distance transform of the segmented 2D data to form a 2D distance map image, considering a set of poses as state vectors with the corresponding probability computed using the similarity measure computation, re-sampling the pose vector to find a set of most probable poses and considering them as hypothesized poses, recomputing the projection and re-evaluating the probability of the hypothesized poses and updating the state vector until the optimal pose is found.

Tree structure based 2D to 3D registration

A method for augmented reality navigation of a medical intervention includes providing a stereoscopic head mounted display, the display including a pair of stereo viewing cameras, at least one tracking camera, and a stereoscopic guidance display. During a medical intervention on a patient, the patient's body pose is determined from a rigid body transformation between the tracking camera and frame markers on the scanning table, and the pose of an intervention instrument with respect to the table is determined. A visual representation of the patient overlaid with an image of the intervention target, the instrument, and a path for guiding the instrument to perform said medical intervention is displayed in the stereoscopic guidance display.

Growing community of inventors

Princeton, NJ, United States of America

Ali Khamene