Siemens Healthcare Gmbh

Siemens Aktiengesellschaft

Siemens Medical Solutions Usa, Inc.

Siemens Aktiengesell Schaft

Klaus Engel

Daphne Yu

Shaohua Kevin Zhou

Tommaso Mansi

Kaloian Petkov

James Williams

Dorin Comaniciu

Bogdan Georgescu

Shun P Miao

Anna Jerebko

Gianluca Paladini

Philippe Desgranges

David D Liu

Bernhard Geiger

Ingmar Voigt

Stefan Assmann

Andreas Wimmer

Thomas Friese

Nathan S Lay

Olivier Ecabert

Stefan Röttger

Ruth J Soenius

Jesko Schwarzer

Michael Burns

Jana Martschinke

Johannes Binder

Simone Hufnagel

Matthieu Dederichs

Alexander Ehlert

Frederik Lange

In one embodiment, a method is for rendering medical volumetric images from received volumetric data, using a cinematic rendering approach, based on a Monte Carlo path tracing algorithm (MCPT). The MCPT algorithm uses at least one microfacet-based bidirectional reflectance distribution function (BRDF) for computing a probability how light is reflected at an implicit surface which is used for shading the implicit surface. In one embodiment, the method includes detecting if a surface scatter event is triggered. If yes, the method includes modifying the computation of a local gradient in the BRDF by perturbing the respective received volumetric data by applying a noise function for simulating a roughness of the implicit surface; and shading the implicit surfaces for rendering the received volumetric data.

Implicit surface shading in medical volumetric rendering

A method is for visualizing an image data set, the image data set displaying a three-dimensional arrangement including at least a first object and a second object. The method includes providing a three dimensional image data set including first voxels assigned to the first object and second voxels assigned to the second object; identifying first voxels of the three-dimensional image data set; determining a set of parameters for volume rendering, the set of parameters determined including a subset of parameters and a focusing parameter; identifying primary rays impacting on the first object and identifying secondary rays missing the first object; and performing the volume rendering using the subset of parameters determined, for visualizing the first object and the second object. The focusing parameter used for the primary rays in the volume rendering is different from the focusing parameter used for the secondary rays in the volume rendering.

Method for visualizing an image data set, system for visualizing an image data set, computer program product and a computer readable medium

Described is a method for the visualization of medical image data as volume data. As part of the method, medical image data is acquired. A 3D mask is produced by segmenting the image data and classifying the segmented regions into predefined classes. Furthermore, the image data and the mask data are saved in two separate 3D texture files. A translation vector is then calculated, which describes the displacement of a segmented volume element between an original position and a destination position. In addition, a pictorial display of the image data is produced by applying a raycasting method to the stored image data. Finally, a displacement by the translation vector of a segmented volume element in the pictorial display is performed. A visualization entity is also described. Moreover, a medical imaging system is described.

Visualization of medical image data

An embodiment suggests a method for visualizing an image data set, in particular a medical image data set, wherein the visualized data set displays a three dimensional arrangement having at least a first object and a second object. The method includes assigning a first set of parameter to the first object; assigning a second set of parameters to the second object; dividing the medical image data set into a first sub-region and a second sub-region; and providing a visualisation of the three dimensional arrangement by a volume rendering method, in particular by a ray-casting method or a photorealistic volumetric path tracing, the first set of parameter being applied to the first sub-region for visualizing the first object and the second set of parameter being applied to the second sub-region for visualizing the second object.

In-context photorealistic 3D visualization for surgical decision support

Functional and anatomical information are combined in medical imaging. The functional information is treated as a light source illuminating surrounding anatomy, not just along a viewing direction. As a result, rendered images of the anatomy include highlighting or visual lighting queues showing locations of biological activity using global illumination.

Illumination in rendering of anatomy with functional information

Slice representation of a volume with the aid of volume data is provided. A selection of a slice orientation for slice representation of volume data is made. A slice is then determined in accordance with the selected orientation. A relief representation is calculated for this slice and used as a relief for the representation of the at least one slice. A vivid representation of slice information is provided.

Slice representation of volume data

An artificial intelligence agent is machine trained and used to provide physically-based rendering settings. By using deep learning and/or other machine training, settings of multiple rendering parameters may be provided for consistent imaging even in physically-based rendering.

Content-based medical image rendering based on machine learning

The present embodiments relate to cinematic volume renderings and/or volumetric Monte-Carlo path tracing. By way of introduction, the present embodiments described below include apparatuses and methods for cinematic rendering of unfolded three-dimensional volumes. An image analysis algorithm is performed on an input volume to extract one or more structures of interest, such as a rib centerline, a liver surface or another three-dimensional volume. Based on the extracted three-dimensional structure(s), a geometric transformation is computed to generate an unfolded three-dimensional volume of the structure(s). Cinematic volume rendering techniques are used to generate a rendered image from the unfolded three-dimensional volume.

Cinematic rendering of unfolded 3D volumes

Generating anatomically specific movie driven medical image review is provided. Scan data is received representing an anatomy of a patient. A movie generation preset selection associated with the scan data is received. Anatomical landmarks within the scan data are detected. A movie of the patient is generated based on the scan data, the movie generation preset, and the anatomical landmarks.

Anatomically specific movie driven medical image review

A first interface for reading image data of an anatomical region obtained by means of a medical imaging method is provided. A modeling module serves for establishing a volumetric biomechanical structure model of the anatomical region on the basis of the image data. Moreover, provision is made of a tracking module, couplable with a camera, for video-based registration of spatial gestures of a user. Furthermore, a simulation module, based on the biomechanical structure model, serves to assign a registered gesture to a simulated mechanical effect on the anatomical region, simulate a mechanical reaction of the anatomical region to the simulated mechanical effect, and modify the biomechanical structure model in accordance with the simulated mechanical reaction. Moreover, provision is made for a visualization module for the volumetric visualization of the biomechanical structure model.

Device and method for the computer-assisted simulation of surgical interventions

Interior scan and exterior photos are jointly visualized in medical imaging. One or more cameras are mounted to the internal medical scanner, allowing a photograph to be taken while or in temporal proximity to when the internal region of the patient is scanned. An image associating the exterior photographs with the interior region of the patient is presented to assist in diagnosis. Due to the spatial and temporal proximity, the image may be a visualization formed by combining the photograph and interior scan data.

Joint visualization of 3D reconstructed photograph and internal medical scan

The inner volume of an inhomogeneous three-dimensional object is visualized by a plurality of simulated visual rays. For a respective visual ray entering the object volume, i) a scatter position is determined along the visual ray, ii) a scatter direction is selected in dependence on a random process, and iii) the visual ray is scattered at the scatter position in the selected scatter direction. Steps i) to iii) are repeated until the visual ray is absorbed in the object volume or exits the object volume, wherein the exiting visual ray is incident on an illumination source and, in dependence on a brightness and/or color value of the illumination source, an illumination contribution of the visual ray to a respective visualization pixel is ascertained.

Method, visualization device, and computer program product for visualizing a three-dimensional object

A method of visualizing a three-dimensional object from a data volume is disclosed. In an embodiment, the method includes computing an irradiance cache for the data volume; and applying the irradiance cache during rendering of a three-dimensional image from the data volume. In an embodiment, entries of the irradiance cache are organized in a uniform grid.

Method of visualizing a three-dimensional object from a data volume

A method and apparatus for volume rendering based 3D image filtering and real-time cinematic volume rendering is disclosed. A set of 2D projection images of the 3D volume is generated using cinematic volume rendering. A reconstructed 3D volume is generated from the set of 2D projection images using an inverse linear volumetric ray tracing operator. The reconstructed 3D volume inherits noise suppression and structure enhancement from the projection images generated using cinematic rendering, and is thus non-linearly filtered. Real-time volume rendering can be performed on the reconstructed 3D volume using volumetric ray tracing, and each projected image of the reconstructed 3D volume is an approximation of a cinematic rendered image of the original volume.

Method and system for volume rendering based on 3D image filtering and real-time cinematic rendering

Methods, apparatuses, and systems are provided for live capturing of light map image sequences for image-based lighting of medical data. Patient volume scan data for a target area is received over time by a processor. Lighting environment data for the target area is captured over time by a camera. The camera transmits the lighting environment data to the processor over time. The processor lights the patient volume scan data with the lighting environment data into lighted volume data over time. The processor renders an image of the lighted volume data over time.

Growing community of inventors

Nürnberg, Germany

Klaus Engel