Siemens Healthcare Gmbh

Siemens Healthineers Ag

Siemens Aktiengesellschaft

Siemens Medical Solutions Usa, Inc.

Christoph Vetter

Kaloian Petkov

Daphne Yu

Rishabh Shah

Sandra Sudarsky

Chenyang Xu

Christoph Guetter

Wei Li

Lining Yang

Feng Qiu

Wei Hong

John Paulus, Jr

An exposure value is dynamically adapted for consistent interactive rendering of a volumetric medical dataset. A rendering set of a plurality of rendering types with each rendering type adapted for providing an image dataset derived from the volumetric medical dataset is provided. An image dataset according to a first rendering type using a first exposure value is output. An exposure value for each rendering type within the rendering set is determined based on the first exposure value of the first rendering type and on a consistency requirement for changing rendering types of the image dataset output. Upon receiving a user input for modifying the output of the image dataset, a second rendering type with a second exposure value is selected and output.

Technique for dynamically adapting an exposure value in interactive rendering

Systems and methods for determining rendering parameters based on authored snapshots or templates. In one aspect, clinically relevant snapshots of patient medical data are created by experts to support educational or clinical workflows. Alternatively, the snapshots are created by automation processes from AI-based organ and disease segmentations. In another aspect, clinically relevant templates are generated. Rendering parameters are derived from the snapshots or templates, stored, and then applied for either rendering new data or interactive viewing of existing data.

Systems and methods for automated rendering

Distance estimation is optimized in virtual or augmented reality. A distance map of a surgical instrument to a region of interest is determined, at least at the beginning and when a position of the surgical instrument has changed. A render-image is rendered based on a medical 3D image and the position of the surgical instrument, at least at the beginning and when the position of the surgical instrument has changed. At least the region of interest and those parts of the surgical instrument positioned in the volume of the render-image are shown in the render-image. Based on the distance map, at least for a predefined area of the region of interest, visible, acoustic, and/or haptic distance-information is added.

Method and system for optimizing distance estimation

Computer-implemented methods for rendering a volumetric dataset and a surface embedded in the volumetric dataset are described. One method includes performing a volume rendering process to generate a volume rendering of the volume. Based on the volume rendering process, depths of respective locations in the volume rendering are determined, and the depths stored in association with the respective locations. A surface rendering process generates a surface rendering of a surface using the depths and respective locations. The volume rendering and the surface rendering are combined into a combined rendering of the volume and surface. In another method, depths of the surface at respective locations with respect to the volume are determined and the depths are stored in association with the locations. A volume rendering process includes a shading process which uses the depths of the surface and the respective locations.

Method of rendering a volume and a surface embedded in the volume

To reduce complexity and corresponding run time, quantum computation is used for rendering a volume. The quantum computation may search for voxels along a ray or the minimum or maximum. The quantum computation may orient (e.g., rotate) data for more efficient searching for the maximum or minimum. Due to the superposition in quantum computing, the efficiency in volume rendering medical images is increased as compared to traditional binary approaches.

Volume rendering from three-dimensional medical data using quantum computing

Physically-based volume rendering generates a lightfield. The locations of scattering modeled in physically-based rendering are used to assign depths for the lightfield. The previously assigned depths and previously rendered lightfield are used for lightfield rendering, which may be performed more rapidly than the physically-based volume rendering.

Lightfield rendering based on depths from physically-based volume rendering

Physically-based volume rendering produces pixels. By assigning depths to the pixels, a 3D point cloud is generated. For more rapid rendering, such as due to user interaction, the 3D point cloud rendering is a proxy to physically-based volume rendering. The rendering parameters for the desired image may be determined using the proxy, and then physically-based volume rendering is performed to obtain the desired image.

Point cloud proxy for physically-based volume rendering

A computer-implemented method for exploration of medical visualization parameters in virtual spaces includes detecting a user location and a user orientation in a physical space and generating a display of an immersive layout centered at the user location and the user orientation. A plurality of holograms is generated within in the immersive layout. Each hologram depicts a rendering of a medical image with a distinct combination of rendering parameter values. The display is updated based on a change to one or more of the user location and the user orientation in the physical space.

Exploration of medical visualization parameters in virtual spaces

The present embodiments relate to presampled photon maps for Monte-Carlo volume renderings. A photon map is generated from scan data of a volume, and the photon map is sampled and stored as an O-buffer or a uniform buffer. The O-buffer is adapted to the scan data and/or the transfer function to optimize the offset of the O-buffer for use in Monte-Carlo volume rendering. A Monte-Carlo volume rendering is generated from the scan data and the sampled photon map.

Presampled photon maps for Monte-Carlo volume renderings

For occlusion handing in lightfield rendering, layered lightfields are created. Rather than use one lightfield for one camera position and orientation, multiple lightfields representing different depths or surfaces at different depths relative to that camera position and orientation are created. By using layered lightfields for the various camera positions and orientations, the camera may be located within the convex hull or scanned object. The depths of the layers are used to select the lightfields for a given camera position and location.

Layered lightfields for occlusion handling

The present embodiments relate to multi-resolution lightfield representations and lightfield renderings. By way of introduction, the present embodiments include apparatuses and methods for generating multi-resolution lightfield representations used to generate lightfield renderings that provide end users with zoom functionality without distorting the rendering. Image data sets of a volume are captured at different resolutions for each camera position, and the image data sets are stored as multi-resolution image pyramids. The multi-resolution image pyramids represent the lightfield at different resolutions, and image data sets at a particular resolution are selected and used for generating a volume rendering at a zoom level chosen for the lightfield rendering.

Multi-resolution lightfield rendering using image pyramids

Robotic navigation is provided in nuclear probe imaging. Adaptive reconstruction is provided. A measure of quality of the reconstruction is used as a feedback to determine when sufficient sampling has occurred. For example, once a pre-determined number of separate lesions are indicated in the reconstruction, the quality of the reconstruction is considered sufficient.

Quality controlled reconstruction for robotic navigated nuclear probe imaging

A method for rendering a deformable object. The method includes: obtaining a 3D volumetric voxel dataset of a region, such region having therein an object to be rendered; building a tree hierarchical structure for the obtained volumetric dataset, such tree structure blocks as the nodes of a primary tree hierarchy and bricks being those blocks stored as textures in a video memory; augmenting the primary tree hierarchical structure with maximum and minimum values of the data contained within a block; creating a neighborhood tree hierarchy having for each leaf block of the neighborhood tree hierarchy a reference to the neighboring leaf blocks in the neighborhood tree hierarchy as well as references to neighboring bricks in the neighborhood tree hierarchy; updating the information about minimum and maximum in the primary tree hierarchy by saving for each block the minimum and maximum of the neighboring blocks; and rendering the leaf blocks in visibility order.

Method for direct volumetric rendering of deformable bricked volumes

A method for non-rigid multi-modal registration of digitized images includes providing a reference image and an alignment images acquired from different imaging modalities to a graphics processing unit (GPU), initializing a deformation field for registering said reference image and said alignment image, computing marginal and joint intensity histograms of the reference image and the alignment image as registered by said deformation field, computing gradients of the reference and registered alignment images and of their respective marginal and joint intensity histograms, smoothing said histograms and gradients using Gaussian filters, calculating a new deformation field using said smoothed gradients, and registering said alignment image to said reference image using said deformation field.

Growing community of inventors

Hopewell, NJ, United States of America

Christoph Vetter