Siemens Medical Solutions Usa, Inc.

Siemens Corporate Research, Inc.

Siemens Aktiengesellschaft

Siemens Healthcare Gmbh

Siemens Corporation

Siemens Healthineers Ag

Gianluca Paladini

Thomas Moeller

Ali Kamen

Wei Li

Dorin Comaniciu

Frank Sauer

Daphne Yu

Klaus Engel

Klaus D Engel

Oliver Kutter

Leo John Grady

Shaohua Kevin Zhou

Thilaka S Sumanaweera

Michal Sofka

Ankur Kapoor

Ali Khamene

Jingdan Zhang

James P Williams

Eli Gibson

Youngjin Yoo

Qinglin Ma

Parmeshwar Khurd

Wei Hong

Lance Anthony Ladic

Yuri Boykov

John Paulus, Jr

John C Pearson

Poikavila Ullaskrishnan

Kristof Ralovich

John W Cherry

Pragneshkumar Patel

David Rapaport

Lawrence Tarbox

Mathia Scucchiari

Systems and methods facilitate privacy-preserving data curation in a federated learning system by transmitting a portion of a potential data sample to a remote location. The portion is inspected for quality to rule out data samples that do not satisfy data curation criteria. The remote examination focuses on checking the region of interest but maintains privacy as the examination is unable to parse any other identifiable subject information such as face, body shape etc. because pixels or voxels outside the portion are not included. The examination results are sent back to the collaborators so that inappropriate data samples can be excluded during federated learning rounds.

Privacy-preserving data curation for federated learning

An apparatus and method for tracking the position and orientation of one or more objects in three dimensional space is disclosed. One or more tracked sensor units are each connected with a respective object. Each tracked sensor unit includes one or more light sources and an inertial measurement unit. One or more position sensitive detector tracking devices track the position of the tracked sensor units. Each position sensitive detector tracking device includes a plurality of position sensitive detector sensors combined with optical lenses that focus light from a larger field of view onto each position sensitive detector sensor. The position and orientation of each object in three-dimensional space is calculated from the output of the inertial measurement unit of the respective tracked sensor unit and the output of the one or more position sensitive detector tracking devices in response to light emitted from the one or more light sources of the respective tracked sensor unit.

Method and apparatus for wide area multi-body 6D pose tracking system

Methods and systems for luggage visualization perform virtual unpacking by visually moving an object image away from its original pose. A scanned 3D volume is segmented guided by a confidence measure to create a label volume whose voxels specify the detected object IDs. The luggage dataset and the label volume are visualized by volume rendering. Using an automatic coloring algorithm, any pair of objects whose projections are adjacent in an image are assigned distinct hues. A layered framework efficiently renders a scene mixed with packed luggage, animated unpacking objects, and already unpacked objects put aside for further inspection. A GPU is used to automatically select objects that are not blocked by others and can be unpacked.

Luggage visualization and virtual unpacking

Methods, apparatuses, and systems are provided for live capturing of light map image sequences for image-based lighting of medical data. Patient volume scan data for a target area is received over time by a processor. Lighting environment data for the target area is captured over time by a camera. The camera transmits the lighting environment data to the processor over time. The processor lights the patient volume scan data with the lighting environment data into lighted volume data over time. The processor renders an image of the lighted volume data over time.

Live capturing of light map image sequences for image-based lighting of medical data

A method for Monte Carlo volume rendering in accordance with the present teachings includes: (a) tracing a plurality of light rays into a scene containing volumetric data, the light rays configured for simulating global illumination; (b) randomizing the scattering location and direction of the plurality of light rays through the volume, wherein a common sequence of random numbers is used in order for the scattering direction of each of the plurality of randomized scattered light rays to be substantially parallel; (c) computing at least one trilinearly interpolated and shaded sample along each of the plurality of randomized scattered light rays based on stored volumetric data, wherein at least a portion of the stored volumetric data used in at least a portion of the computing is configured for coherent access; and (d) rendering the volume with global illumination based on a plurality of iterations of the tracing, the randomizing, and the computing. Systems for Monte Carlo volume rendering are described.

Coherent memory access in Monte Carlo volume rendering

A method and system for integrating radiological and pathological information for cancer diagnosis, therapy selection, and monitoring is disclosed. A radiological image of a patient, such as a magnetic resonance (MR), computed tomography (CT), positron emission tomography (PET), or ultrasound image, is received. A location corresponding to each of one or more biopsy samples is determined in the at least one radiological image. An integrated display is used to display a histological image corresponding to the each biopsy samples, the radiological image, and the location corresponding to each biopsy samples in the radiological image. Pathological information and radiological information are integrated by combining features extracted from the histological images and the features extracted from the corresponding locations in the radiological image for cancer grading, prognosis prediction, and therapy selection.

Method and system for integrated radiological and pathological information for diagnosis, therapy selection, and monitoring

Robotic navigation is provided for nuclear probe imaging. Using a three-dimensional scanner (), the surface of a patient is determined (). A calibrated robotic system positions () a nuclear probe about the patient based on the surface. The positioning () may be without contacting the patient and the surface may be used in reconstruction to account for spacing of the probe from the patient. By using the robotic system for positioning (), the speed, resolution and/or quality of the reconstructed image may be predetermined, user settable, and/or improved compared to manual scanning. The reconstruction () may be more computationally efficient by providing for regular spacing of radiation detection locations within the volume.

Robotic navigated nuclear probe imaging

A nuclear probe and ultrasound transducer are interconnected, such as being in a same hand-held housing. The interconnection aligns the coordinate systems in a known spatial relationship. The ultrasound data is used to detect transducer offset or change in position without a tracking sensor. The radiation detected by the nuclear probe may be reconstructed into an image based on the detected transducer position since the nuclear probe moves with the ultrasound transducer. Both anatomical and functional imaging may be provided together without the complications of calibration and tracking. Where a therapeutic transducer is included, therapy may also be provided. The anatomical and functional information identifies the regions for treatment. The same device, already positioned correctly based on the functional and anatomical imaging, is then used for treatment with high intensity focused ultrasound.

Multi-modal medical imaging

For cloud-based computer assisted detection, hierarchal detection is used, allowing detection on data at progressively greater resolutions. Detected locations at coarser resolutions are used to limit the data transmitted at greater resolutions. Data is only transmitted for neighborhoods around the previously detected locations. Subsequent detection using higher resolution data refines the locations, but only for regions associated with previous detection. By limiting the number and/or size of regions provided at greater resolutions based on the previous detection, the progressive transmission avoids transmission of some data. Additionally, or alternatively, lossy compression may be used without or with minimal reduction in detection sensitivity.

Data transmission in remote computer assisted detection

The present invention discloses a method and system for deploying software, e.g., software modules designed for acquisition and/or post-processing of images related to a particular imaging agent. The modules can be remotely accessed from a software server.

System and method for deployment of configuration and analysis software

A method for automatic virtual endoscopy navigation, including: (a) using a fisheye camera to generate an endoscopic image and a depth image from a current position of the camera in lumen computed tomographic (CT) data; (b) segmenting a first region and a second region from the depth image, wherein the first region identifies a view direction of the camera and the second region is an area through which the camera can be moved without touching an inner surface of the lumen; (c) moving the camera from the current position, while pointing the camera in the view direction, to a next position in the second region; and (d) repeating steps (a-c) in sequence using the next position in step (c) as the current position in step (a).

Image-based path planning for automated virtual colonoscopy navigation

Ultrasound imaging is synchronized with measurements. Generating three-dimensional representations is synchronized with measuring one or more parameters. For example, measurements are preformed based on navigating through a volume. The measurements are linked to the corresponding three-dimensional representations. As another example, the user selects a measurement from a graph. A three-dimensional representation of the volume associated with the selected measurement is presented.

Synchronized three or four-dimensional medical ultrasound imaging and measurements

In response to a request from a client, a server for volume rendering loads a volume dataset from a storage archive, creates a low resolution sub-sampled copy of such volume dataset and transmits it to a client. In response to subsequent requests from the client, the server for volume rendering renders a high quality image of the full resolution volume dataset and renders a low quality image of the sub-sampled copy of the volume dataset, then generates a pixel mask or a hybrid pixel mask indicative of a difference between the high quality image and the low quality image and transmits such pixel mask to the client. The client receives from the server the pixel mask and computes a high quality image based at least in part on the pixel mask and on a selective rendering of its local low resolution sub-sampled copy of the volume dataset.

Method and apparatus for efficient client-server visualization of multi-dimensional data

A memory manager interfaces between a rendering application and the driver controlling one or more memories. A multi-level brick cache system caches bricks in a memory hierarchy to accelerate the rendering. One example memory hierarchy may include system memory, AGP memory, and graphics memory. The memory manager allows control of brick overwriting based on current or past rendering. Since different memories are typically available, one or more memory managers may control storage of bricks into different memories to optimize rendering. Management of different memory levels, overwriting based on current or previous rendering, and an interfacing memory manager may each be used alone or in any possible combination.

Memory management system and method for GPU-based volume rendering

A method for managing a memory system for large data volumes includes providing a central memory management system comprising a memory management interface between applications and a memory of a programmed computer, maintaining a global priority list of data buffers allocated by the applications, storing decompressed data of the data buffers into a cache which is managed by the central memory management system using a separate priority list, and accessing the decompressed data of the data buffers in the cache.

Growing community of inventors

Skillman, NJ, United States of America

Gianluca Paladini