Siemens Healthcare Diagnostics Gmbh

Siemens Healthcare Gmbh

Siemens Aktiengesellschaft

Siemens Mobility Gmbh

Siemens Corporation

Stevens Institute of Technology

Siemens Ag Osterreich

Stefan Kluckner

Terrence Chen

Yao-Jen Chang

Benjamin S Pollack

Shanhui Sun

Kai Ma

Vivek Kumar Singh

Dorin Comaniciu

Jan Ernst

Oliver Lehmann

Ziyan Wu

Wen Wu

Patrick Wissmann

Puneet Sharma

Ali Kamen

Tommaso Mansi

Sasa Grbic

Carol L Novak

Saikiran Rapaka

Ankur Kapoor

Daphne Yu

Günter Lauritsch

Srikrishna Karanam

Maneesh Kumar Singh

Arun Innanje

Thomas Pheiffer

Charles Henri Florin

Jiang Tian

Ahmet Tuysuzoglu

Jiangping Wang

John Paulus, Jr

Katja Worm

Florian Bühs

Cristina Comaniciu

Helge Molthan

Khurram Soomro

Jan Gräfing

Christof Hoppe

Karsten Mirtschin

Laura Gruber

Haiyan Li

Carsten Engel

Tobias Tölg

Artur Wenkler

Yecheng Gu

Lukas Tetzlaff

Christoph Konrad Reinbothe

Embodiments provide a method of using image-based tube top circle detection based on multiple candidate selection to localize the tube top circle region in input images. According to embodiments provided herein, the multi-candidate selection enhances the robustness of tube circle detection by making use of multiple views of the same tube to improve the robustness of tube top circle detection. With multiple candidates extracted from images under different viewpoints of the same tube, the multi-candidate selection algorithm selects an optimal combination among the candidates and provides more precise measurement of tube characteristics. This information is invaluable in an IVD environment in which a sample handler is processing the tubes and moving the tubes to analyzers for testing and analysis.

Image-based tube top circle detection with multiple candidates

A neural network-based method for quantifying a volume of a specimen. The method includes providing a specimen, capturing images of the specimen, and directly classifying to one of a plurality of volume classes or volumes using a trained neural network. Quality check modules and specimen testing apparatus adapted to carry out the volume quantification method are described, as are other aspects.

Deep learning volume quantifying methods and apparatus

A model-based method for quantifying a specimen. The method includes providing a specimen, capturing images of the specimen while illuminated by multiple spectra at different nominal wavelengths, and exposures, and classifying the specimen into various class types comprising one or more of serum or plasma portion, settled blood portion, gel separator (if used), air, tube, label, or cap; and quantifying of the specimen. Quantifying includes determining one or more of: a location of a liquid-air interface, a location of a serum-blood interface, a location of a serum-gel interface, a location of a blood-gel interface, a volume and/or a depth of the serum or plasma portion, or a volume and/or a depth of the settled blood portion. Quality check modules and specimen testing apparatus adapted to carry out the method are described, as are other aspects.

Methods and apparatus adapted to quantify a specimen from multiple lateral views

Methods for image-based detection of the tops of sample tubes used in an automated diagnostic analysis system may be based on a convolutional neural network to pre-process images of the sample tube tops to intensify the tube top circle edges while suppressing the edge response from other objects that may appear in the image. Edge maps generated by the methods may be used for various image-based sample tube analyses, categorizations, and/or characterizations of the sample tubes to control a robot in relationship to the sample tubes. Image processing and control apparatus configured to carry out the methods are also described, as are other aspects.

Methods and systems for learning-based image edge enhancement of sample tube top circles

A method of characterizing a serum and plasma portion of a specimen in regions occluded by one or more labels. The characterization method may be used to provide input to an HILN (H, I, and/or L, or N) detection method. The characterization method includes capturing one or more images of a labeled specimen container including a serum or plasma portion from multiple viewpoints, processing the one or more images to provide segmentation data including identification of a label-containing region, determining a closest label match of the label-containing region to a reference label configuration selected from a reference label configuration database, and generating a combined representation based on the segmentation information and the closest label match. Using the combined representation allows for compensation of the light blocking effects of the label-containing region. Quality check modules and testing apparatus and adapted to carry out the method are described, as are other aspects.

Methods and apparatus for label compensation during specimen characterization

A method of training a neural network (Convolutional Neural Network-CNN) including reduced graphical annotation input is provided. The training method can be used to train a Testing CNN that can be used for determining Hemolysis (H), Icterus (I), and/or Lipemia (L), or Normal (N) of a serum or plasma portion of a test specimen. The training method includes capturing training images of multiple specimen containers including training specimens, generating region proposals of the serum or plasma portions of the training specimens; and selecting the best matches for the location, size and shape of the region proposals for the multiple training specimens. The obtained features (network and weights) from the training CNN can be used in a testing CNN. Quality check modules and testing apparatus adapted to carry out the training method, and characterization methods using abounding box regressor are described, as are other aspects.

Methods and apparatus for bio-fluid specimen characterization using neural network having reduced training

A method of characterizing a serum and plasma portion of a specimen in regions occluded by one or more labels. The characterization may be used for Hemolysis, Icterus, and/or Lipemia, or Normal detection. The method captures one or more images of a labeled specimen container including a serum or plasma portion, processes the one or more images to provide segmentation data and identification of a label-containing region, and classifying the label-containing region with a convolutional neural network (CNN) to provide a pixel-by-pixel (or patch-by-patch) characterization of the label thickness count, which may be used to adjust intensities of regions of a serum or plasma portion having label occlusion. Optionally, the CNN can characterize the label-containing region as one of multiple pre-defined label configurations. Quality check modules and specimen testing apparatus adapted to carry out the method are described, as are other aspects.

Methods and apparatus for determining label count during specimen characterization

A method of characterizing a serum and plasma portion of a specimen in regions occluded by one or more labels. The characterization may be used for determining Hemolysis (H), Icterus (I), and/or Lipemia (L), or Normal (N) of a serum or plasma portion of a specimen. The method includes capturing one or more images of a labeled specimen container including a serum or plasma portion, processing the one or more images with a convolutional neural network to provide a determination of Hemolysis (H), Icterus (I), and/or Lipemia (L), or Normal (N). In further embodiments, the convolutional neural network can provide N'-Class segmentation information. Quality check modules and testing apparatus adapted to carry out the method are described, as are other aspects.

Methods and apparatus for HILN characterization using convolutional neural network

The present embodiments relate to automatically estimating a three-dimensional pose of an object from an image captured using a camera with a structured light sensor. By way of introduction, the present embodiments described below include apparatuses and methods for training a system for and estimating a pose of an object from a test image. Training and test images are sampled to generate local image patches. Features are extracted from the local image patches to generate feature databased used to estimate nearest neighbor poses for each local image patch. The closest nearest neighbor pose to the test image is selected as the estimated three-dimensional pose.

Image indexing and retrieval using local image patches for object three-dimensional pose estimation

A model-based method of determining characteristics of a specimen container. The method includes providing a specimen container, capturing images of the specimen container at different exposures times and at different spectra having different nominal wavelengths, selecting optimally-exposed pixels from the images at different exposure times at each spectra to generate optimally-exposed image data for each spectra, and classifying the optimally-exposed pixels as at least being one of tube, label or cap, and identifying a width, height, or width and height of the specimen container based upon the optimally-exposed image data for each spectra. Quality check modules and specimen testing apparatus adapted to carry out the method are described, as are other aspects.

Methods and apparatus adapted to identify a specimen container from multiple lateral views

A model-based method of determining characteristics of a specimen container cap to identify the container cap. The method includes providing a specimen container including a container cap; capturing backlit images of the container cap taken at different exposures lengths and using a plurality of different nominal wavelengths; selecting optimally-exposed pixels from the images at different exposure lengths at each nominal wavelength to generate optimally-exposed image data for each nominal wavelength; classifying the optimally-exposed pixels as at least being one of a tube, a label or a cap; and identifying a shape of the container cap based upon the optimally-exposed pixels classified as being the cap and the image data for each nominal wavelength. Quality check modules and specimen testing apparatus adapted to carry out the method are described, as are numerous other aspects.

Systems, methods and apparatus for identifying a specimen container cap

A method of characterizing a specimen for HILN (H, I, and/or L, or N). The method includes capturing images of the specimen at multiple different viewpoints, processing the images to provide segmentation information for each viewpoint, generating a semantic map from the segmentation information, selecting a synthetic viewpoint, identifying front view semantic data and back view semantic data for the synthetic viewpoint, and determining HILN of the serum or plasma portion based on the front view semantic data with an HILN classifier, while taking into account back view semantic data. Testing apparatus and quality check modules adapted to carry out the method are described, as are other aspects.

Methods, apparatus, and quality check modules for detecting hemolysis, icterus, lipemia, or normality of a specimen

Barcode tag conditions on sample tubes are detected utilizing side view images of sample tubes for streamlining handling in clinical laboratory automation systems. The condition of the tags may be classified into classes, each divided into a list of additional subcategories that cover individual characteristics of the tag quality. According to an embodiment, a tube characterization station (TCS) is utilized to obtain the side view images. The TCS enables the simultaneous or near-simultaneous collection of three images for each tube, resulting in a 360 degree side view for each tube. The method is based on a supervised scene understanding concept, resulting in an explanation of each pixel into its semantic meaning. Two parallel low-level cues for condition recognition, in combination with a tube model extraction cue, may be utilized. The semantic scene information is then integrated into a mid-level representation for final decision making into one of the condition classes.

Barcode tag detection in side view sample tube images for laboratory automation

A model-based method of inspecting a specimen for presence of an interferent (H, I, and/or L). The method includes capturing images of the specimen at multiple different exposures times and at multiple spectra having different nominal wavelengths, selection of optimally-exposed pixels from the captured images to generate optimally-exposed image data for each spectra, identifying a serum or plasma portion of the specimen, and classifying whether an interferent is present or absent within the serum or plasma portion. Testing apparatus and quality check modules adapted to carry out the method are described, as are other aspects.

Methods and apparatus for detecting an interferent in a specimen

A method for identifying a feature in a first image comprises establishing an initial database of image triplets, and in a pose estimation processor, training a deep learning neural network using the initial database of image triplets, calculating a pose for the first image using the deep learning neural network, comparing the calculated pose to a validation database populated with images data to identify an error case in the deep learning neural network, creating a new set of training data including a plurality of error cases identified in a plurality of input images and retraining the deep learning neural network using the new set of training data. The deep learning neural network may be iteratively retrained with a series of new training data sets. Statistical analysis is performed on a plurality of error cases to select a subset of the error cases included in the new set of training data.

Method and system for efficiently mining dataset essentials with bootstrapping strategy in 6DOF pose estimate of 3D objects

Growing community of inventors

Berlin, Germany

Stefan Kluckner