Ventana Medical Systems, Inc.

Sony Corporation

Hoffmann-la Roche Inc.

Uop Lcc

F. Hoffmann-la Roche Ag

Quan Yuan

Srinivas Chukka

Anindya Sarkar

Ming-Chang Liu

Matthew Martin

Clayton Colin Sadler

Rajeswar R Gattupalli

Michael Jerome Vetter

Liangyin Yu

Bryan James Egolf

Ka Leung Lok

William M Hartman

Gerardo Fernandez

Bikash Sabata

Elizabeth Little

Angelika Fuchs

The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images. The basis for alignment may be a line-based registration process, wherein sets of lines are computed on the boundary regions computed for the two images, where the boundary regions are obtained using information from two domains—soft-weighted foreground images and gradient magnitude images. The binary mask image, based on whose boundary the line features are computed, may be generated by combining two binary masks—a first binary mask is obtained on thresholding a soft-weighted (continuous valued) foreground image, which is computed based on the stain content in an image, while a second binary mask is obtained after thresholding a gradient magnitude domain image, where the gradient is computed from the grayscale image obtained from the color image.

Line-based image registration and cross-image annotation devices, systems and methods

The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images. The basis for alignment may be a line-based registration process, wherein sets of lines are computed on the boundary regions computed for the two images, where the boundary regions are obtained using information from two domains&#x2014;soft-weighted foreground images and gradient magnitude images. The binary mask image, based on whose boundary the line features are computed, may be generated by combining two binary masks&#x2014;a first binary mask is obtained on thresholding a soft-weighted (continuous valued) foreground image, which is computed based on the stain content in an image, while a second binary mask is obtained after thresholding a gradient magnitude domain image, where the gradient is computed from the grayscale image obtained from the color image.

A method for identifying biomarker-positive tumor cells is disclosed. The method includes, for example, reading a first digital image and a second digital image into memory, the first and second digital image depicting the same area of a first slide; identifying a plurality of nuclei and positional information of said nuclei by analyzing the light intensities in the first digital image; identifying cell membranes which comprise the biomarker by analyzing the light intensities in the second digital image and by analyzing the positional information of the identified nuclei; and identifying biomarker-positive tumor cells in said area, wherein a biomarker-positive tumor cell is a combination of one identified nucleus and one identified cell membrane that surrounds the identified nucleus.

Medical image analysis for identifying biomarker-positive tumor cells

Systems and methods for analyzing vessels in multiplexed images include detecting large vessels using a spoke feature detection method, detecting long and narrow vessels using a line feature detection method, detecting smaller vessels using rolling-ball filtering and binary image operations to generate a mask, and evaluating any contour polygons resulting from these operations using quality measurements and other thresholds. Maturity determination and nuclei detection are also performed, resulting in an output of vessel characteristics and co-locations enabling enhanced analysis of multispectral images.

Vessel analysis in multiplexed images

Systems and methods for speeding up a spectral unmixing process by using pixel groups are disclosed. Operations including forming groups of similar pixels, and unmixing only one representative pixel from each pixel group enable determination of an unmixing result for all the pixels in the group. A similarity metric may be based on a dot product of an unprocessed pixel with the representative pixel in the subset of pixels. The method is repeated for any number of remaining unmatched pixels that exceed a threshold, until the number of remaining or unmatched pixels is smaller than the threshold, upon which the remaining pixels may be individually unmixed. Significantly fewer unmixing operations are performed on an image, thereby speeding up the unmixing process.

Systems and methods for spectral unmixing of microscopic images using pixel grouping

The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images.

Whole slide image registration and cross-image annotation devices, systems and methods

A method for detecting presence of a hand gesture in video frames includes receiving video frames having an original resolution, downscaling the received video frames into video frames having a lower resolution, and detecting a motion corresponding to the predefined hand gesture in the downscaled video frames based on temporal motion information in the downscaled video frames. The method also includes detecting a hand shape corresponding to the predefined hand gesture in a candidate search window within one of the downscaled video frames using a binary classifier. The candidate search window corresponds to a motion region containing the detected motion. The method further includes determining whether the received video frames contain the predefined hand gesture based on the hand shape detection.

Growing community of inventors

San Jose, CA, United States of America

Quan Yuan