Applying pixelwise descriptors to a target image that are generated by segmenting objects in other images

Abstract

Both pixel-oriented analysis and the more accurate yet slower object-oriented analysis are used to recognize patterns in images of stained cancer tissue. Images of tissue from other patients that are similar to tissue of a target patient are identified using the standard deviation of color in the images. Object-oriented segmentation is then used to segment small portions of the images of the other patients into object exhibiting object characteristics. Pixelwise descriptors associate each pixel in the remainder of the images with object characteristics based on the color of pixels at predetermined offsets from the characterized pixel. Pixels in the image of the target patient are assigned object characteristics without performing the slow segmentation of the image into objects. A pixel heat map is generated from the target image by assigning pixels the color corresponding to the object characteristic that the pixelwise descriptors indicate is most likely associated with each pixel.