University of Southern California

Other

Rishi Raghav Rawat

David B Agus

Daniel Lee Ruderman

Paul Thomas Macklin

Fei Sha

Darryl Shibata

Rachna Rawat

Rajeev Rawat

Radhika Rawat

Histologic classification of pathology specimens through machine learning is a nascent field which offers tremendous potential to improve cancer medicine. Its utility has been limited, in part because of differences in tissue preparation and the relative paucity of well-annotated images. We introduce tissue recognition, an unsupervised learning problem analogous to human face recognition, in which the goal is to identify individual tumors using a learned set of histologic features. This feature set is the 'tissue fingerprint.' Because only specimen identities are matched to fingerprints, constructing an algorithm for producing them is a self-learning task that does not need image metadata annotations. Here, we provide an algorithm for self-learning tissue fingerprints, that, in conjunction with color normalization, can match hematoxylin and eosin stained tissues to one of 104 patients with 93% accuracy. We applied this identification network's internal representation as a tissue fingerprint for use in predicting the molecular status of an individual tumor (breast cancer clinical estrogen receptor (ER) status). We describe a fingerprint-based classifier that predicts ER status from whole-slides with high accuracy (AUROC=0.90), and is an improvement over traditional transfer learning approaches. The use of tissue fingerprinting for digital pathology as a concise but meaningful histopathologic image representation enables a new range of machine learning algorithms leading to increased information for clinical decision making in patient management.

Histopathology classification through machine self-learning of 'tissue fingerprints'

A method assessing tissue morphology using machine learning includes a step of training a machine learnable device to predict the status of a diagnostic feature in stained tissue samples. The machine learnable device is trained with a characterized set of digital images of stained tissue samples. Each digital image of the characterized set has a known status for the diagnostic feature and an extracted feature map provides values for a extracted feature over an associated 2-dimensional grid of spatial locations. A step of inputting the set of extracted feature maps is inputted into the machine learnable device to form associations therein between the set of extracted feature maps to and the known status for the diagnostic feature to form a trained machine learnable device. The status for the diagnostic feature of a stained tissue sample of unknown status for the diagnostic feature is predicted from the trained machine learnable device.

Machine learning for digital pathology

A computer system and related method for analysis of medical symptoms on a body of a living being is provided. The system comprises a first portion of computer readable medium which stores digital representation of a plurality of tissue layers in the body. The system also includes a processor unit and a second portion of computer readable medium. The second portion of the computer readable medium stores instructions executable by the processor unit to perform the steps of displaying at least one tissue layer from the plurality of the tissue layers on a display device, receiving a first input indicating a locale on the displayed at least one tissue layer, receiving a second input associating a medical symptom description to the indicated locale, and including information about the medical symptom description and the associated locale in the digital representation of the body. Related methods are also provided.

Computer based system and method for medical symptoms analysis, visualization and social network

Growing community of inventors

Boulder, CO, United States of America

Rishi Raghav Rawat