International Business Machines Corporation

Salesforce, Inc.

Other

Ali Madani

Tanveer Fathima Syeda-Mahmood

Mehdi Moradi

Nikhil Naik

Nitish Shirish Keskar

Bryan McCann

Alvin Guo Wei Chan

Mechanisms are provided to implement a machine learning training model. The machine learning training model trains an image generator of a generative adversarial network (GAN) to generate medical images approximating actual medical images. The machine learning training model augments a set of training medical images to include one or more generated medical images generated by the image generator of the GAN. The machine learning training model trains a machine learning model based on the augmented set of training medical images to identify anomalies in medical images. The trained machine learning model is applied to new medical image inputs to classify the medical images as having an anomaly or not.

Generative adversarial network medical image generation for training of a classifier

Embodiments described herein provide methods and systems for generating data samples with enhanced attribute values. Some embodiments of the disclosure disclose a deep neural network framework with an encoder, a decoder, and a latent space therebetween, that is configured to extrapolate beyond the attributes of samples in a training distribution to generate data samples with enhanced attribute values by learning the latent space using a combination of contrastive objective, smoothing objective, cycle consistency objective, and a reconstruction loss.

Methods and system for deep learning model generation of samples with enhanced attributes

The present disclosure provides systems and methods for controllable protein generation. According to some embodiments, the systems and methods leverage neural network models and techniques that have been developed for other fields, in particular, natural language processing (NLP). In some embodiments, the systems and methods use or employ models implemented with transformer architectures developed for language modeling and apply the same to generative modeling for protein engineering.

Systems and methods for language modeling of protein engineering

An analytics system uses one or more machine-learned models to predict a hormone receptor status from a H&E stain image. The system partitions H&E stain images each into a plurality of non-overlapping image tiles. Bags of tiles are created through sampling of the image tiles. For each H&E stain image, the system generates a feature vector from a bag of tiles sampled from the partitioned image tiles. The analytics system trains one or more machine-learned models with training H&E stain images having a positive or negative receptor status. With the trained models, the analytics system predicts a hormone receptor status by applying a prediction model to the feature vector for a test H&E stain image.

Machine-learned hormone status prediction from image analysis

An analytics system uses one or more machine-learned models to predict a hormone receptor status from a H&E stain image. The system partitions H&E stain images each into a plurality of image tiles. Bags of tiles are created through sampling of the image tiles. The analytics system trains one or more machine-learned models with training H&E stain images having a positive or negative receptor status. The analytics system generates, via a tile featurization model, a tile feature vector for each image tile a test bag for a test H&E stain image. The analytics system generates, via an attention model, an aggregate feature vector for the test bag by aggregating the tile feature vectors of the test bag, wherein an attention weight is determined for each tile feature vector. The analytics system predicts a hormone receptor status by applying a prediction model to the aggregate feature vector for the test bag.

Mechanisms are provided to implement a generative adversarial network (GAN). A discriminator of the GAN is configured to discriminate input medical images into a plurality of classes including a first class indicating a medical image representing a normal medical condition, a second class indicating an abnormal medical condition, and a third class indicating a generated medical image. A generator of the GAN generates medical images and a training medical image set is input to the discriminator that includes labeled medical images, unlabeled medical images, and generated medical images. The discriminator is trained to classify training medical images in the training medical image set into corresponding ones of the first, second, and third classes. The trained discriminator is applied to a new medical image to classify the new medical image into a corresponding one of the first class or second class. The new medical image is either labeled or unlabeled.

Medical image classification based on a generative adversarial network trained discriminator

Mechanisms are provided to implement a neural network, a concept extractor, and a machine learning model that operate to provide automatic contour annotation of medical images based on correlations with medical reports. The neural network processes a medical image to extract image features of the medical image. The concept extractor processes a portion of text associated with the medical image to extract concepts associated with the portion of text. The machine learning model correlates the extracted image features with the extracted concepts. An annotated medical image is generated based on the correlation of the extracted image features and extracted concepts. An annotation of the annotated medical image specifies a region of interest corresponding to both an extracted image feature and an extracted concept, thereby automatically mapping the portion of text to a relevant region of the medical image.

Automatic contour annotation of medical images based on correlations with medical reports

Mechanisms are provided to implement a generative adversarial network (GAN) that is trained based on labeled image data, unlabeled image data, and generated image data generated by a generator of the GAN. The GAN comprises a loss function that comprises error components for each of the labeled image data, unlabeled image data, and generated image data which is used to train the GAN. A new data source for which the trained GAN is to be adapted is identified and the trained GAN is adapted for the new data source. Image data in the new data source is classified by applying the adapted GAN to the data in the new data source. Adapting the trained GAN includes obtaining a minimized set of labeled images and utilizing the minimized set of images to perform the adapting of the trained GAN.

Growing community of inventors

Oakland, CA, United States of America

Ali Madani