International Business Machines Corporation

Satyananda Kashyap

Mehdi Moradi

Tanveer Fathima Syeda-Mahmood

Yaniv Gur

Ehsan Dehghan Marvast

Chun Lok Wong

David James Beymer

Alexandros Karargyris

Ahmed El Harouni

Hongzhi Wang

Anup Pillai

Ashutosh Jadhav

Joy Tzung-yu Wu

Joy Wu

Methods and systems for performing transfer learning with basis scaling and pruning. One method includes obtaining a pre-trained deep convolutional neural network (DCNN), decomposing each weight matrix of the DCNN, and decomposing each convolutional layer by applying the respective decomposed weight matrix to the convolution layer to form a first layer which comprises the left matrix for convolution, and a second layer which comprises the right matrix for convolution. The method also includes providing a basis-scaling convolutional layer having a weight matrix that is derived by a function of singular values and the right singular vectors and training the basis scaling factors of the basis-scaling convolutional layers.

Transfer learning with basis scaling and pruning

A computer-implemented method, a computer program product, and a computer system for introducing channel-scaling layers in a deep neural network. A computer receives a pre-trained deep neural network including convolutional layers followed by respective ones of activation layers, adds channel-scaling layers after the respective ones of the activation layers, where each of the channel-scaling layers includes scaling weights. The computer trains the scaling weights in the channel-scale layers. The computer removes, in the convolutional layers, channels whose corresponding scaling weights are lower than a predetermined threshold. The computer removes the channel-scaling layers. In response to determining that at least one convergence criterion is met, the computer provides a finally trained deep neural network.

Channel scaling: a scale-and-select approach for selective transfer learning

Mechanisms are provided to implement an automated medical imaging report generator which receives an input medical image and inputs the input medical image into a machine learning (ML) computer model trained to predict finding labels based on patterns of image features extracted from the medical image. The ML computer model generates a prediction of a finding label applicable to the input medical image in terms of a finding label prediction output vector. Based on the finding label prediction output vector, a lookup operation is performed, in a medical report database of previously processed medical imaging report data structures, to find a matching medical imaging report data structure corresponding to the finding label. An output medical imaging report is generated for the input medical image based on natural language content of the matching medical imaging report data structure.

Automatic generation of medical imaging reports based on fine grained finding labels

Methods and systems for determining a diagnostically unacceptable medical image. One system includes at least one electronic processor configured to receive a new medical image captured via a medical imaging device. The at least one electronic processor is also configured to determine a classification of the new medical image using a model developed with machine learning using training information that includes a plurality of medical images and an associated classification for each medical image, each associated classification identifying whether the associated medical image is diagnostically unacceptable, wherein the classification of the new medical image indicates whether the new medical image is diagnostically unacceptable. The at least one electronic processor is also configured to, when the classification indicates that the new medical image is diagnostically unacceptable, prompt a user of the medical imaging device to adjust a parameter associated with the new medical image and recapture the new medical image.

Methods and systems for determining a diagnostically unacceptable medical image

Medical imaging study summary engine mechanisms are provided. The mechanisms receive a medical imaging study having data representing a plurality of medical images of a patient. The mechanisms generate a temporal trajectory data structure of at least a subset of the medical images in the plurality of medical images, wherein the temporal trajectory data structure specifies topological changes in temporally subsequent medical images in the plurality of medical images. The mechanisms select medical image data corresponding to selected medical images from the medical imaging study data structure based on the temporal trajectory data structure. The mechanisms output the selected medical image data via a medical imaging study user interface.

Automatic summarization of medical imaging studies

A mechanism is provided in a data processing system comprising a processor and a memory, the memory comprising instructions that are executed by the processor to specifically configure the processor to implement a medical imaging story board creation engine. The medical imaging story board creation engine executing in the data processing system receives a patient data structure comprising a medical imaging study comprising a plurality of electronic medical images. The medical imaging story board creation engine analyzes the patient data structure to determine a modality of the medical imaging study. The medical imaging story board creation engine determines, based on the determined modality of the medical imaging study, for each electronic image in the medical imaging study, at least one of an image mode or viewpoint. The medical imaging story board creation engine performs a saliency feature extraction operation on the electronic medical images in the medical imaging study based on the image mode or viewpoint of each of the electronic medical images. The medical imaging story board creation engine selects a subset of electronic medical images based on results of the saliency feature extraction. The medical imaging story board creation engine generates and outputs a collection of selected electronic medical images based on the selection of the subset of electronic medical images to form a medical imaging story board.

Growing community of inventors

San Jose, CA, United States of America

Satyananda Kashyap