International Business Machines Corporation

Vivek Krishnamurthy

Sheng Hua Bao

Ramani Ranjan Routray

Eitan D Farchi

Cartic Ramakrishnan

Orna Raz

Pathirage D S U Perera

Pathirage Dinindu Sujan Udayanga Perera

A mechanism is provided in a data processing system having a processor and a memory. The memory comprises instructions which are executed by the processor to cause the processor to implement a training system for finding an optimal surface for hierarchical classification task on an ontology. The training system receives a training data set and a hierarchical classification ontology data structure. The training system generates a neural network architecture based on the training data set and the hierarchical classification ontology data structure. The neural network architecture comprises an indicative layer, a parent tier (PT) output and a lower leaf tier (LLT) output. The training system trains the neural network architecture to classify the training data set to leaf nodes at the LLT output and parent nodes at the PT output. The indicative layer in the neural network architecture determines a surface that passes through each path from a root to a leaf node in the hierarchical ontology data structure. The training system trains a classifier model for a cognitive system using the surface and the training data set.

Optimizing hierarchical classification with adaptive node collapses

A method, a system, and a computer program product are provided. A training set of adverse event text fragments assigned to medical codes is analyzed to determine first text fragments having frequently occurring medical code assignments and second text fragments having infrequently occurring medical code assignments. The training set is modified to undersample the first text fragments and to oversample the second text fragments such that the text fragments of the modified training set correspond to a substantially uniform assignment of the medical codes. At least one machine learning model is generated and trained with the modified training set. Some parameters of the at least one machine learning model are updated based on errors detected during the training. After completing the training, an adverse event text fragment is applied to the at least one machine learning model to assign at least one medical code.

Automatic classification of adverse event text fragments

Growing community of inventors

San Jose, CA, United States of America

Vivek Krishnamurthy