International Business Machines Corporation

Antonio Foncubierta Rodriguez

Maria Gabrani

Guillaume Jaume

Pushpak Pati

Konstantinos Bekas

Matteo Manica

Kevin Thandiackal

Joris Cadow

Waleed Farrukh

A computer-implemented method for enforcing an idempotent-constrained characteristic during training of a neural network may be provided. The method comprises training of a neural network by minimizing a loss function, wherein the loss function comprises an additional term imposing an idempotence-based regularization to the neural network during the training.

Idempotence-constrained neural network

Methods and systems are provided for processing different-modality digital images of tissue. The method includes, for each image, detecting biological entities in the image and generating an entity graph comprising entity nodes, representing respective biological entities, interconnected by edges representing interactions between entities represented by the entity nodes. The method also includes selecting, from each image, anchor elements comprising elements corresponding to anchor elements of at least one other image, and generating an anchor graph in which anchor nodes, representing respective anchor elements, are interconnected with entity nodes of the entity graph for the image by edges indicating relations between entity nodes and anchor nodes. The method further includes generating a multimodal graph by interconnecting anchor nodes of the anchor graphs for different images via correspondence edges indicating correspondence between anchor nodes, and processing the multimodal graph to output multimodal data, derived from the plurality of images, for medical evaluation.

Processing multimodal images of tissue for medical evaluation

Computer-implemented methods and systems are provided for interpreting a whole-slide image of a tissue specimen. Such a method includes detecting biological entities in a region of interest independently at each magnification level in a whole-slide image. An entity graph is generated for each magnification level, the entity graph comprising nodes, representing respective biological entities detected at that magnification level, interconnected by edges representing interactions between entities. The method also includes, for each region of interest, generating a hierarchical graph, defining a hierarchy of the entity graphs for that region, in which nodes of different entity graphs are interconnected by hierarchical edges representing hierarchical relations between nodes of the entity graphs. The method further comprises supplying the hierarchical graph for the region to an AI system to produce result data corresponding to a medical evaluation of the tissue specimen represented thereby, and outputting the result data for the tissue specimen.

Interpretation of whole-slide images in digital pathology

A system and process for extracting information from filled form images is described. In one example, the claimed invention first extracts textual information and the hierarchy in a blank form. This information is then used to extract and understand the content of filled forms. In this way, the system does not have to analyze from the beginning each filled form. The system is designed so that it remains as generic as possible. The number of hard-coded rules in the whole pipeline was minimized to offer an adaptive solution able to address the largest number of forms, with various structures and typography. The system is also created to be integrated as a built-in function in a larger pipeline. The form understanding pipeline could be the starting point of any advanced Natural Language Processing application.

Extracting structured information from a document containing filled form images

A system and process for extracting information from filled form images is described. In one example the claimed invention first extracts textual information and the hierarchy in a blank form. This information is then used to extract and understand the content of filled forms. In this way, the system does not have to analyze from the beginning each filled form. The system is designed so that it remains as generic as possible. The number of hard coded rules in the whole pipeline was minimized to offer an adaptive solution able to address the largest number of forms, with various structures and typography. The system is also created to be integrated as a built-in function in a larger pipeline. The form understanding pipeline could be the starting point of any advanced Natural Language Processing application.

Computer-implemented methods are provided for generating a data structure representing tabular information in a scanned image. Such a method can include storing image data representing a scanned image of a table, processing the image data to identify positions of characters and lines in the image, and mapping locations in the image of information cells, each containing a set of the characters, in dependence on said positions. The method can also include, for each cell, determining cell attribute values, dependent on the cell locations, for a predefined set of cell attributes, and supplying the attribute values as inputs to a machine-learning model trained to pre-classify cells as header cells or data cells in dependence on cell attribute values.

Data structure generation for tabular information in scanned images

A method of determining a hierarchy of a blank template using an image of the blank template and using the determined hierarchy for providing labels and field values of text lines of a filled form document.

Method and system for extracting information from an image of a filled form document

A method for extracting information from a molecular pathway diagram may be provided. The method includes providing a molecular pathway diagram, detecting basic graphical structural elements in the diagram resulting in a set of basic objects, detecting a graphical semantic of each of the basic graphical structural elements resulting in a set of structural primitives, and detecting a graphical syntax of the basic graphical structural element relative to each other and to the diagram. Furthermore, the method includes assigning metadata to a plurality of the detected basic graphical structural elements, where the metadata includes basic graphical structural element data, graphical semantic data and graphical syntax data resulting in a set of entities and relationships.

Growing community of inventors

Zurich, Switzerland

Antonio Foncubierta Rodriguez