Automated extraction of structured labels from medical text using deep convolutional networks and use thereof to train a computer vision model

Abstract

A method is provided for processing medical text and associated medical images. A natural language processor configured as a deep conventional neural network is trained on a first corpus of curated free-text, medical reports each of which having one or more structured labels assigned by an medical expert. The network is trained to learn to read additional free-text medical reports and produce predicted structured labels. The natural language processor is applied to a second corpus of free-text medical reports that are associated with medical images. The natural language processor generates structured labels for the associated medical images. A computer vision model is trained using the medical images and the structured labels generated. The computer vision model can thereafter assign a structured label to a further input medical image. In one example, the medical images are chest X-rays.