International Business Machines Corporation

Jim Dewan

Tracy Michael Canada

Eduardo Kaufmann-Malaga

Techniques for data curation are provided. A data set is received for ingestion into a question answering system, where the data set includes a first question and a first answer. Relevance of the first question is validated by comparing the first question to a first question cluster in the question answering system, and it is determined that the first answer satisfies predefined security criteria. The first data set is evaluated to identify a set of references, and a generalized data set is generated by replacing each respective reference of the set of references with a corresponding entity identifier. The first generalized data set is then ingested into the question answering system.

Data curation for corpus enrichment

Techniques for automated training content generation are provided. A plurality of questions are retrieved, where each of the plurality of questions is associated with an answer in a plurality of answers. Further, it is determined that a first and a second answer in the plurality of answers are equivalent. A first question corresponding to the first answer and a second question corresponding to the second answer are identified, and a first question cluster including the first question and the second question is generated. The first question cluster is associated with at least one of the first answer and the second answer. Finally, upon determining that a number of questions in the plurality of questions that are included in the first question cluster exceeds a first predefined threshold, the first question cluster is ingested into a question answering system.

Growing community of inventors

Rhinebeck, NY, United States of America

Jim Dewan