International Business Machines Corporation

Christopher James Karle

William Graham O'Keeffe

David Deidou Taieb

Sabrina Yee

Ketan T Patel

Kenneth M Giffels

Richard Scott Schwerdtfeger

Corinne M Ryan

A mechanism is provided in a data processing system for automatically generating question and answer pairs for training a question answering system for a given domain. The mechanism receives user input of question text for a question to be submitted to a question answering system in a user interface. The mechanism determines a question strength score for the question text. The question strength score represents a likelihood the question text will result in a correct answer with high confidence. The mechanism presents a graphical representation of the question strength score in the user interface.

Displaying quality of question being asked a question answering system

The technique herein substantially improves productivity of Annotator developers by providing methods and systems to develop and test Annotators without having to run a full pipeline every time changes are made to a particular Annotator. To this end, preferably a running pipeline is instrumented to enable automated recording of static configuration and dynamically-generated event data as the pipeline is executed. Based on these data, a reusable data model is generated that captures code and other dependencies in the pipeline (e.g., configuration parameters, intermediary CASes, program flow, annotations, and the like). The data model is then used to facilitate testing of Annotators without using the full pipeline (or even major sub-pipelines therein).

Recording, replaying and modifying an unstructured information management architecture (UIMA) pipeline

An approach is provided for monitoring the health of a Question/Answer (QA) Computing System. In the approach, performed by an information handling system, a number of static questions are periodically submitted to the QA system, wherein each of the static questions corresponds to a previously established verified answer. Responses are received from the QA system, with the responses including answers corresponding to the submitted static questions. Monitoring the performance of the QA system based on the received responses. When the monitoring detects a problem with the QA system, a user is notified of the detected problem.

Monitoring the health of a question/answer computing system

A pipeline development environment includes a toolset that includes a visual design editor. The editor comprises a display interface having a palette of known Annotators that may be selected by a developer. The pipeline development environment also includes or has associated therewith a data repository. The data repository stores datasets. A particular dataset is associated with an Annotator and comprises dependency data generated from execution of a pipeline (or some portion thereof). The repository typically stores datasets from many pipeline runs, including runs of other pipelines, multiple runs of a given pipeline with different inputs, etc. Using the editor, a developer creates a visual representation of the pipeline. As Annotators are added into the pipeline, system tooling dynamically generates the descriptor files and other configuration parameters (for the new pipeline), preferably based on the dependency data associated with the individual Annotators and retrieved from the repository.

Dynamically building an unstructured information management architecture (UIMA) pipeline

A mechanism is provided for enforcing accessible content development. The mechanism enforces accessible content development by accessing a tag library descriptor for each of a plurality of markup tags for web content authoring where the tag library descriptor notes one or more tag sub-elements required for accessibility. The mechanism analyzes each markup tag in a piece of web content by comparing the tag library descriptor accessibility requirements to sub-elements included with each markup tag to determine whether all required accessibility sub-elements are present. The mechanism generates an error message if all required accessibility sub-elements of a markup tag are not present.

Growing community of inventors

Wayland, MA, United States of America

Christopher James Karle