International Business Machines Corporation

Qingda Wang

Chin Ngai Sze

Frank N Lee

Linda C Cham

Yi Min Zhang

Jia Xin Gao

Kinson Chik

Qiang Jia

Yi-Ling J Wong

Dang Peng Liu

A method, computer program product, and system for providing provenance tracking in a workflow system. The computer-implemented process provides for one or more processors to receive a workflow definition input. One or more processors perform workflow job commands, in response to receiving a workflow definition, and a workflow instance request. One or more processors access an input file associated with the workflow instance. One or more processors generate, at run-time, provenance metadata. One or more processors generate, at run-time, a global file identification (ID) associated with an output file. One or more processors link the global file ID and the provenance metadata to the output file of the workflow instance, and one or more processors store the output file, which includes the global file ID and the provenance metadata, both linked to the output file.

Reliable workflow system provenance tracking at runtime

For workflow test, a processor executes a workflow instance. The workflow instance includes a first workflow description of step names for a plurality of jobs. The processor further receives a modification to the first workflow description as the workflow instance executes. In addition, the processor synchronizes the modified workflow description to the executing workflow instance as the workflow instance executes. A workflow context of the executing workflow instance is preserved.

Method to design and test workflows

Growing community of inventors

Richmond Hill, Canada

Qingda Wang