International Business Machines Corporation

Linda C Cham

Wei Li

Alexander Druyan

Kailash N Marthi

Yun Xiang

Chin Ngai Sze

Frank N Lee

Qingda Wang

Yi-Ling J Wong

A method, computer program product, and system for providing provenance tracking in a workflow system. The computer-implemented process provides for one or more processors to receive a workflow definition input. One or more processors perform workflow job commands, in response to receiving a workflow definition, and a workflow instance request. One or more processors access an input file associated with the workflow instance. One or more processors generate, at run-time, provenance metadata. One or more processors generate, at run-time, a global file identification (ID) associated with an output file. One or more processors link the global file ID and the provenance metadata to the output file of the workflow instance, and one or more processors store the output file, which includes the global file ID and the provenance metadata, both linked to the output file.

Reliable workflow system provenance tracking at runtime

A scheduler receives flexible reservation requests for scheduling in a computing environment comprising consumable resources. The flexible reservation request specifies a duration and a required resource. The consumable resources comprise machine resources and floating resources. The scheduler creates a flexible job for the flexible reservation request and places the flexible job in a prioritized job queue for scheduling, wherein the flexible job is prioritizes relative to at least one regular job in the prioritized job queue. The scheduler adds a reservation set to a waiting state for the flexible reservation request. The scheduler, responsive to detecting the flexible job positioned in the prioritized job queue for scheduling next and detecting a selection of consumable resources available to match the at least one required resource for the duration, transfers the selection of consumable resources to the reservation and sets the reservation to an active state.

Workflow control of reservations and regular jobs using a flexible job scheduler

A scheduler receives at least one flexible reservation request for scheduling in a computing environment comprising consumable resources. The flexible reservation request specifies a duration and at least one required resource. The consumable resources comprise at least one machine resource and at least one floating resource. The scheduler creates a flexible job for the at least one flexible reservation request and places the flexible job in a prioritized job queue for scheduling, wherein the flexible job is prioritizes relative to at least one regular job in the prioritized job queue. The scheduler adds a reservation set to a waiting state for the at least one flexible reservation request. The scheduler, responsive to detecting the flexible job positioned in the prioritized job queue for scheduling next and detecting a selection of consumable resources available to match the at least one required resource for the duration, transfers the selection of consumable resources to the reservation and sets the reservation to an active state, wherein the reservation is activated as the selection of consumable resources become available and has uninterrupted use of the selection of consumable resources for the duration by at least one job bound to the flexible reservation.

Growing community of inventors

Poughkeepsie, NY, United States of America

Linda C Cham