Adaptive throttling of calls to service endpoints from workflows by modifying workflow definitions

Abstract

Systems and methods for a workflow manager to adaptively throttle service calls to service endpoints are disclosed herein, according to some embodiments. A system includes a plurality of service endpoints. The system also includes a workflow definition repository storing workflow definitions, where a workflow definition defines both tasks for a workflow to perform that corresponds to service calls to the service endpoints, and a dependency ordering between the tasks. The system also includes workflow execution nodes implementing workflow engine instances. A workflow engine instance executes a workflow according to a workflow definition. Responsive to health information indicating that a service endpoint is operating below a performance threshold, the workflow manager modifies workflow definitions using that service to incorporate a staging area. Instead of transitioning to a task that corresponds to a service call to the service endpoint, the workflow engine instances executing modified workflow definitions, transition to the staging area.