Achieving at least substantially constant processing request throughput within environment having varying resource availability

Abstract

Resource loads are determined based on normalized factors that are themselves based on resource factors. The following is repeated until each resource's load is less than or equal to the resource's willingness capacity or until all the resources are each fully loaded or unavailable. Each resource's willingness capacity is determined based on the resource's willingness parameter. The willingness parameter indicates at least whether a resource is willing to receive a number of processing requests no greater than a maximum or a minimum request limit. A throughput overflow is determined for each resource having a load greater than its willingness capacity. The load for each resource having a throughput overflow greater than zero is reset. The load for each resource that is available and not fully loaded is updated based on new normalized factors and based on a potential throughput loss that is equal to a sum of the throughput overflows.