Fallback capacity providers for capacity management of workload infrastructure

Abstract

Techniques implemented by a cloud computing system for providing fallback capacity providers to ensure that infrastructure capacity required to run containerized services is available despite primary capacity providers experiencing a failure. Cloud providers offer container-management services that automate the management and scaling of containerized services of users. The container-management services are supported by capacity providers that manage the computing infrastructure on which the containerized services run (e.g., servers, VMs, etc.). However, there are times when a capacity provider is unable to provision capacity for containerized services, such as due to a large scale failure. Rather than leaving capacity requests unserved, the container-management service designates a fallback capacity provider that acts as a failover for provisioning requested infrastructure capacity. The fallback capacity providers have different provisioning paths than the primary capacity providers, and thus different availability postures and failure modes, to ensure resiliency in provisioning capacity for containerized services.