Generational management of compute resource pools

Abstract

Provided is a system for managing a pool of compute resources usable to execute user codes such as containerized software applications. The pool may include a plurality of sub-pools of compute instances that are each suited to handle a specific type of code execution requests and/or a specific set of capacity or resource configurations. For example, when a code execution request is received, the system may determine compute capacity from which sub-pool would be best suited to handle the request, and direct the request to that sub-pool (or execute the user code using compute capacity from that sub-pool). Each sub-pool may be assigned a generational indicator that indicates its level of use (e.g., rarely used, moderately use, frequently used, etc.) and/or its age (e.g., brand new, young, old, etc.). As a sub-pool experiences continued use, the sub-pool may be promoted and its retention/replenishment policy may be updated accordingly.