Dynamic selection of router groups to manage computing instances

Abstract

This disclosure describes techniques implemented partly by a service provider network for dynamically selecting between router groups to account for scaling up and/or scaling down of managed instances that are serving concurrent requests. Router groups define bandwidth allowances for routers that restrict the number of machine instances the routers are allowed to manage for individual user accounts. As concurrency of requests increases for a user account, rather than using more routers in a router group with a smaller bandwidth allowance, the techniques described herein include selecting a different router group for the user account that defines larger bandwidth allowances for user accounts. The service provider network may determine that the number of concurrent requests for a user account has passed a threshold for a router group, and select a new router group for routing new requests and managing containers of instances that are processing the existing concurrent requests.