Load rebalancing in a network-based system

Abstract

A load shedding mechanism and an endpoint selection mechanism may be used to rebalance loads of endpoints of a network-based service. The load shedding mechanism may monitor health information of one or more endpoints and determine whether to perform a load shedding operation based on the health information. In response to determining to perform the load shedding operation for a selected endpoint, the load shedding mechanism may, prior to a client close request for a keep-alive connection of the selected endpoint, trigger an early close of the keep-alive connection. In response to a corresponding client attempting to reconnect based at least in part on the early close, the endpoint selection mechanism may select another endpoint to form a keep-alive connection with the client.