Service-level detection of latency anomalies in a computing platform

Abstract

A technique detects latency-related anomalies that occur in performing provisioning actions in a network-accessible computing platform. Illustrative provisioning actions include creating a resource (e.g., a virtual machine), updating the resource, and deleting the resource. The technique operates by detecting and reporting the latency-related anomalies on a service-level granularity. The technique also provides access to operation-level latency-related data to assist in diagnosing the causes of the anomalies. In some implementations, the technique consolidates incidents that potentially reveal a common source of failure into a single report. In some implementations, the technique interacts with a machine-trained language model to confirm whether a reported incident is a false positive which does not warrant further action. The technique performs this function by sending a prompt to the language model that expresses a current incident and one or more prior incidents that have been determined to match the current incident.