Providing visibility and recommendations for batch processing

Abstract

Techniques implemented by batch-processing service to provide users with visibility around execution metrics for their batch jobs, and determine more optimal scheduling policies and/or scaling algorithms for executing batch jobs. The batch-processing service may collect telemetry data for batch jobs, and analyze the telemetry data to generate execution metrics for the batch jobs. The batch-processing service uses these execution metrics to generate various visualizations that may be presented to users to provide the users with more visibility into the performance of their batch jobs. Additionally, the batch-processing service may analyze the execution metrics, and determine more optimized scheduling policies and/or scaling algorithms to use for running the batch jobs. In this way, the batch-processing service can increase the visibility given to users around the performance of their batch jobs, and can also identify modifications to scheduling and scaling in order to improve the performance of the batch jobs.