Automated monitoring and auditing failed and recovered batch data tasks

Abstract

The disclosure herein describes automatically monitoring and auditing the performance of batch data tasks associated with a data warehouse. A failure status indicator associated with a batch data task is detected in a task status log associated with the data warehouse. Based on detecting the failure status indicator, the task status log is polled for a recovery status indicator associated with the batch data task. Based on detecting the recovery status indicator associated with the batch data task, audit programs associated with the batch data task are initiated and audit results is received therefrom. Based on the received audit results, an audit result indicator is provided, the audit result indicator including an audit success indicator or an audit failure indicator. The described system provides efficient auditing feedback regarding failed batch data tasks to responsible parties associated with those tasks, enabling efficient detection of and response to potential data errors.