Distributed computer task management of interrelated network computing tasks

Abstract

A system can manage distribution of computing jobs among a plurality of third-party network or cloud computing providers to maximize utilization of available computing resources purchased or otherwise obtained by an entity. The system can determine a dependency relationship between jobs and distribute the jobs among the network computing providers based at least in part on the dependency relationship between the jobs. Moreover, the system can use machine learning algorithms to generate one or more prediction algorithms to predict future computing resource usage demands for performing a set of scheduled and unscheduled jobs. Based at least in part on the resource prediction, the dependency relationship between jobs, service level agreements with network computing service providers, and job resource requirements, the system can determine an improved or optimal distribution of jobs among the network computing service providers that satisfies or best satisfies one or more objective functions to maximize resource utilization.