Automatic reconfiguration of high performance computing job schedulers based on user behavior, user feedback, and job performance monitoring

Abstract

A job in a high performance computing system is executed according to a current scheduler configuration. The job is monitored to determine the job's actual resource usage, the job's performance metric and the job's completion. Responsive to determining that the job completed executing, a difference is computed between allocated resources allocated according to the current scheduler configuration at job submission for execution on the high performance computing system and the job's actual resource usage at the job's completion, wherein the difference is computed for each of N number of jobs that complete executing on the high performance computing system, wherein all of the N number of jobs are associated with a given user. Responsive to determining that the difference for said each of N number of jobs meets a criterion, the current scheduler configuration is automatically reconfigured to reduce the allocated resources for the jobs associated with the given user.