Dynamically tuning hyperparameters during ml model training

Abstract

A method of automatically tuning hyperparameters includes receiving a hyperparameter tuning strategy. Upon determining that one or more computing resources exceed their corresponding predetermined quota, the hyperparameter tuning strategy is rejected. Upon determining that the one or more computing resources do not exceed their corresponding predetermined quota, a machine learning model training is run with a hyperparameter point. Upon determining that one or more predetermined computing resource usage limits are exceeded for the hyperparameter point, the running of the machine learning model training is terminated for the hyperparameter point and the process returns to running the machine learning model training with a new hyperparameter point. Upon determining that training the machine learning model is complete, training results are collected and computing resource utilization metrics are determined. A correlation of the hyperparameters to the computing resource utilization is determined from the completed training of the machine learning model.