International Business Machines Corporation

Hongsheng Liu

Dung Tien Phan

Lam Nguyen

Pavankumar Murali

In an approach to hyperparameter optimization, one or more computer processors express a hyperparameter tuning process of a model based on a type of model, one or more dimensions of a training dataset, associated loss function of the model, and associated computational constraints of the model, comprising: identifying a set of optimal hyper-rectangles based a calculated local variability and a calculated best function value; calculating a point as a representative for each identified potentially optimal hyper-rectangle by locally searching over the identified set of potentially optimal hyper-rectangles; dividing one or more hyper-rectangles in the identified set of optimal hyper-rectangles into a plurality of smaller hyper-rectangles based on each calculated point; and calculating one or more optimal hyperparameters utilizing a globally converged hyper-rectangle from the plurality of smaller hyper-rectangles. The one or more computer processors classify one or more unknown datapoints utilizing the model associated with tuned hyperparameters.

Tuning classification hyperparameters

Aspects of the invention include implemented method includes selecting an optimization algorithm for the control system of a processing plant based on whether the control system is guided by a linear-based predictive model or a non-linear-based predictive model, in which a gradient is available. Calculating set-point variables using the optimization algorithm. Predicting an output based on the calculated set-point variables. Comparing an actual output at the processing plant to the predicted output. Suspending a physical process at the processing plant in response to the actual output being a threshold value apart from the predicted output.

Growing community of inventors

Chapel Hill, NC, United States of America

Hongsheng Liu