Configuration process framework for machine learning models

Abstract

Various embodiments are directed to configuring or training deep neural network (DNN) machine learning models comprising one or more hidden layers and an output layer. Various embodiments provide technical advantages in training DNN machine learning models, including improved computational efficiency and guaranteed optimality. In one embodiment, an example method includes identifying a nonlinear-model-based representation for each hidden layer, which may be a Bank of Wiener Models, a nonlinear units of the hidden layer, and/or the like. The method further includes individually and sequentially configuring the hidden layers, each configured by determining a correlation measure (e.g., a correlation ratio) between the layer output and a target signal. Parameters of the particular hidden layer are modified by maximizing the correlation measure to yield maximal correlation over the space of functions. The method further includes performing automated tasks using the DNN machine learning model after configuring its parameters on a training set.