Sas Institute Inc.

Xindian Long

Joshua David Griffin

Lawrence Edmund Lewis

Steven E Krueger

Yan Xu

Liping Cai

Jorge Manuel Gomes Da Silva

Ralph Walter Abbey

Scott Russell Pope

Mohammadreza Nazari

Amirhassan Fallah Dizche

Xingqi Du

A system, method, and computer-program product includes selecting, by a controller node, a plurality of candidate hyperparameter search points from a hyperparameter search space; instructing, by the controller node, one or more worker nodes to concurrently train a plurality of machine learning models for a target number of epochs using the plurality of candidate hyperparameter search points; identifying, by the controller node, a collection of intermediate candidate hyperparameter search points that outperform a remainder of the plurality of candidate hyperparameter search points by evaluating a performance of the plurality of machine learning models after training for the target number of epochs; and performing, by the controller node, a crossover operation with the collection of intermediate candidate hyperparameter search points to identify one or more new candidate hyperparameter search points to test in the hyperparameter search space.

Systems and methods for parallel exploration of a hyperparameter search space

A system, method, and computer-program product includes commencing a parent computer process based on receiving a request to perform an analytical operation on one or more datasets, commencing at least one child computer process that is launched by the parent computer process when the parent computer process initiates an execution of the analytical operation on the one or more datasets, transmitting, by the at least one child computer process, a request to the parent computer process to retrieve the one or more datasets, writing, by the parent computer process, the one or more datasets to a cross-process queue based on the parent computer process receiving the requests, reading, by the at least one child computer process, the one or more datasets from the cross-process queue, and executing, using an analytical application executing on the least one child computer process, the analytical operation based on the one or more datasets.

Systems and methods for executing an analytical operation across a plurality of computer processes

A system, method, and computer-program product includes computing, by a controller node, a hyperparameter search space for a plurality of hyperparameters; selecting, by the controller node, a plurality of hyperparameter search points from the hyperparameter search space; instructing, by the controller node, one or more worker nodes to concurrently train a plurality of machine learning models based on the plurality of hyperparameter search points; receiving, from the one or more worker nodes, a plurality of performance metrics that measure a performance of the plurality of machine learning models; determining, by the controller node, one or more sets of optimal hyperparameter values based on the plurality of performance metrics; and outputting, by the controller node, the one or more sets of optimal hyperparameter values.

A system, method, and computer-program product includes receiving, by a worker process, a plurality of chunks of data from a client process; deriving, by the worker process, an input pattern for feeding the plurality of chunks of data to a machine learning model; caching, by the worker process, a subset of data elements of the plurality of chunks of data specified by the input pattern based on a data caching policy; and training the machine learning model by feeding the subset of data elements cached by the worker process and a remainder of data elements in the plurality of chunks of data when requested by the input pattern.

Systems and methods for multi-language training of machine learning models

A system, method, and computer-program product includes receiving, by a controller node, a request to execute a client process associated with a first programming language and a plurality of threads; launching, by the controller node, a plurality of multi-language worker processes based on a number of threads associated with the client process; and instructing, by the controller node, the plurality of multi-language worker processes to execute the plurality of threads associated with the client process.

A system, method, and computer-program product includes selecting, by a controller node, a plurality of hyperparameter search points from a hyperparameter search space; instructing, by the controller node, one or more worker nodes to concurrently train a plurality of machine learning models for a target number of epochs using the plurality of hyperparameter search points; receiving, from the one or more worker nodes, a plurality of performance metrics that measure a performance of the plurality of machine learning models during the target number of epochs; and removing, by the controller node, one or more underperforming hyperparameter search points from the plurality of hyperparameter search points according to a pre-defined performance metric ranking criterion associated with the plurality of performance metrics.

Growing community of inventors

Cary, NC, United States of America

Xindian Long