Intel Corporation

Sigopt, Inc.

Pixar

Scott Clark

Patrick Hayes

Michael McCourt

Alexandra Johnson

Ben Hsu

Olivia Kim

Bolong Cheng

George Ke

Halley Nicki Vance

Timothy S Milliron

Robert G Podesta

Christopher R Schoeneman

Simon Howey

James Blomo

Kevin Tee

Sarth Frey

Taylor Jackie Spriggs

Taylor Jackle-Spriggs

Taylor Jackie Springs

A system and method for tuning hyperparameters and training a model includes implementing a hyperparameter tuning service that tunes hyperparameters of a model that includes receiving, via an API, a tuning request that includes: (i) a first part comprising tuning parameters for generating tuned hyperparameter values for hyperparameters of the model; and (ii) a second part comprising model training control parameters for monitoring and controlling a training of the model, wherein the model training control parameters include criteria for generating instructions for curtailing a training run of the model; monitoring the training run for training the model based on the second part of the tuning request, wherein the monitoring of the training run includes periodically collecting training run data; and computing an advanced training curtailment instruction based on the training run data that automatically curtails the training run prior to a predefined maximum training schedule of the training run.

Systems and methods for tuning hyperparameters of a model and advanced curtailment of a training of the model

A system and method for accelerated tuning of hyperparameters includes receiving a multi-task tuning work request for tuning hyperparameters of a model, wherein the multi-task tuning work request includes: a full tuning task for tuning hyperparameters, wherein the full tuning task includes a first set of tuning parameters governing a first tuning operation; a partial tuning task for tuning the hyperparameters of the model, wherein the partial tuning task includes a second distinct set of tuning parameters governing a second tuning operation; executing the first tuning operation and the second tuning operation; generating a first suggestion set and a second suggestion set of one or more proposed values for the hyperparameters based on the execution of the full tuning task and the partial tuning task; and setting the partial tuning task as a proxy for the full tuning task thereby accelerating a tuning of the hyperparameters of the model.

Systems and methods for an accelerated tuning of hyperparameters of a model using a machine learning-based tuning service

Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposed hyperparameter values.

Systems and methods for implementing an intelligent application program interface for an intelligent optimization platform

Systems and methods for an accelerated tuning of hyperparameters of a model supported with prior learnings data include assessing subject models associated with a plurality of distinct sources of transfer tuning data, wherein the assessing includes implementing of: [1] a model relatedness assessment for each of a plurality of distinct pairwise subject models, and [2] a model coherence assessment for each of the plurality of distinct pairwise subject models; constructing a plurality of distinct prior mixture models based on the relatedness metric value and the coherence metric value for each of the plurality of distinct pairwise subject models, identifying sources of transfer tuning data based on identifying a distinct prior mixture model having a satisfactory model evidence fraction; and accelerating a tuning of hyperparameters of the target model based on transfer tuning data associated with the distinct prior mixture model having the satisfactory model evidence fraction.

Systems and methods for an accelerated and enhanced tuning of a model based on prior model tuning data

A disclosed example includes implementing a first worker instance and a second worker instance to operate in parallel; running a first tuning operation via the first worker instance to tune first hyperparameters; running a second tuning operation via the second worker instance using a Bayesian-based optimization to determine a hyperparameter configuration to evaluate next; evaluating the hyperparameter configuration for an external model using a surrogate model; and selecting the hyperparameter configuration for the external model.

Systems and methods implementing an intelligent optimization platform

Systems and methods for tuning hyperparameters of a model include receiving a tuning request for tuning hyperparameters, the tuning request includes a first and a second objective function for the machine learning model. The first and second objective functions may output metric values that do not improve uniformly. Systems and methods additionally include defining a joint tuning function that is based on a combination of the first and second objective functions; executing a tuning operation; identifying a Pareto efficient frontier curve defined by a plurality of distinct hyperparameter values; applying metric thresholds to the Pareto efficient frontier curve; demarcating the Pareto efficient frontier curve into at least a first infeasible section and a second feasible section; searching the second feasible section of the Pareto efficient frontier curve for one or more proposed hyperparameter values; and identifying at least a first set of proposed hyperparameter values based on the search.

Systems and methods for implementing an intelligent tuning of multiple hyperparameter criteria of a model constrained with metric thresholds

Disclosed examples include after a first tuning of hyperparameters in a hyperparameter space, selecting first hyperparameter values for respective ones of the hyperparameters; generating a polygonal shaped failure region in the hyperparameter space based on the first hyperparameter values; setting the first hyperparameter values to failure before a second tuning of the hyperparameters; and selecting second hyperparameter values for the respective ones of the hyperparameters in a second tuning region after the second tuning of the hyperparameters in the second tuning region, the second tuning region separate from the polygonal shaped failure region.

Systems and methods implementing an intelligent machine learning tuning system providing multiple tuned hyperparameter solutions

Systems and methods for tuning hyperparameters of a model includes: receiving a multi-criteria tuning work request for tuning hyperparameters of the model of the subscriber to the remote tuning service, wherein the multi-criteria tuning work request includes: a first objective function of the model to be optimized by the remote tuning service; a second objective function to be optimized by the remote tuning service, the second objective function being distinct from the first objective function; computing a joint tuning function based on a combination of the first objective function and the second objective function; executing a tuning operation of the hyperparameters for the model based on a tuning of the joint function; and identifying one or more proposed hyperparameter values based on one or more hyperparameter-based points along a convex Pareto optimal curve.

Systems and methods for implementing an intelligent machine learning optimization platform for multiple tuning criteria

A system and method includes receiving a tuning work request for tuning an external machine learning model; implementing a plurality of distinct queue worker machines that perform various tuning operations based on the tuning work data of the tuning work request; implementing a plurality of distinct tuning sources that generate values for each of the one or more hyperparameters of the tuning work request; selecting, by one or more queue worker machines of the plurality of distinct queue worker machines, one or more tuning sources of the plurality of distinct tuning sources for tuning the one or more hyperparameters; and using the selected one or more tuning sources to generate one or more suggestions for the one or more hyperparameters, the one or more suggestions comprising values for the one or more hyperparameters of the tuning work request.

Systems and methods include receiving a tuning work request for tuning hyperparameters of a third-party model or system; performing, by a machine learning-based tuning service, a first tuning of the hyperparameters in a first tuning region; identifying tuned hyperparameter values for each of the hyperparameters based on results of the first tuning; setting a failure region based on the tuned hyperparameter values of the first tuning; performing, by the machine learning-based tuning service, a second tuning of the hyperparameters in a second tuning region that excludes the failure region; identifying additional tuned hyperparameter values for each of the hyperparameters based on results of the second tuning; and returning the tuned hyperparameter values and the additional hyperparameter values for implementing the third-party model or system with one of the tuned hyperparameter values and the additional hyperparameter values.

Growing community of inventors

San Francisco, CA, United States of America

Scott Clark