International Business Machines Corporation

Zhichao Su

Kuan Feng

Junfeng Liu

Yi Zhao

Qing Xu

King Shing K Lui

Embodiments for efficient machine and deep learning hyperparameter tuning in a distributed computing system. Runtime metrics of each training iteration are collected to identify candidate jobs to merge during an execution phase. The candidate jobs are grouped into job groups, and the job groups containing the candidate jobs are merged together subsequent to each iteration boundary for execution during the execution phase.

Job merging for machine and deep learning hyperparameter tuning

Embodiments for accelerator allocation and reclamation for deep learning jobs in a computing cluster. Metrics are recorded of each accelerator of a set of accelerators allocated to a deep learning job including computing a gain of computational power by an additional allocation of new accelerators and computing a cost of transferring data among the new accelerators and the set of allocated accelerators. Ones of the new accelerators are allocated to the deep learning job or ones of the set of allocated accelerators assigned to perform the deep learning job are reclaimed upon determining an optimal accelerator topology by comparing the gain of computation power and the cost of transferring data.

Smart accelerator allocation and reclamation for deep learning jobs in a computing cluster

Embodiments for dynamic accelerator scheduling and grouping for deep learning jobs in a computing cluster. An efficiency metric of each job executing in the computing cluster is calculated to generate a prioritized job queue. Accelerator re-grouping execution plans are then generated based on the prioritized job queue, the accelerator re-grouping execution plans associated with a target cluster topology to be achieved according to the placement of selected jobs from the prioritized job queue in relation to a location of respective ones of a plurality of accelerators within the computing cluster. One of the accelerator re-grouping execution plans is executed to allocate the selected jobs to the respective ones of the plurality of accelerators to thereby shift the computing cluster to the target cluster topology.

Growing community of inventors

Beijing, China

Zhichao Su