Method and system for performing workloads in a data cluster

Abstract

Techniques described herein relate to systems, methods, and non-transitory computer readable mediums for performing workloads on hardware configurations. The method includes determining compliant hardware configurations of the data cluster using workload features associated with the workload, hardware specification information associated with hardware of data nodes of a data cluster, and a first machine learning model; generating performance predictions associated with the compliant hardware configurations using the workload features, a portion of the hardware specification information associated with the compliant hardware configurations, and a second machine learning model; and generating a recommendation using the performance predictions, and the recommendation specifies a hardware configuration of the compliant hardware configurations. The workload is performed using the recommendation.