Managing compute clusters for data platforms

Abstract

In general, techniques are described that enable a computing system comprising a memory and processing circuitry to manage computing devices and deployment of a data platform. The memory may store services forming a control plane of a data platform. The processing circuitry may execute a container orchestration platform that configures the computing devices to execute a container, and execute the container managed by the container orchestration platform to implement an application orchestrator that interfaces with the container orchestration platform to automatically manage deployment of the services forming the control plane of the data platform. The application orchestrator may obtain an indication of an underlying architecture of the one or more computing devices, and automatically deploy, based on the indication of the underlying architecture of the computing devices, the services forming the control plane as containers managed by the container orchestration platform.