Converged scale-up and scale-out networks

Abstract

In one embodiment, a method includes registering, by a centralized controller of a backend network: (1) each compute node of the backend network, where each compute node has one or more AI accelerators and is in one of several distinct pods; (2) each scale-up switch of the backend network, where each scale-up switch is specific to a particular pod and connects compute nodes within its pod; and (3) each scale-out switch of the backend network. The method further includes dynamically determining, for an AI task, (1) whether to provide scale-up or scale-out resources for the task and then (2) a set of compute nodes to allocate to the task; generating, by a control plane, a data plane defining a data path for the allocated set of compute nodes; and performing, by the allocated set of compute nodes using the generated data plane, the particular AI task.