Unifabrix Ltd.

Ethan Sharon Hyatt

Ronen Aharon Hyatt

Gaya Opal Hyatt

Embodiments of a switch enabling multiple hosts to concurrently access and share resources of a Single Logical Device (SLD). The switch includes first and second upstream switch ports (USPs) coupled to first and second hosts, and a downstream switch port (DSP) coupled to the SLD. The first USP communicates with the first host according to a first Compute Express Link (CXL) protocol, the second USP communicates with the second host according to a second CXL protocol, and the DSP communicates with a first CXL SLD component according to a third CXL protocol. A Resource Provisioning Unit (RPU) terminates the first, second, and third CXL protocols, and exposes second and third virtualized SLDs, which utilize resources of the first SLD component, to the first and second hosts, respectively. Optionally, the first, second, and third CXL protocols are CXL.mem protocols.

Scalable virtualization of GPUs and compute accelerators in a switch providing CXL resource-as-a-service of memory, NVMe or RDMA networking via SLD agnostic provisioning

Embodiments for communicating using a switch having multiple sets of switch ports, which can generate abstractions for compute nodes and accelerators in a switched Compute Express Link (CXL) interconnect, enabling any-to-any connectivity between hosts and devices. A first set of switch ports couples hosts and/or devices with a first virtual to physical binding. A second set couples a Resource Provisioning Unit (RPU) with the first virtual to physical binding. The first binding binds at least some of the first and/or second sets of switch ports to a first set of Virtual CXL Switches (VCSs). A third set couples the RPU to a second virtual to physical binding. A fourth set couples additional hosts and/or devices with the second virtual to physical binding. And the second virtual to physical binding binds at least some of the third and/or fourth sets of switch ports to a second set of VCSs.

Abstraction of compute nodes and accelerators in a switched CXL interconnect

Embodiments for communicating using a switch configured to establish multiple types of communication routes. First and second upstream switch ports (USPs) communicate with first and second hosts according to first and second Compute Express Link (CXL) protocols, respectively. A downstream switch port (DSP) communicates with a device according to a third CXL protocol. The switch couples the first USP to the DSP via a first route traversing a single Virtual CXL Switch (VCS), and couples the first USP to the second USP via a second route traversing two VCSs. Optionally, the switch includes a Resource Provisioning Unit (RPU) coupling the two VCSs of the second route, terminating the first and second CXL protocols, and translating between CXL messages conforming to the first and second CXL protocols.

Switched protocol transformer for high-performance computing (HPC) and AI workloads

Embodiments for communicating using a switch. A first Virtual CXL Switch (VCS) routes messages, conforming to a first CXL protocol, from a first switch port to a Resource Provisioning Unit (RPU). A second VCS routes messages, conforming to a second CXL protocol, from the RPU to the second switch port. The RPU terminates the first and second CXL protocols and translates at least some of the messages conforming to the first CXL protocol to at least some of the messages conforming to the second CXL protocol. Optionally, the first CXL protocol comprises CXL.mem, the second CXL protocol comprises CXL.cache, and the RPU manages snoop and invalidation message flows and maintains transaction order requirements.

Elastic multi-directional resource augmentation in a switched CXL fabric

Embodiments for communicating between a Compute Express Link (CXL) host and a CXL device. A CXL Endpoint receives, from the host, first messages conforming to a first CXL.io protocol and second messages conforming to a first non-CXL.io protocol. A CXL Root Port receives, from the device, third messages conforming to a second CXL.io protocol and fourth messages conforming to a second non-CXL.io protocol. A computer terminates the first CXL.io protocol, processes at least some of the first messages without translating and sending corresponding translated first messages to the device, terminates the first non-CXL.io protocol, translates at least a quarter of the second messages, and makes the translated second messages available to the CXL Root Port for communication with the device. Optionally, each of the first and second non-CXL.io protocols is selected from at least one of CXL.mem or CXL.cache.

Host-to-device CXL communication including multi-fabric bridging, also over NVLink, UALink, and ethernet

Embodiments for communicating between Compute Express Link (CXL) hosts. A first CXL Endpoint receives, from a first host, first messages conforming to a first CXL.io protocol and second messages conforming to a first non-CXL.io protocol. A second CXL Endpoint receives, from a second host, third messages conforming to a second CXL.io protocol and fourth messages conforming to a second non-CXL.io protocol. A computer terminates the first CXL.io protocol, processes at least some of the first messages without translating and sending corresponding translated first messages to the second host, terminates the first non-CXL.io protocol, translates at least a quarter of the second messages, and makes the translated second messages available to the second CXL Endpoint for communication with the second host. Optionally, each of the first and second non-CXL.io protocols is selected from at least one of CXL.mem or CXL.cache.

Host-to-host communication with selective CXL non-transparent bridging

Dynamic provisioning of resources in a datacenter improves the utilization efficiency of compute, memory, storage, and network resources, while maintaining flexibility to meet changing demands. Embodiments herein disclose protocol-aware provisioning of resources over Compute Express Link (CXL) fabrics, enabling multi-protocol pooling and disaggregation of resources, including memory and workload-specific accelerators such as GPUs and DSAs. In some embodiments, a Resource Provisioning Unit (RPU) facilitates intent-based protocol translations and mappings between address spaces, potentially enabling the creation of large-scale compute-memory fabrics that may utilize both coherent and non-coherent Non-Transparent Bridging (NTB) between multiple protocols in a single system, serving as the underlying infrastructure for executing workloads such as Large-Language Models (LLMs) and Deep Learning Recommendation Models (DLRMs). Some embodiments also optimize low-latency communication between processes running on different nodes by enabling host-to-host memory provisioning for libraries such as OpenMP, Pthreads, or CUDA, which can utilize shared memory.

Protocol-aware provisioning of resource over CXL fabrics

Embodiments for communicating using a switch including Virtual CXL Switches (VCSs), upstream switch ports (USPs), and downstream switch ports (DSPs), enabling flexible mapping between switch ports and entities. Each VCS includes an upstream virtual PCIe-to-PCIe bridge (vPPB) coupled to one or more downstream vPPBs. A first virtual to physical binding is configured to bind USPs to upstream vPPBs, and a second virtual to physical binding is configured to bind DSPs to downstream vPPBs. Optionally, the switch further includes a Resource Provisioning Unit (RPU) to terminate CXL protocols and translate at least some CXL messages, and the first and second bindings bind the RPU to respective upstream and downstream vPPBs.

Reconfigurable multi-layer virtual binding in a CXL switch fabric

Embodiments for communicating between first and second hosts according to CXL.mem and CXL.cache protocols. A computer translates a CXL.mem M2S RwD with a Tag, received by a CXL Type 2 or Type 3 device (EP1) from the first host, to a CXL.cache D2H Req with a CQID. A CXL Type 1 or Type 2 device (EP2) sends the D2H Req to the second host, and receives a CXL.cache H2D Rsp with the CQID and a UQID. EP1 sends a CXL.mem S2M NDR with the Tag to the first host, and EP2 sends a CXL.cache D2H Data message with the UQID to the second host. Optionally, EP1 receives and terminates CXL.io/PCIe Configuration Request TLPs from the first host, the M2S RwD further includes a first physical address and Data, and the D2H Req further includes a second physical address.

Translating between CXL.mem and CXL.cache write transactions

Memory has been playing a major role in the performance, scalability and applicability of General Compute systems, and more recently, in realizing Generative Artificial Intelligence (GenAI) and High-Performance Computing (HPC) systems that scale to thousands of GPUs, CPUs and special-purpose Accelerators. Embodiments herein disclose efficient software-defined protocol terminations and protocol translations utilizing Compute Express Link (CXL), including translations between CXL.mem and CXL.cache protocols. Also disclosed are CXL-based systems, Resource Provisioning Units (RPUs), and Memory Fabric Switches enabling dynamic memory pooling and sharing, host-to-host communication utilizing CXL.mem, CXL.cache and CXL.io, intent-based protocol translations, and optionally seamless interactions between CXL, UALink, NVLink, and/or Ethernet protocols, utilizing a broad range of semantics including IO, Cache, and Memory, optimizing memory access and reducing latency. Some embodiments also enable scalability, flexibility and security in high-performance architectures suited for data centers and next-generation computing environments.

Growing community of inventors

Haifa, Israel

Ethan Sharon Hyatt