Scalable loss tolerant remote direct memory access over optical infrastructure with shaped quota management

Abstract

Remote Direct Memory Access (RDMA) over Internet Protocol and/or Ethernet has gained attention for datacenters. However, the sheer scale of the required RDMA networks presents a challenge. Accordingly, optical infrastructures wavelength division multiplexing within a datacenter environment have also gain attention through the wide low cost bandwidth it offers with easy expansion within this environment. However, latency is a significant issue for many applications rather than bandwidth between devices. Accordingly the inventors have established a design methodology where the network prioritises latency over bandwidth where bandwidth utilization and management offer reduced latency for such applications. Accordingly, the inventors exploit loss-tolerant RDMA architectures with quota-based traffic control, message level load balancing and a global view of virtual connections over commodity switches with simple priority queues.