Hewlett Packard Enterprise Development LP

Cray Incorporated

Duncan Roweth

Robert L Alverson

Edwin L Froese

Andrew Steven Kopser

Thomas L Court

Keith D Underwood

David Charles Hewson

Abdulla M Bataineh

Partha Kundu

Joseph G Kopnick

Laurence S Kaplan

Jonathan P Beecroft

Igor Gorodetsky

Anthony M Ford

Eric P Lundberg

Abdulla Bataineh

Nathan L Wichmann

Edwin Froese

Charles A Giefer

Timothy J Johnson

Trevor Alan Jones

Howard Pritchard

Albert SauPong Cheng

Krishna Chaitanya Kandalla

Dejan S Milojicic

Harumi Kuno

Alan Lynn Davis

Derek Steven Schumacher

Sai Rahul Chalamalasetti

Sergey Serebryakov

Ryan Dean Menhusen

Torsten Wilde

John L Byrne

Edward J Turner

Daniel William Dauwe

Gregory Faanes

Michael Higgins

Steven L Scott

James Reinhard

Vivek Sharma

Shithal Tumkur Kenchappa

Prashanth Tamraparni

Vipin Kumar Kukkala

Nilakantan Mahadevan

Vrashi Ponnappa Puchimanda Ramacha

In some examples, a system stores, in a first database having a first schema, metrics received from a network comprising communication nodes, the metrics relating to operations of the communication nodes, and the first database associating the metrics with metadata corresponding to hierarchical components in a topology of the network. In response to an alert relating to an issue in the network, the system computes a health measure based on the metrics, the health measure indicating a health status of a first component, performs a dynamic runtime mapping of the metadata associated with the metrics in the first database having the first schema with corresponding metadata in a second database having a second schema different from the first schema, where the second database contains information of a topology of the network, and initiates a management action to address the health status based on the health measure and the dynamic runtime mapping.

Health-based management of a network

In certain implementations, a method includes receiving, by a network interface controller (NIC), a request for inter-process communication associated with a sending process of a distributed application. The request includes a logical network address for a destination process of the distributed application. The method includes executing, by the NIC, a network address translation process to translate the logical network address for the destination process to a translated network address for the destination process. The network address translation process includes executing, using a first portion of the logical network address, a lookup of a network address translation table to determine a first address; determining a translation modifier by executing a translation algorithm using a second portion of the logical network address; and determining the translated network address using the first address and the translation modifier. The method includes processing, by the NIC, a first message using the translated network address.

Network address translation

In certain embodiments, a method includes identifying, by a NIC of a node where application sender of an application executes, a network data unit for telemetry metadata insertion based on performing a match operation on information associated with the network data unit, wherein the network data unit is being transmitted from the application sender to an application receiver executing on another node; inserting, based on a first success of the first match operation, telemetry metadata into the network data unit, the telemetry metadata comprising network information and application specific information; stripping, by a last hop device along the data flow path, the telemetry metadata from the network data unit; generating, by the last hop device, a telemetry metadata report using the telemetry metadata; and providing the telemetry metadata report to an application collector executing on the second node.

Application specific network telemetry and diagnostics

An apparatus facilitating efficient key refresh in a node is provided. During operation, the apparatus can determine a collective operation initiated by the node. The node can include a processor and can be in a distributed system comprising a plurality of nodes. The collective operation can be performed by a subset of the plurality of nodes in conjunction with each other. The apparatus can generate a new key based on a previous key maintained at the apparatus. Here, a respective key can be used for encrypting an inter-node packet in the distributed system. The apparatus can maintain the new and previous keys for the duration of the collective operation. Either of the new and previous keys can be used for decrypting messages received at the apparatus from other nodes of the distributed system. Upon determining a threshold point of the collective operation, the apparatus can discard the previous key.

Efficient key management in distributed application

Systems and methods are provided for performing routing in a switch network or fabric. Switches can be configured in a hierarchical topology having a plurality of groups, where switches in a group are connected to one another, and groups are connected to other groups. Routing can be performed by maintaining per-group group load information. A packet can be routed between at least two groups using the per-group group load information to effect a set of routing decisions. The set of routing decisions can be biased towards or away one or more paths.

Methods for distributing software-determined global load information

A network interface controller (NIC) capable of facilitating fine-grain flow control (FGFC) is provided. The NIC can be equipped with a network interface, an FGFC logic block, and a traffic management logic block. During operation, the network interface can determine that a control frame from a switch is associated with FGFC. The network interface can then identify a data flow indicated in the control frame for applying the FGFC. The FGFC logic block can insert information from the control frame into an entry of a data structure stored in the NIC. The traffic management logic block can identify the entry in the data structure based on one or more fields of a packet belonging to the flow. Subsequently, the traffic management logic block can determine whether the packet is allowed to be forwarded based on the information in the entry.

System and method for facilitating fine-grain flow control in a network interface controller (NIC)

Systems and methods are provided for passing data amongst a plurality of switches having a plurality of links attached between the plurality of switches. At a switch, a plurality of load signals are received from a plurality of neighboring switches. Each of the plurality of load signals are made up of a set of values indicative of a load at each of the plurality of neighboring switches providing the load signal. Each value within the set of values provides an indication for each link of the plurality of links attached thereto as to whether the link is busy or quiet. Based upon the plurality of load signals, an output link for routing a received packet is selected, and the received packet is routed via the selected output link.

Algorithms for use of load information from neighboring nodes in adaptive routing

An apparatus is provided that includes a network interface to transmit and receive data packets over a network; a memory including one or more buffers; an arithmetic logic unit to perform arithmetic operations for organizing and combining the data packets; and a circuitry to receive, via the network interface, data packets from the network; aggregate, via the arithmetic logic unit, the received data packets in the one or more buffers at a network rate; and transmit, via the network interface, the aggregated data packets to one or more compute nodes in the network, thereby optimizing latency incurred in combining the received data packets and transmitting the aggregated data packets, and hence accelerating a bulk data allreduce operation. One embodiment provides a system and method for performing the allreduce operation. During operation, the system performs the allreduce operation by pacing network operations for enhancing performance of the allreduce operation.

System and method for implementing a network-interface-based allreduce operation

A network interface controller (NIC) capable of performing message passing interface (MPI) list matching is provided. The NIC can include a host interface, a network interface, and a hardware list-processing engine (LPE). The host interface can couple the NIC to a host device. The network interface can couple the NIC to a network. During operation, the LPE can receive a match request and perform MPI list matching based on the received match request.

System and method for facilitating efficient message matching in a network interface controller (NIC)

A network interface card (NIC) receives a stream of commands, a respective command comprising memory-operation requests, each request associated with a destination NIC. The NIC buffers asynchronously the requests into queues based on the destination NIC, each queue specific to a corresponding destination NIC. When first queue requests reach a threshold, the NIC aggregates the first queue requests into a first packet and sends the first packet to the destination NIC. The NIC receives a plurality of packets, a second packet comprising memory-operation requests, each request associated with a same destination NIC and a destination core. The NIC buffers asynchronously the requests of the second packet into queues based on the destination core, each queue specific to a corresponding destination core. When second queue requests reach the threshold, the NIC aggregates the second queue requests into a third packet and sends the third packet to the destination core.

Aggregating small remote memory access requests

A network interface controller (NIC) capable of efficient operation management for host accelerators is provided. The NIC can be equipped with a host interface and triggering logic block. During operation, the host interface can couple the NIC to a host device. The triggering logic block can obtain, via the host interface from the host device, an operation associated with an accelerator of the host device. The triggering logic block can determine whether a triggering condition has been satisfied for the operation based on an indicator received from the accelerator. If the triggering condition has been satisfied, the triggering logic block can obtain a piece of data generated from the accelerator from a memory location and execute the operation using the piece of data.

System and method for facilitating operation management in a network interface controller (NIC) for accelerators

Systems and methods are provided for a modular switch system that comprises disaggregated components, plugins, and managers that enable flexibility to adjust the dynamic configuration of a switch system. This can create modularity and customizability at different times of the lifecycle of the currently configured switch system.

Dynamically modular and customizable computing environments

A network interface controller (NIC) capable of efficient packet forwarding is provided. The NIC can be equipped with a host interface, a packet generation logic block, and a forwarding logic block. During operation, the packet generation logic block can obtain, via the host interface, a message from the host device and for a remote device. The packet generation logic block may generate a plurality of packets for the remote device from the message. The forwarding logic block can then send a first subset of packets of the plurality of packets based on ordered delivery. If a first condition is met, the forwarding logic block can send a second subset of packets of the plurality of packets based on unordered delivery. Furthermore, if a second condition is met, the forwarding logic block can send a third subset of packets of the plurality of packets based on ordered delivery.

System and method for facilitating efficient packet forwarding in a network interface controller (NIC)

Systems and methods of routing a data communication across a network having a plurality switches are provided by monitoring the operation of the plurality of global links to determine which of the plurality of global links provide working paths. A routing table indicative of a status for the plurality of links is maintained, where the routing table provides weighting for each of the working paths. When routing, a link using a weighted pseudo-random selection from the choices available in the routing table is selected. Routing along one of the working paths commensurate with the selected link is performed, and the weighting is updated based upon the operation of the plurality of links.

Weighting routing

A method for conducting a network performance analysis, the method comprising measuring latencies of a plurality of packets communicated over a network includes determining latency representations for a plurality of levels of the network, for a plurality of communication routes, and/or for a plurality of communication types. The latency representations comprise the latency measurements, statistical representations of the latency measurements, and/or latency metrics derived from the latency measurements. The method includes comparing the determined latency representations to expected latency representations, the expected latency representations comprising expected latencies, expected statistical representation of latencies, and/or expected latency metrics. Based on the comparison, the method includes determining a discrepancy between one of the expected latency representations and one of the determined latency representations; and based on the determined discrepancy, identifying one of the levels of the network, the communication routes, and/or the communication types as an excess-latency-causing portion of the network.

Conducting network performance analysis

Growing community of inventors

Bristol, United Kingdom

Duncan Roweth