Intel Corporation

Hewlett Packard Enterprise Development LP

Sandia Corporation

Keith D Underwood

James Dinan

Mario Flajslik

Robert L Alverson

Charles A Giefer

Duncan Roweth

Sayantan Sur

Karl P Brummel

Timo Schneider

Karl Scott Hemmert

Ravindra Babu Ganapathi

Steffen Kosinski

Andrew Friedley

Nathan S Miller

Christopher Michael Brueggen

Eric R Borch

Jaroslaw Topp

Bruce M Pirie

Nathan L Wichmann

David Addison

Michael Redeker

Jan Uerpmann

Robert William Wisniewski

Ulf Hanebutte

David Pardo Keppel

Jonathan M Eastep

Federico Ardanaz

Mark Debbage

David N Lombard

Ravi Murty

Stephanie L Hirnak

Vignesh Trichy Ravi

Yaxin Shui

John Greth

Jan Norden

Thomas Gaertner

Ronald B Brightwell

Travis Hamilton

Siddhartha Jana

Clement T Cole

Gabriele Jost

Stanley C Smith

Michael J Levenhagen

Norbert Foerster

K Scott Hemmert

Charles F Giefer

In certain implementations, a method includes receiving, by a network interface controller (NIC), a request for inter-process communication associated with a sending process of a distributed application. The request includes a logical network address for a destination process of the distributed application. The method includes executing, by the NIC, a network address translation process to translate the logical network address for the destination process to a translated network address for the destination process. The network address translation process includes executing, using a first portion of the logical network address, a lookup of a network address translation table to determine a first address; determining a translation modifier by executing a translation algorithm using a second portion of the logical network address; and determining the translated network address using the first address and the translation modifier. The method includes processing, by the NIC, a first message using the translated network address.

Network address translation

An apparatus facilitating efficient key refresh in a node is provided. During operation, the apparatus can determine a collective operation initiated by the node. The node can include a processor and can be in a distributed system comprising a plurality of nodes. The collective operation can be performed by a subset of the plurality of nodes in conjunction with each other. The apparatus can generate a new key based on a previous key maintained at the apparatus. Here, a respective key can be used for encrypting an inter-node packet in the distributed system. The apparatus can maintain the new and previous keys for the duration of the collective operation. Either of the new and previous keys can be used for decrypting messages received at the apparatus from other nodes of the distributed system. Upon determining a threshold point of the collective operation, the apparatus can discard the previous key.

Efficient key management in distributed application

A network interface controller (NIC) facilitating incast management at a computing system is provided. During operation, the NIC can receive, via a network, a request to send data from a remote computing system. The NIC can determine that the request is among a plurality of requests from a plurality of remote computing systems accessible via the network. Based on a descriptor in the request, the NIC can determine a storage location of the data at the remote computing system. The NIC can then determine a level of congestion associated with the plurality of requests at the computing system. The NIC can schedule a data retrieval in response to the request based on the level of congestion and with respect to the plurality of requests. The NIC can then retrieve the data from the storage location based on remote access.

Rendezvous to enable congestion management

Systems and methods are provided for providing a shared token as part of establishing a communication connection with a network ('connection establishment') between a source device and a target device, after a previous communication connection to the network between the source device and the target device is closed or torn down, in helping to prevent future replay attacks.

Secure connection initiation to prevent replay attacks in an encrypted network

An apparatus is provided that includes a network interface to transmit and receive data packets over a network; a memory including one or more buffers; an arithmetic logic unit to perform arithmetic operations for organizing and combining the data packets; and a circuitry to receive, via the network interface, data packets from the network; aggregate, via the arithmetic logic unit, the received data packets in the one or more buffers at a network rate; and transmit, via the network interface, the aggregated data packets to one or more compute nodes in the network, thereby optimizing latency incurred in combining the received data packets and transmitting the aggregated data packets, and hence accelerating a bulk data allreduce operation. One embodiment provides a system and method for performing the allreduce operation. During operation, the system performs the allreduce operation by pacing network operations for enhancing performance of the allreduce operation.

System and method for implementing a network-interface-based allreduce operation

A network interface card (NIC) receives packets corresponding to a read or write request, the packets associated with a datatype descriptor stored in a datatype engine of the NIC, and each packet associated with a precomputed context which indicates a value for each dimension of a multi-dimensional array and a start location of the respective packet within a host memory block. The NIC generates, for a respective packet, a datatype handle corresponding to the datatype descriptor and an offset indicating a position of the respective packet within the packets. The NIC determines, based on the datatype handle and the offset, a cached context for the respective packet and initializes the datatype engine based on the cached context. The datatype engine generates, based on the cached context, read or write requests comprising addresses and lengths, thereby allowing the NIC to process out-of-order packets based on the precomputed and cached context.

Mechanism to enable out-of-order packet processing in a datatype engine

A method and apparatus are provided for facilitating a datatype engine (DTE) to support high performance computing. A network interface card (NIC) receives, via a message passing interface, a command to read data from a host memory. The NIC determines that the command indicates a first datatype descriptor stored in the NIC. The NIC forms, based on the command, a packet which indicates a base address and a length associated with the data to be read from the host memory and passes the packet to the DTE. The DTE generates a plurality of read requests comprising offsets from the base address and corresponding lengths based on the first datatype descriptor. The DTE passes the plurality of read requests to a direct memory access module, thereby allowing the NIC to access the host memory while eliminating copies of the data on the host during transfer of the command across a network.

Datatype engine to support high performance computing

A system, method, and apparatus are provided to facilitate data structures for a datatype engine and provide inline compaction. The system receives, by a network interface card (NIC), a command to read data from a host memory, wherein the command indicates a datatype. The system generates a plurality of read requests comprising offsets from a base address and corresponding lengths based on the datatype. The system issues the plurality of read requests to the host memory to obtain the data from the host memory. The system obtains a byte-mask descriptor corresponding to the datatype. The system performs, based on the obtained data and the byte-mask descriptor, on-the-fly compaction of the obtained data, thereby allowing the NIC to return a requested subset of the obtained data.

Mechanism to represent data structures for a datatype engine and provide inline compaction

A system for facilitating efficient command management in a network interface controller (NIC) is provided. During operation, the system can determine, at the NIC, a trigger condition and a location in a command queue for a set of commands corresponding to the trigger condition. The command queue can be external to the NIC. The location can correspond to an end of the set of commands in the command queue. The system can then determine, at the NIC, whether the trigger condition has been satisfied. If the trigger condition is satisfied, the system can fetch a respective command of the set of commands from the command queue and issuing the command from the NIC until the location is reached, thereby bypassing locally storing the set of commands prior to the trigger condition being satisfied.

System and method for facilitating dynamic triggered operation management in a network interface controller (NIC)

Logic may store at least a portion of an incoming packet at a memory location in a host device in response to a communication from the host device. Logic may compare the incoming packet to a digest in an entry of a primary array. When the incoming packet matches the digest, logic may retrieve a full entry from the secondary array and compare the full entry with the first incoming packet. When the full entry matches the first incoming packet, logic may store at least a portion of the first incoming packet at the memory location. And, in the absence of a match between the first incoming packet and the digest or full entry, logic may compare the first incoming packet to subsequent entries in the primary array to identify a full entry in the secondary array that matches the first incoming packet.

Methods and arrangements to accelerate array searches

Examples include a method of managing storage for triggered operations. The method includes receiving a request to allocate a triggered operation; if there is a free triggered operation, allocating the free triggered operation; if there is no free triggered operation, recovering one or more fired triggered operations, freeing one or more of the recovered triggered operations, and allocating one of the freed triggered operations; configuring the allocated triggered operation; and storing the configured triggered operation in a cache on an input/output (I/O) device for subsequent asynchronous execution of the configured triggered operation.

Triggered operations for collective communication

Particular embodiments described herein provide for a system for enabling the communication of a large message using multiple network interface controllers (NICs). The system can be configured to determine that a message to communicate to a receiver over a network is above a threshold, determine a plurality of NICs to be used to communicate the message, create a manifest that includes an identifier of each of the plurality of NICs, and communicate the manifest to the receiver using a multi-unit message. In an example, the multi-unit message is communicated using a PUT command and the receiver can analyze the manifest and use a GET command to pull the message from the plurality of NICs.

Communication of a large message using multiple network interface controllers

Technologies for generating triggered conditional events operations include a host fabric interface (HFI) of a compute device configured to receive an operation execution command message associated with a triggered operation that has been fired, process the received operation execution command message to extract and store argument information from the received operation execution command, and increment an event counter associated with the fired triggered operation. The HFI is further configured to perform a triggered compare-and-generate event (TCAGE) operation as a function of the extracted argument information, determine whether to generate a triggering event, generate the triggering event as a function of the performed TCAGE operation, insert the generated triggered event into a triggered operation queue, and update the value of the event counter. Other embodiments are described herein.

Technologies for generating triggered conditional events

Technologies for link-bandwidth-aware routing are disclosed. In order to avoid congestion while still allowing link bandwidth to be decreased in order to save power, a network switch may select a port to send a packet over based on the present link bandwidth of the data links connected to the various output ports of the network switch. The network switch preferentially sends the packet over the minimal output port, or, if the minimal output port is congested, over one of the ports with the highest available link bandwidth. If the link bandwidth of the data link connected to the selected output port is not high enough, the network switch will automatically dynamically increase the link bandwidth of the data link as necessary.

Technologies for link-bandwidth-aware routing

Growing community of inventors

Powell, TN, United States of America

Keith D Underwood