Transfer of data-redundancy encoded data via unreliable, connectionless protocol

Abstract

A system for transmitting data over a network may include data processed according to a data-redundancy encoding technique such as erasure coding to be transmitted via an unreliable, connectionless transmission protocol, for example user datagram protocol ('UDP'). A transmitting manager may receive a request from an application to transmit data. The transmission manager may select encoding parameters and encode data to be transferred using a data-redundancy encoding technique. The transmission manager may initiate transmission of the encoded data and payload header data may via a network, for example via a network communication stream or protocol stack. A reconstruction manager associated with the receiving node may reconstruct the original data using the received erasure coding data and payload header data. In some embodiments, the receiving node may transmit telemetry data to the erasure coding algorithm. The erasure coding algorithm may use received telemetry data to adjust parameters of the erasure coding algorithm for future erasure coding and transmission operations. In some systems, telemetry data may include a request to retransmit all or a portion of the erasure coded data.