Chicago Mercantile Exchange Inc.

Gareth Albert McCarter

Charles Patrick Nugent

Michael Patrick King

A streaming platform reader includes: a plurality of reader threads configured to retrieve messages from a plurality of partitions of a streaming platform, wherein each message in the plurality of partitions is associated with a unique identifier; a plurality of queues coupled to the plurality of reader threads configured to store messages or an end of partition signal from the reader threads, wherein each queue includes a first position that stores the earliest message stored by a queue; a writer thread controlled by gate control logic that: compares the identifiers of all of the messages in the first positions of the queues of the plurality of queues, and forwards, to a memory, the message associated with the earliest identifier; and wherein the gate control logic blocks the writer thread unless each of the queues contains a message or an end of partition signal.

Streaming platform reader

A streaming platform reader includes: a reader thread configured to retrieve messages from a plurality of partitions of a streaming platform, wherein each message in the plurality of partitions is associated with a unique identifier; a plurality of queues coupled to the reader thread configured to store messages or an end of partition signal from the reader thread, wherein each queue includes a first position that stores the earliest message stored by a queue; an extraction thread controlled by gate control logic that: compares the identifiers of all of the messages in the first positions of the queues of the plurality of queues, and forwards, to a pool of queues associated with a pool of processing threads, the message content of the message associated with the earliest identifier; and wherein the gate control logic blocks the extraction thread unless each of the queues contains a message or an end of partition signal.

Growing community of inventors

Belfast, United Kingdom

Gareth Albert McCarter