Telemetry data table creation and merging in time series for optimal data storage in cluster networks

Abstract

A telemetry processing system in a cluster network collecting streaming telemetry data from a plurality of telemetry producer pods. Processes improve extraction of telemetry data from a cluster network by collating streaming telemetry data received from each pod as a resource of the network, wherein a defined epoch delineates the streaming data into a plurality of metric datasets. Each dataset is stored in a database table created for the epoch in a respective cache created in a telemetry pipeline for each resource. The cached data is merged for a specific resource for the epoch in a merged database table that combines metric datasets per epoch to remove duplicative information created by the plurality of metric datasets and facilitate more efficient searching and extraction of the streaming telemetry data.