Priority-driven federated query-based data caching

Abstract

Various embodiments of the present disclosure provide federated query processing techniques for monitoring data access patterns through federated queries and intelligently caching disparate data segments based on the data access patterns. The techniques include determining a relative priority for a data segment of a third-party data source based on a plurality of federated queries. Each of the plurality of federated queries may reference data segments from a plurality of disparate data sources. The relative priority may be indicative of a priority of the data segment relative to other data segments. In response to a determination that the relative priority satisfies a priority threshold, the techniques include storing a data segment in an intermediary local data source and initiating the performance of a data segment redirect configured to redirect a subsequent federated query associated with the data segment to the intermediary local data source.