Microsoft Technology Licensing, LLC

Mainak Ghosh

Srikanth Kandula

Ishai Menache

Sriram S Rao

Avrilia Floratou

Ashvin Agrawal

Joseph Naor

Christopher William Douglas

Virajith Jalaparti

Methods, systems, apparatuses, and computer program products are provided for prefetching data. A workload analyzer may identify job characteristics for a plurality of previously executed jobs in a workload executing on a cluster of one or more compute resources. For each job, identified job characteristics may include identification of an input dataset and an input bandwidth characteristic for the input dataset. A future workload predictor may identify future jobs expected to execute on the cluster based at least on the identified job characteristics. A cache assignment determiner may determine a cache assignment that identifies a prefetch dataset for at least one of the future jobs. A network bandwidth allocator may determine a network bandwidth assignment for the prefetch dataset. A plan instructor may instruct a compute resource of the cluster to load data to a cache local to the cluster according to the cache assignment and the network bandwidth assignment.

Cache and I/O management for analytics over disaggregated stores

Growing community of inventors

Foster City, CA, United States of America

Mainak Ghosh