Hewlett-packard Development Company, L.p.

Hewlett Packard Enterprise Development LP

Shivaram Venkataraman

Robert S Schreiber

Indrajit Roy

Parthasarathy Ranganathan

Mehul A Shah

Nathan Lorenzo Binkert

Alvin AuYoung

A sparse array is partitioned into first partitions and a second array is partitioned into second partitions based on an invariant relationship between the sparse array and the second array. The sparse array and the second array are associated with a computation involving the sparse array and the second array. The first partitions and the corresponding second partitions are distributed to workers. A different first partition and corresponding second partition is distributed to each of the workers. Third partitions of the sparse array and corresponding fourth partitions of the second array are determined based on the invariant relationship and measurements of load are received from each of the workers. At least one of the first partitions and the corresponding second partition is different from one of the third partitions and the corresponding fourth partition. The at least one of the first partitions and the corresponding second partition that is different is redistributed among the workers. A different third partition and corresponding fourth partition is executed by each of the workers.

Load-balanced sparse array processing

A plurality of array partitions are defined for use by a set of tasks of the program run-time. The array partitions can be determined from one or more arrays that are utilized by the program at run-time. Each of the plurality of computing devices are assigned to perform one or more tasks in the set of tasks. By assigning each of the plurality of computing devices to perform one or more tasks, an objective to reduce data transfer amongst the plurality of computing devices can be implemented.

Managing array computations during programmatic run-time in a distributed computing environment

Growing community of inventors

Berkeley, CA, United States of America

Shivaram Venkataraman