Quantcast Corporation

Other

Thileepan Subramaniam

Silvius V Rus

A column set server adapts to data use patterns by data consumers by modifying how a table produced by a data producer is partitioned into separate column sets to reduce the waste incurred in accessing the data by multiple consumers of the data. For example, the column set server adjusts a column set distribution when a new consumer process is added, when one is retired, or when relative data set size ratios change.

Adaptive column set composition

A distributed storage system maintains multiple logically independent file systems. Each file system includes a data set stored by a distributed storage of the distributed storage system. During operation, access pattern levels for the multiple logically independent file systems are determined. Thereafter, the data sets included in the multiple logically independent file systems are redistributed across multiple storage devices of the distributed storage. In one aspect, redistribution of a particular data set is based at least in part on the particular file system including the particular data set and on the determined access pattern levels for the multiple logically independent file systems. In one implementation, redistribution is performed according to a uniform redistribution scheme. In another implementation, redistribution is performed according to a proportional distribution scheme.

Growing community of inventors

Mountain View, CA, United States of America

Thileepan Subramaniam