Systems and methods for intelligently distributing data in a network scalable cluster using a cluster volume table (cvt) identifying owner storage nodes for logical blocks

Abstract

Systems, methods, and computer-readable media for intelligent distribution of data in a storage cluster are described herein. An example method includes maintaining a cluster volume table (CVT) that stores information regarding data distribution of a volume across a plurality of storage nodes, and defining data distribution groups within the CVT. The CVT includes a plurality of entries, where each entry identifies an owner storage node for a respective logical block of the volume. Each data distribution group includes consecutive CVT entries. The method also includes receiving an input/output (I/O) operation directed to a region of the volume, identifying an owner storage node associated with the region of the volume using the CVT, and serving the I/O operation with at least one storage node of a data distribution group associated with the owner storage node. The I/O operation is served at a chunk-level granularity that is finer than a logical-block-level granularity of the volume. The at least one storage node that serves the I/O operation may be identified by performing a division and modulo operation. A modulus may equal the number of storage nodes in the data distribution group associated with the owner storage node. Data may be striped at the chunk-level granularity across the storage nodes in the data distribution group associated with the owner storage node.