Emc IP Holding Company LLC

Lachlan McIlroy

Anton Rang

Max Laier

Ryan Libby

Robert Shelton

Zero block elimination (ZBE) and statistical accounting for reduction in storage space used in a memory component of a file system due to ZBE can be managed. During a write operation, in response to eliminating a zero block from the write operation, a data management component (DMC) can associate a zero extent with a sparse region that represents a block in the memory component where the zero block was to have been written, unless a zero extent is already associated with that block. DMC can determine a number of zero blocks eliminated from write operations due to ZBE based on the number of zero extents associated with files stored in the memory component, to facilitate determining an amount of reduction of use of storage space in the memory component, or a data reduction ratio, storage efficiency ratio, or zero reduction ratio associated with the memory component, due to ZBE.

Zero block elimination reporting for a file system

Deduplication, including inline deduplication, of data for a file system can be implemented and managed. A data management component (DMC) can control inline and post-process deduplication of data during write and read operations associated with memory. DMC can determine whether inline data deduplication is to be performed to remove a data chunk from a write operation to prevent the data chunk from being written to a data store based on a whether a hash associated with the data chunk matches a stored hash stored in a memory index and associated with a stored data chunk stored in a shadow store. If there is a match, DMC can perform a byte-by-byte comparison of the data chunk and stored data chunk to determine whether they match. If they match, DMC can perform inline data deduplication to remove the data chunk from the write operation.

Inline and post-process data deduplication for a file system

Compression of data for a file system utilizing protection groups can be implemented and managed. A compression management component (CMC) can control compression of data via inline or post-process compression for storage in protection groups in memory, including determining whether to compress data, determining a compression algorithm to utilize to compress data, and/or determining whether to perform inline and/or post-process compression of data. CMC can generate protection group (PG) metadata for a PG in which compressed data is stored. PG metadata can comprise a logical extent map that describes which logical blocks contain compressed data, a list of cyclic redundancy check values for logical blocks, and a list of compression chunks that store individual metadata regarding individual compressed streams, wherein, for an individual compressed stream, the individual metadata comprises a compression format, compressed size, uncompressed size, and/or starting offset in physical space within the PG.

Growing community of inventors

Newport, Australia

Lachlan McIlroy