Qumulo, Inc.

Steven Henry Haber

Thomas Scott Urban

Aaron Passey

Robert Edward Gebert

Thomas Gregory Rothschilds

Michael Anthony Chmiel

Yuxi Bai

Jonathan Michael MacLaren

Matthew Christopher McMullan

Tyler Morrison Moody

Nicholas J Wilson

Michael Adam Krasnow

Pathirat Kosakanchit

Rowan Arthur Phipps

Edward Brow

Ying Fairweather

Graham Edwin Ellis

Thorne Davis Garvin

Neal Thomas Fachan

Noah Trent Nelson

John Brazel

Zacharie Lamont Kirsch

Robert Gebert

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

Object-based storage with garbage collection and data consolidation

Embodiments are directed to workload allocation for file system maintenance. A file system that includes storage nodes and snapshots may be provided such that each snapshot may be associated with a plurality of data blocks. If snapshots are deleted further actions may be performed, including: determining the dead blocks associated with the deleted snapshots such that each dead block may be a data block that may be unassociated with undeleted snapshots; adding the plurality of dead blocks to dead trees located on the storage nodes; determining an urgency score based on a workload model and file system metrics; determining delete tasks based on the urgency score; determining a portion of the storage nodes based on a number of delete tasks; and executing the delete tasks on the portion storage nodes to delete the dead blocks to return storage capacity to the file system.

Workload allocation for file system maintenance

Embodiments are directed to managing data in a file system. An object from the file system that has parent objects may be provided. A snapshot in a current epoch may be generated such that the first snapshot may be based on the object and descendants of the object. A coverage set may be provided for the object that references the snapshot and also references each other snapshot that includes the parent objects. Read-only access to a version of the object may be provided based on a correspondence of the version and a snapshot referenced by the coverage set of the object. A coverage engine compares the update to a coverage update epoch (cue) associated with the parent objects. The coverage engine updates coverage sets of the parent objects based on grandparents of the object.

Managing per object snapshot coverage in filesystems

A facility for snapshot space accounting for a storage system, such as a filesystem is disclosed. The facility enables users to quickly and easily determine the amount of storage space that would be released or recovered if a snapshot were to be purged. The facility may work in conjunction with, or as part of, a snapshot service. The facility maintains an expiration data structure and a count data structure and uses these data structures in implementing the disclosed snapshot space accounting techniques. The expiration data structure represents the life cycle of each snapshot element maintained by the facility while the count data structure represents, for pairs of snapshots, the size of the information stored in the snapshot data that expired and that spans the corresponding pair of snapshots.

Space accounting for storage system snapshots

Growing community of inventors

Seattle, WA, United States of America

Steven Henry Haber