Red Hat, Inc.

Joshua Durgin

Gabriel Zvi BenHanokh

Brett D Niver

Gabriel Benhanokh

Adam Kupczyk

David Zafman

Neha Ojha

A metadata size can be reduced for online deduplication operations. For example, a computing device can generate a metadata entry describing a data block in a metadata table comprising a plurality of metadata entries describing a plurality of data blocks. The computing device can determine a length of time to be associated with the metadata entry for maintaining the metadata entry in the metadata table. The computing device can, subsequent to the length of time passing subsequent to generating the metadata entry, determine the metadata entry indicates a number of references to the data block is below a threshold. The computing device can, in response to determining the number of references is below the threshold, remove the metadata entry from the metadata table.

Reducing a size of metadata for online deduplication operations

Metadata sizes for data objects in cloud storage systems can be reduced. For example, a computing system can receive, at a client device of a cloud storage system, a first object identifier associated with a data object in the cloud storage system. The computing system can use a reduction function to generate a second object identifier associated with the data object. The second object identifier can have a smaller byte size than the first object identifier. The computing system can transmit, to a server of the cloud storage system, the second object identifier to be stored in metadata associated with the data object in the cloud storage system.

Metadata size reduction for data objects in cloud storage systems

Garbage collection for a log-structured file system can be offloaded from a processor to an internal controller of a storage device, such as a solid-state drive. For example, an internal controller of a storage device can determine characteristics of a log-structured file system hosted by a processor that is external to the storage device. The characteristics can indicate how data is arranged in the log-structured file system. The internal controller can then execute, based on the characteristics, a garbage collection process with respect to the data of the log-structured file system on behalf of the processor.

Offloading memory maintenance for a log-structured file system

Aspects and features of the present disclosure can prefetch metadata in the nodes of a cloud-based storage system. At a node that stores at least one shard of a data object, metadata for the data object can be fetched from node storage and saved in a node cache prior to processing a read request for the shard. The metadata can be cached in response to a prefetch request transmitted to the node, for example, by the gateway that shards data objects for the storage system. Thus, the metadata can be available in the node cache when the read request for the data shard arrives later, reducing delays in accessing data object shards from the storage nodes of the system.

Prefetching metadata in a storage system

Data units can be relocated in scale-out storage systems. For example, a computing device can receive, at a first node of a scale-out storage system, a request for a data unit. The first node can include a metadata entry associated with the data unit. The computing device can determine, based on the metadata entry, that a second node of the scale-out storage system includes the data unit. The computing device can determine, from the metadata entry, that a number of versions of the data unit in the scale-out storage system meets or exceeds a threshold. The computing device can output a command to cause the data unit to be relocated to the first node with the metadata entry.

Data relocation for data units in scale-out storage systems

Client devices associated with scale-out storage nodes can be managed based on scale-out storage nodes having backup power supplies. For example, a management node of a scale-out storage system can determine, from among a plurality of storage nodes of the scale-out system, that a first storage node is uncoupled to a backup power supply and that a second storage node is coupled to the backup power supply. The management node can receive device characteristics describing a type of workload and a configuration for a client device associated with the first storage node. The management node can determine the client device satisfies a migration policy based on the device characteristics. The management node can migrate the client device to the second storage node based on the client device satisfying the migration policy.

Managing client devices associated with storage nodes in a scale-out storage system

Performance of devices can be evaluated and enhanced in software-defined systems. For example, a computing device can receive, at a server of a software-defined system, a first plurality of properties describing a client system in the software-defined system. The computing device can compare, by the server, the first plurality of properties to additional properties describing at least one additional client system in the software-defined system. The computing device can determine, by the server, an adjustment for the client system based on the comparison and a similarity of the client system to each of the at least one additional client system. The computing device can output, by the server, an indication of the adjustment to the client system.

System performance evaluation and enhancement in a software-defined system

Metadata of extent-based storage systems can be managed. For example, a computing device can store a first metadata object and a second metadata object in a first memory device. The first metadata object can specify locations of a first set of extents corresponding to a first data unit stored in a second memory device. The second metadata object can specify locations of a second set of extents corresponding to a second data unit stored in the second memory device. The computing device can determine that a first size of the first metadata object is smaller than a second size of the second metadata object. The computing device can remove the second metadata object from the first memory device based on determining that the first size is less than the second size.

Metadata management for extent-based storage system

A region of a volatile memory can be dynamically resized based on a charge level of a backup battery supply. For example, a computing device can have a volatile memory with a memory region for storing data. The computing device can also have an attached backup battery supply. The computing device can determine a charge level of the backup battery supply and adjust a size of the memory region based on the determined charge level. Adjusting the size of the memory region can involve changing an amount of the volatile memory that is allocated to the memory region.

Dynamically resizing a region of volatile memory based on a charge level of a backup battery supply

Distributed storage nodes having backup power supplies and write-back caching capabilities can be pooled for servicing write requests. For example, a management node of a distributed storage system can determine a subset of storage nodes, from among a group of storage nodes of the distributed storage system, coupled to backup power supplies based on status information received from the group of storage nodes. The status information can indicate whether a respective storage node of the group of storage nodes is coupled to a corresponding backup power supply. The management node can then generate a node pool that includes the subset of storage nodes with write-back caching enabled. The node pool can be configured to perform write-back caching in relation to a write request.

Pooling distributed storage nodes that have backup power supplies and write-back caching capabilities

Replicas of content can be managed in storage systems. In one example, a storage system can determine an amount of load on the storage system based on values for performance metrics indicating a performance of the storage system. Next, the storage system can determine that the storage system is to have a target number of replicas of content based on the amount of load on the storage system. The storage system can then adjust itself to have the target number of replicas of the content.

Managing replicas of content in storage systems

Data requests can be serviced by smart network interface cards (NICs). For example, a smart NIC can receive a request for data at a hardware-implemented path of the smart network interface card (NIC). The smart NIC can determine, based on a mapping table accessible by the hardware-implemented path of the smart NIC, a first storage node includes the data. The smart NIC can transmit the request to the first storage node for determining a second storage node, rather than the first storage node, includes the data and transmitting at least a portion of the request to the second storage node.

Growing community of inventors

Canyon County, CA, United States of America

Joshua Durgin