International Business Machines Corporation

Globalfoundries Inc.

Lee Jason Sanders

Gordon Douglas Hutchison

Ben Sasson

John Paul Agombar

Ian Boden

Miles Mulholland

William James Scales

Roderick Guy Charles Moore

Matthew John Fairhurst

Paul Nicholas Cashman

Robert Bruce Nicholson

Gareth Paul Jones

John Earle Lindley

Kenneth Fairclough Day, Iii

Barry Douglas Whyte

Gareth John Nicholls

Florent Rostagni

Alexander Henry Ainscow

Keira Louise Hopkins

Adam Michael Farley

Mark Keith Elliott

Jason Hughes

Sarvesh S Patel

Kushal S Patel

Karl Allen Nielsen

Carlos Francisco Fuente

Geraint M North

Nicolas Marc Clayton

Christopher B E Beeken

Kenneth F Day, Iii

Nicholas Michael O'Rourke

David Adam Sinclair

Denis A Frank

Colleen Renee Stouffer

David Sherwood

Alistair Laesk Symon

Barry D Whyte

Bill J Seales

Katja Gebuhr

Kenneth Day Iii

A method, computer program product, and computer system for copying of data in a storage system between storage drives that have embedded compression. The method includes determining that a copy operation of data is required from a source drive to a target drive and determining that the source drive and the target drive use the same compression algorithm. The method includes: reading the data in a compressed form from the source drive including bypassing a decompression algorithm; transmitting the compressed data from the source drive to the target drive; and receiving and writing the compressed data at the target drive including bypassing a compression algorithm at the target drive.

Copying of data in a storage system between storage drives that have embedded compression

A system for managing a storage array in a storage system may include an analysis component for analyzing a set of compression ratios used for a set of storage blocks written on a first storage device and a second storage device to determine a pattern. The system may include a determination component for determining, responsive to the pattern, a first compression ratio and a second compression ratio; the first compression ratio may be different from the second compression ratio. The system may include a data read/write component for writing a storage block to the first storage device with the first compression ratio and writing the storage block to the second storage device with the second compression ratio.

Storage data copies with differing compression algorithms

A method, system, computer program product and computer program for managing a storage system, the storage system comprising a first storage device, a second storage device, a source storage device, a target storage device, and a cache, the method comprising: receiving a first host access request for a data block on the first storage device; receiving a mapping between the source storage device and the target storage device; and in response to the first host access request and the mapping: accessing a corresponding data block on the second storage device; and updating metadata for the cache.

Maintaining cache validity

A method, system, and computer program product for managing a storage system, comprising: analyzing an access request for a first storage block of the set of storage blocks; in response to the access request comprising a read request: in response to the first storage block residing in the cache: processing the read request from the cache; promoting the first storage block within the cache; and destaging the first storage block to the storage device with the first compression ratio; and in response to the first storage block not residing in the cache: processing the read request from the storage device; and copying the first storage block to the cache; in response to the access request comprising a write request: writing the first storage block to the cache; and destaging the first storage block to the storage device using the first compression ratio.

Reactive deep-frozen adaptive replacement cache and drive interface

Method and system are provided for recycling container storage objects at a storage controller. The method includes receiving a create operation of a new container by an orchestrator, including information indicating a purpose of the container, and associating a label with the new container, with the label indicating the orchestrator-defined information. The method includes checking labels of soft-deleted container objects for a suitable match with the label of the new container, where soft-deleted container objects are logical objects for deleted containers that are maintained for recycling. The method includes recycling metadata of a matched soft-deleted container object for the new container. The method includes checking received input/output operations for the new container against already stored data of the matched soft-deleted container to recycle data and skip writes where they match.

Recycling container storage objects at a storage controller

Aspects of the present invention disclose a method, computer program product, and system for stale data recovery using virtual storage metadata. The method includes one or more processors generating a primary virtual storage metadata structure having virtual address areas for a data chunk. Each area includes a plurality of most recent updates of metadata for the data chunk. The metadata of each update includes a sequence number for the update and a pointer to the physical location of the data. The method further includes one or more processors generating an overflow virtual storage metadata structure for multiple virtual address areas. The overflow metadata structure includes updates that have overflowed from the virtual address areas. In addition, wherein an oldest update in a full virtual address area of the primary virtual storage metadata structure includes a link to an overflow location.

Stale data recovery using virtual storage metadata

Described are techniques for managing data locations of derived storage objects. The techniques include accessing a primary metadata tree providing a lookup path using a virtual address to locate data for a primary object in physical storage pointed to by a leaf node of the primary metadata tree and providing a sub-tree from a leaf node of the primary metadata tree associated with the primary object, the sub-tree providing lookup paths using virtual addresses for derived objects. Wherein a derived object is a view of the primary object at a specific point in time, with copy leaf nodes of the sub-tree pointing to stored data of the derived objects. The techniques further include maintaining an ancestry graph associated with the sub-tree with the ancestry graph linking derived object identifiers to provide an ancestral chain lookup to identify derived object identifiers of the closest stored physical data of a derived object.

Managing locations of derived storage objects

A method, computer system, and a computer program product for storing a write data in a storage system that operates using a log-structured filing system is provided. The present invention may include compressing a write data. The present invention may also include identifying a region of a storage system based on a first size of the compressed write data. The present invention may further include the storage system operating using a log-structured filing system. The present invention may also include a different region of the storage system having a different compression ratio. The present invention may further include writing the compressed write data in the identified region of the storage system.

Storing write data in a storage system

Disclosed are techniques for defragmentation in deduplication storage systems. Machine language determines using deduplication metadata that at least some of an incoming input/output stream is a duplicate of at least part of a source volume whose physical locations of its stored data are fragmented in backend storage. Subsequently, defragmentation is carried out on the stored data by using the incoming input/output stream to write the data into sequential chunks at new physical locations in the backend storage and updating the source volume location mappings to the new physical locations.

Defragmentation in deduplication storage systems

Method, apparatus, and computer program product utilizing a hot-spare node in a storage network having a deduplication fingerprints database. A plurality of nodes is provided in the storage network including at least one active node and at least one hot-spare node. A portion of the deduplication fingerprints database is stored on each active node and on each hot-spare node. Data from the deduplication fingerprints database is provided from at least one of said at least one hot-spare node during normal operation. Responsive to a failure of one of said at least one active node, a portion of the deduplication fingerprints database associated with data stored on the failed one of said at least one active node is retained on one of the at least one hot-spare node. The failed one active node is replaced with one of the at least one hot-spare node.

Utilizing spare network nodes for deduplication fingerprints database

Method and system are provided for storage allocation enhancement of microservices. A method carried out at a microservice orchestrator, includes: categorizing a microservice container, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations; and providing the categorization in association with the microservice container input/output operations to a storage system for use in storage allocation of the input/output operations. A method at a storage controller includes: receiving microservice container input/output operations with an associated categorization, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations; and using the associated categorization for optimizing storage allocation for the input/output operations and/or optimizing garbage collection performance.

Storage allocation enhancement of microservices

A cache storage system indexing method is provided that indexes a data address in a cache storage system based on a data fingerprint of the cached data, wherein the data fingerprint is generated by a deduplication fingerprint function used for referencing deduplication of data in the cache storage system. A computer-implemented method of data operations to a cache storage system is also provided including: obtaining a data fingerprint for the data of the data operation, either by applying a deduplication fingerprinting function to data of a write operation or by accessing deduplication metadata for a read operation to obtain the data fingerprint generated by using a deduplication fingerprinting function used for deduplication of data in the cache storage system; and using an indexing service to the cache storage system having an address schema based on the data fingerprints of the data.

Cache indexing using data addresses based on data fingerprints

A set of read operations and a set of write operations for a set of drives in a storage system during a first time window is monitored. A write intensity of a first drive in the set is calculated based on the monitoring. The first drive is classified as a candidate for power reduction based on the write intensity. A write-intensive extent is identified on the first drive based on the monitoring. The write extensive extent is migrated to a second drive in the set of drives, and power to the first drive is reduced.

Reduction of performance impacts of storage power control by migration of write-intensive extent

Method and system are provided for storage allocation enhancement of microservices. A method carried out at a microservice orchestrator, includes: identifying distinct phases of a run of a microservice container; categorizing the phases of a run of a microservice container, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations in the phase of the microservice container; and providing the categorization in association with the microservice container input/output operations in the phase to a storage system for use in storage allocation of the input/output operations.

Storage allocation enhancement of microservices based on phases of a microservice run

An apparatus for improved version updates in data deduplication includes a baseline module that stores a baseline referrer link in a first cohort of baseline referrer links pointing to a first location in storage where a baseline version data block is stored. The apparatus includes a signpost module that stores to metadata a signpost that points to an updated referrer link in a second cohort of updated referrer links that points to a second location in the deduplicating storage device where an updated version data block is stored in response to the updated version data block being generated. The apparatus includes a cohort update module that replaces the baseline referrer link with the updated referrer link in response to determining that an additional updated version data block matches the updated version data block pointed to by the signpost. A method and a system implement functions of the apparatus.

Growing community of inventors

Chichester, United Kingdom

Lee Jason Sanders