International Business Machines Corporation

Globalfoundries Inc.

International Business Corporation

Matthew G Borlick

Lokesh M Gupta

Kevin J Ash

Kyler A Anderson

Karl Allen Nielsen

Trung Ngoc Nguyen

Clint Alan Hardy

Micah Robison

Beth Ann Peterson

Matthew J Kalos

Brian Anthony Rinaldi

Roger Gregory Hathorn

John Charles Elliott

Joseph Hayward

Carol Santich Mellgren

Steven Edward Klein

Adrian Cuenin Gerhard

Brian James Cagno

Matthew Richard Craig

Will A Wright

Richard P Oubre, Jr

Todd Charles Sorenson

John Glenn Thompson

Mark Elliott Hack

Ashwani Kumar

James E Olson

Usman Ahmed

Gregory E McBride

Chao Li

Brian D Hatfield

Edward Lin

Jared Michael Minch

Steven Douglas Johnson

Richard B Stelmach

Edward Hsiu-Wei Lin

Richard Harry Hopkins

Warren Keith Stanley

Kurt Allen Lovrien

Juan Antonio Yanes

Sean Patrick Riley

Markus Navarro

Dohn Robert Buchanan

Dominic Tracy Pruitt

Alistair Leask Symon

Richard H Hopkins

Kyle A Anderson

Provided are a computer program product, system, and method for determining to migrate data between compressed storage devices and non-compressed storage devices in a storage system. The storage system provides compressed storage devices having native data compression and a non-compressed storage devices not configured to have native compression. A determination is made of storage usage factors for the compressed storage devices and the non-compressed storage devices. A determination is made whether to move data between the compressed storage devices and the non-compressed storage devices based on the storage usage factors. Data is moved between the compressed storage devices and the non-compressed storage devices in response to determining to move the data between the compressed storage devices and the non-compressed storage devices.

Determining to migrate data between compressed storage devices and non-compressed storage devices in a storage system

An example method for dynamic data relocation using cloud based ranks comprises monitoring accesses to data stored on a plurality of local ranks of an enterprise storage system; identifying data which has not been accessed for a predetermined amount of time based on the monitored accesses; and moving the data which has not been accessed for the predetermined amount of time to one or more cloud based ranks of the enterprise storage system, wherein each cloud based rank comprises storage space on one or more cloud storage devices, the storage space on the one or more cloud storage devices mapped to corresponding virtual local addresses that are grouped as a virtual local rank.

Dynamic data relocation using cloud based ranks

Described are techniques for selecting compressed or non-compressed data storage using hints for a dataset. The techniques include receiving a dataset at a data storage system that manages storage location on compressed data storage and non-compressed data storage. The techniques further include determining, by the data storage system, that the dataset includes one or more hints for selecting a storage location for the dataset from one of the storage locations managed by the data storage system. The techniques further include selecting, by the data storage system, the storage location for the dataset based in part on the one or more hints and storing the dataset to the storage location.

Hinting information for selecting a storage location for a dataset

Provided are a computer program product, system, and method for determining a storage device type on which to store extents of data in a storage system. The storage system provides a first storage device type that has native data compression at a first compression ratio and a second storage device type that has native data compression at a second compression ratio. The second compression ratio is higher than the first compression ratio. A determination is made for an extent to store the extent on the first storage device type or the second storage device type based on access frequency to data in the extent and an Input/Output (I/O) priority level for the extent. The extent is stored on the determined first or second storage device type.

Determining a storage device type on which to store extents of data in a storage system

A computational device receives an indication that specifies a maximum retention time in cache for a first plurality of tracks, wherein no maximum retention time is specified for a second plurality of tracks. A plurality of insertions points are generated in a least recently used (LRU) list, wherein different insertion points in the LRU list correspond to different amounts of time that a track of the first plurality of tracks is expected to be retained in the cache, wherein the LRU list is configured to demote both tracks of the first plurality of tracks and the second plurality of tracks from the cache.

Integration of application indicated maximum time to cache to least recently used track demoting schemes in a cache management system of a storage controller

Provided are a storage device, system, and method for performance enhancing measures for storage in which high-performance volumes reside. Indication is made of a volume configured in the arrays to have high-performance. An array is determined storing the indicated volume. A determination is made of storage devices in which the determined array resides. The storage devices are enabled to perform garbage collection on blocks of data having valid and invalid pages in the storage devices at a first garbage collection rate and a second garbage collection rate. The second garbage collection rate causes a storage device to perform garbage collection with respect to a greater number of blocks than the first garbage collection rate. A command is sent to the determined storage devices to garbage collect at the second garbage collection rate.

Garbage collection for storage in which high-performance volumes reside

Provided are a computer program product, system, and method for generating data protection directives to provide to a storage controller to control access to data in cache. A data protection directive is generated for a data subset indicating access request type and a protective action with respect to the access request type for the data subset. The data protection directive is transmitted to the storage controller. The storage controller includes the data protection directive in metadata for the data subset. The data protection directive causes the storage controller to perform the protective action in response to an access request of the access request type to a portion of the data subset.

Generating data protection directives to provide to a storage controller to control access to data in cache

A machine learning module is trained by receiving inputs comprising attributes of a computing environment, where the attributes affect a likelihood of failure in the computing environment. In response to an event occurring in the computing environment, a risk score that indicates a predicted likelihood of failure in the computing environment is generated via forward propagation through a plurality of layers of the machine learning module. A margin of error is calculated based on comparing the generated risk score to an expected risk score, where the expected risk score indicates an expected likelihood of failure in the computing environment corresponding to the event. An adjustment is made of weights of links that interconnect nodes of the plurality of layers via back propagation to reduce the margin of error, to improve the predicted likelihood of failure in the computing environment.

Perform preemptive identification and reduction of risk of failure in computational systems by training a machine learning module

A computer-implemented method, according to one approach, includes: monitoring performance in NVRAM having a plurality of memory blocks. Moreover, a change in the flow rate of I/O requests received at the NVRAM is identified as a result of the monitoring. In response to identifying the change is an increase in the flow rate of received I/O requests, the percentage of invalid pages in a given block of NVRAM that triggers garbage collection to be performed on the given block is increased. However, in response to identifying the change is a decrease in the flow rate of received I/O requests, the percentage of invalid pages in a given block that triggers garbage collection to be performed on the given block is decreased.

Adjusting garbage collection based on input/output flow rates

Provided are a computer program product, system, and method for determining whether to compress data at a source device to transmit to a target device. A determination is made of network bandwidth between the source device and the target device. The source device transmits data to the target device. A determination is made of source available processor resources on the source device and target available processor resources on the target device. A determination is made as to whether to compress data at the source device to transmit to the target device based on the network bandwidth, the source available processor resources, and the target available processor resources. Compression is initiated, on the source device, of the data to transmit to the target device in response to determining that the source device is to compress the data.

Determining whether to compress data at a source device to transmit to a target device

Provided are techniques for task adjustment for uniform performance of drives. Arrays are created for different drive types. Performance benchmarks are run for each of the arrays to compute a stage maximum value and a destage maximum value for each of the drive types. At run time, in response to determining that a mode indictor indicates a uniform performance mode, a maximum number of stage Task Control Blocks (TCBs) are set to a stage maximum uniform value and a maximum number of destage TCBs are set to a destage maximum uniform value. The stage of first data is performed using an actual number of stage TCBs that do not exceed the maximum number of stage TCBs. The destage of second data is performed using an actual number of destage TCBs that do not exceed the maximum number of destage TCBs.

Task adjustment for uniform performance of drives

Provided are a method, a system, and a computer program product in which metadata associated with encrypted data is maintained in a cloud computing environment, where the metadata indicates whether reading of information in the encrypted data is restricted geographically. A controller provides a decryption code to a cloud server located in a geographical location. The decryption code is for decrypting the encrypted data. The controller provides the decryption code, based on a determination as to whether the metadata indicates whether the reading of information in the encrypted data is restricted geographically.

Encryption and decryption of data in a cloud storage based on indications in metadata

Provided are a computer program product, system, and method for saving track metadata format information for tracks demoted from cache for use when the demoted track is later staged into cache. A track is demoted from the cache and indicated in a demoted track list. The track format information for the demoted track is saved, wherein the track format information indicates a layout of data in the track. The saved track format information for the demoted track is used when the demoted track is staged back into the cache.

Saving track metadata format information for tracks demoted from cache for use when the demoted track is later staged into cache

Provided are a computer program product, system, and method for determining tracks to prestage into cache from a storage. Information is provided related to determining tracks to prestage from the storage to the cache in a stage group of sequential tracks including a trigger track comprising a track number in the stage group at which to start prestaging tracks and Input/Output (I/O) activity information to a machine learning module. A new trigger track in the stage group at which to start prestaging tracks is received from the machine learning module having processed the provided information. The trigger track is set to the new trigger track. Tracks are prestaged in response to processing an access request to the trigger track in the stage group.

Dynamically determining tracks to prestage from storage to cache using a machine learning module

Provided are a computer program product, system, and method for managing swappable data structures in a plurality of memory devices based on access counts of the data structures. Data structures indicated as swappable are updated less frequently than most frequently updated data structures. Data structures not indicated as swappable are maintained in a first level memory device and not moved to a second level memory device. The first level memory device has lower latency than the second level memory device. Access counts are maintained for the data structures stored in the first level memory device that are indicated as swappable. Data structures are selected in the first level memory device having lowest access counts. The selected data structures are removed from the first level memory device and retained in the second level memory device.

Managing swappable data structures in a plurality of memory devices based on access counts of the data structures

Growing community of inventors

Tucson, AZ, United States of America

Matthew G Borlick