International Business Machines Corporation

Raul Eduardo Saba

Theresa Mary Brown

Carol Santich Mellgren

Nedlaya Yazzie Francisco

Theodore Timothy Harris, Jr

Suguang Li

Mark L Lipets

Gregory E McBride

Gregory Tad Kishi

Joseph W Dain

Sara Megan Coronado

Jared Michael Minch

Scott A Brewer

Warren Keith Stanley

Nicolas Marc Clayton

Lokesh M Gupta

Kurt Allen Lovrien

Brian D Hatfield

Alfred Emilio Sanchez

Ellen Joanne Grusy

Beth Ann Peterson

Matthew Sanchez

Juan A Coronado

Kevin C Lin

Drew Olson

Scott Brewer

Olympia Gluck

Lisa R Martinez

Brian Dow Clark

David Brent Schreiber

Ran Fashchik

Chuong H Tran

Nicholas M Clayton

A method and/or system of managing metadata are disclosed that include connecting a source data storage system (DSS) that stores both data and metadata to a metadata management platform (MMP); scanning metadata records onto the MMP from the DSS; storing metadata attributes for at least one of the group consisting of directories and buckets on the DSS in a look-up table on the MMP; and adding updated metadata attributes to the look-up table on the MMP for each subsequent scan of the DSS.

Custom metadata tag inheritance based on a filesystem directory tree or object storage bucket

A method includes scanning, by a device of a plurality of devices, a directory of a file system. The directory includes a plurality of subdirectories, and each device of the plurality of devices corresponds to a different queue of a plurality of queues. The method also includes inserting, by the device, a plurality of scanning tasks into a subset of the plurality of queues in a round robin fashion. The plurality of scanning tasks correspond to the plurality of subdirectories and responding to a scanning task of the plurality of scanning tasks includes scanning a subdirectory of the plurality of subdirectories.

Parallel file system scans with multiple shared queues

A method includes generating a table in a relational database, the table comprising an empty column reserved for a custom tag. The column has a default column name. The method also includes, in response to an instruction to create the custom tag, generating a column mapping that maps a name of the custom tag to the column name. The column mapping is stored outside the relational database and is used by a parser to translate between the name of the custom tag and the column name.

Custom tag definition and translation in a database

Provided are a computer program product, system, and method for updating change information for current copy relationships when establishing a new copy relationship having overlapping data with the current copy relationships. A first copy relationship indicates changed first source data to copy to first target data. An establish request is processed to create a second copy relationship to copy second source data in to second target data. A second copy relationship is generated, in response to the establish request, indicating data in the second source data to copy to the second target data. A determination is made of overlapping data units in the first source data also in the second target data. Indication is made in the first copy relationship to copy the overlapping data units. The first source data indicated in the first copy relationship is copied to the first target data, including data for the overlapping data units.

Updating change information for current copy relationships when establishing a new copy relationship having overlapping data with the current copy relationships

Consistency groups are asynchronously copied to a remote computational device, from a local computational device, wherein point in time copy operations are performed at the local computational device while the consistency groups are being asynchronously copied to the remote computational device. Indicators are stored at the remote computational device to identify those point in time copy operations that are to be restored as part of a recovery operation performed at the remote computational device in response to a failure of the local computational device.

Restoration of data when point in time copy operations are performed during asynchronous copy

Systems and methods for metadata tag inheritance are disclosed. The methods include maintaining a plurality of data storage systems in communication with an external metadata management system, operating the metadata management system to store metadata corresponding to data residing on the data storage systems as a plurality of entries, detecting an execution of a data operation command on data residing in a data storage system that causes movement of a data set from that data storage system to a destination data storage system that is different from that data storage system, and operating the metadata management system to create a new metadata entry corresponding to the execution of the data operation command. Each of the plurality of entries may include one or more custom tags, and the new metadata entry may include at least one custom tag created before the execution of the data operation command.

Methods and systems for metadata tag inheritance between multiple storage systems

Systems and methods for metadata tag inheritance during backup are disclosed. The method includes maintaining a plurality of data storage systems in communication with an external metadata management system, operating the metadata management system to store metadata corresponding to data residing on the data storage systems as a plurality of entries that include or more custom tags, detecting an execution of a backup data operation command on data residing in a data storage system that causes creation of a backup copy of a data set in that data storage system in a destination data storage system, and operating the metadata management system to create a new metadata entry corresponding to the execution of the backup data operation command in response to detecting the execution of the backup data operation command. The new metadata entry includes at least one custom tag created before the execution of the backup data operation command.

Methods and systems for metadata tag inheritance for data backup

Systems and methods for metadata tag inheritance are disclosed. The methods include maintaining a plurality of data storage systems in communication with an external metadata management system, operating the metadata management system to store metadata corresponding to data residing on the plurality of data storage systems as a plurality of entries, detecting an execution of a data operation command in a data storage system that causes movement of a data set from source storage location to a destination storage location in that data storage system, and operating the metadata management system to create a new metadata entry corresponding to the execution of the data operation command in response to detecting the execution of the data operation command. Each of the plurality of entries includes one or more custom tags, and the new metadata entry includes at least one custom tag created before the execution of the data operation command.

Methods and systems for metadata tag inheritance between multiple file systems within a storage system

Systems and methods for metadata tag inheritance are disclosed. The methods include maintaining a plurality of data storage systems including at least one tiered data storage system in communication with an external metadata management system, operating the metadata management system to store metadata corresponding to data residing on the plurality of data storage systems as a plurality of entries, detecting an execution of a data operation command in the tiered data storage system that causes movement of a data set from a source storage tier to a destination storage tier, and in response to detecting the execution of the data operation command, operating the metadata management system to create a new metadata entry corresponding to the execution of the data operation command. The new metadata entry includes at least one custom tag created before the execution of the data operation command.

Methods and systems for metadata tag inheritance for data tiering

Provided are a computer program product, system, and method for releasing space allocated to a space efficient target storage in a copy relationship with a source storage. Source and target copy relationships indicate source data in the source storage to copy to target data in the target storage. The source copy relationship indicates source data that need to be copied to the target data before being updated, and the target copy relationship indicates target data tracks updated with data copied from corresponding source data. An operation is initiated that results in terminating the source and target copy relationships. Space allocated to the target data for the source and target copy relationships is released in response to determining that the target storage comprises the space efficient storage. The source and target copy relationships are removed.

Releasing space allocated to a space efficient target storage in a copy relationship with a source storage

Provided are a computer program product, system, and method for using a cascade flag to process a copy relationship having a backward cascade copy relationship. Each of a plurality of copy relationships indicates to copy source data to target data and has a cascade flag. The cascade flag for a forward copy relationship of the copy relationships is set to a first value in response to determining that the source data for the forward copy relationship comprises target data for a backward copy relationship and that a background copy operation specified to copy source data to target data of the backward copy relationship has not completed. The cascade flag for the forward copy relationship is set to a second value in response to determining that the backward copy relationship does not have an uncompleted background copy operation.

Using a cascade flag to process a copy relationship having a backward cascade copy relationship

A method for enabling point-in-time-copy target volumes to be primary volumes in PPRC relationships is disclosed. In one embodiment, such a method includes reserving, on a first storage device, first resources needed to establish a first point-in-time-copy relationship between a first source volume and a first target volume. The method further sends a reservation request to a second storage device to reserve second resources needed to establish, on the second storage device, a second point-in-time-copy relationship between a second source volume and a second target volume. In the event the reservation request is successfully executed, the method establishes the first point-in-time-copy relationship on the first storage device using the first resources, and sends a check-in request to the second storage device to establish the second point-in-time-copy relationship on the second storage device using the second resources. A corresponding system and computer program product are also disclosed.

Growing community of inventors

Tucson, AZ, United States of America

Raul Eduardo Saba