International Business Machines Corporation

Harold Joseph Roberson, Ii

Robert Beverley Basham

Anbazhagan Mani

Alessandro Sorniotti

Elli Androulaki

Rishika Kedia

Martin Petermann

Evangelos Stavros Eleftheriou

Joseph W Dain

Dean Hildebrand

Wayne A Sawdon

Thomas D Weigold

Slavisa Sarafijanovic

Dileep Dixith

Christopher J Tan

Subramaniyan Nallasivam

Edward H W Lin

Ranjith Rajagopalan Nair

Nikola Knezevic

Stan Li

Provided are a computer program product, system, and method for replicating and migrating files to secondary storage sites. Files in a fileset at the primary storage site are migrated to a file container, wherein data for the files migrated to the file container is distributed among the secondary storage sites. File metadata for each of the migrated files is updated to include access information on the migrated file in the file container. Data for the migrated files is deleted in a local storage. The file metadata for the migrated files is replicated to the secondary storage sites over the network to store in filesets at the secondary storage sites without replicating file data for the migrated files to store in the filesets the secondary storage sites.

Replicating and migrating files to secondary storage sites

Methods that can accelerate replication of file metadata on different sites are disclosed herein. One method includes recreating, by a processor, a transaction history for a predetermined period of time for a set of consumer sites of a first storage network and synchronizing data in the set of consumer sites and a new consumer site added to the first storage network utilizing a cloud scale persistent message bus. In this method, the data is synchronized based on the recreated transaction history during the predetermined period of time and current transactions performed on each consumer site in the set of consumer sites. Apparatus, systems, and computer program products that can include, perform, and/or implement the methods are also disclosed herein.

Apparatus, systems, and methods for accelerated replication of file metadata on different sites

Distributed system controllers provide on-demand data access in complex, heterogenous data storage. In one embodiment, the distributed system controllers respond to name space metadata event messages published on a persistent message but to maintain a common name space in a complex of heterogenous data storage systems. In one embodiment, data unit access request metadata messages are propagated in recursive, cascading hops along a persistent message bus until the requested data unit is located and retrieved. Other features and aspects may be realized, depending upon the particular application.

Distributed system control for on-demand data access in complex, heterogenous data storage

Methods and systems for automated regulation compliance for backing up and restoring in a storage environment are provided. A system for providing automated regulation compliance for backing up and restoring in a storage environment includes an analyzer module that determines if a storage system complies with regulations. The system includes a converter module that converts the storage system to comply with the regulations in response to determining that the storage system does not comply with the regulations. The system includes a validator module that validates that the converted storage system complies with the regulations.

Automated regulation compliance for backup and restore in a storage environment

A computer program product is provided for efficiently managing storage in a multi-tiered storage system. The computer program product comprises a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a processor to cause the processor to receive a command from an application, where the command is directed to at least one object. The program instructions are further executable by the processor to cause the processor to determine storage for the at least one object in a multi-tiered storage system based on the command, and store the at least one object in accordance with the determined storage.

Efficiently managing movement of large amounts object data in a storage hierarchy

A key-value store for storing and retrieving user files based on key-value pairs, hereafter referred to as KVPs. For each user of the key-value store, each file of a set of files of said each user is stored as one or more pairs of KVPs. Each of said one or more pairs comprises a KVP of a first type and a KVP of a second type. The KVP of the first type comprises at least a part of contents of said each file, whereas the KVP of the second type comprises metadata (and possibly attributes) of said each file. Each KVP of the second type links to one or more KVPs of the first type. Further provided are related method and computer program products.

Key-value store for managing user files based on pairs of key-value pairs

A multi-tiered file locking service provides file locking at the thread and process level, and can optionally include locking at the file system level. A local locking mechanism maintains a list of local locks for threads within a process. When a thread requests a lock for a file, and a local lock is obtained, a process lock for the file may be requested. When no file system locking is used, when the process lock is obtained, the thread receives the lock for the file. When file system locking is used, when the process lock is obtained, a file system lock for the file may be requested. When the file system lock for the file is obtained, the thread receives the lock for the file. The result is a file locking service that functions across threads, processes and nodes in a distributed computing environment.

Multi-tiered file locking service in a distributed environment

Growing community of inventors

Rochester, MN, United States of America

Harold Joseph Roberson, Ii