International Business Machines Corporation

Mark Alan Haye

David Maxwell Cannon

Matthew Joseph Anglin

Howard Newton Martin

Colin Scott Dawson

Avishai Haim Hochberg

Barry Fruchtman

Donald Paul Warren, Jr

Toby Lyn Marek

David Michael Shackelford

Michael Allen Kaczmarski

Ronald Maynard Kern

John Glenn Thompson

James Patrick Smith

David Randall Blea

Alan L Stuart

Ken Eugene Hannigan

Donald Reynold Blea

Data objects are replicated from a source storage managed by a source server to a target storage managed by a target server. A source list is built of objects at the source server to replicate to the target server. The target server is queried to obtain a target list of objects at the target server. A replication list is built indicating objects on the source list not included on the target list to transfer to the target server. For each object in the replication list, data for the object not already at the target storage is sent to the target server and metadata on the object is sent to the target server to cause the target server to include the metadata in an entry for the object in a target server replication database. An entry for the object is added to a source server replication database.

Replication of data objects from a source server to a target server

An apparatus, system, and method are disclosed for policy-based secure destruction of data. The method for policy-based secure destruction of data is provided. In one embodiment, the method includes storing a data destruction policy, wherein the data destruction policy defines at least one predetermined data destruction parameter. The method may also include referencing the data destruction policy to obtain the data destruction parameters in response to a predetermined data operation. In a further embodiment, the method may include executing a data destruction process in accordance with the data destruction parameters.

Method and system for policy-based secure destruction of data

A process is disclosed by which data is securely deleted in a transactionally consistent manner. This may be accomplished by committing a preparation transaction for a data object within a system managing the data object in order to return the system to an initial condition if necessary, attempting to commit an execution transaction with the data object only after committing the preparation transaction, and securely deleting any portion of the data object necessary to return the system to the initial condition if committing the execution transaction fails and to change the system to a completed condition only if committing the execution transaction succeeds. In a delete or move transaction an existing backup object may be assigned a new logically deleted state such that if the delete or move transaction fails, the data will be made accessible again.

Securely deleting data in a transactionally consistent manner

Provided are a method, system, and program for managing storage objects. Storage object information is provided for each storage object, wherein the storage object information indicates at least one of a plurality of groups associated with the storage object, and wherein each storage object is capable of being associated with a plurality of groups and different group types. Group information is provided for each group indicating a group identifier, storage objects associated with the group, and a group type.

Method, system, and program for managing groups of objects when there are different group types

A system, apparatus, and process creates a table of contents (TOC), including one or more table of contents (TOC) entries, to manage data in a hierarchical storage management system. Each TOC entry contains metadata describing the contents and attributes of a data object within an image, which is an aggregation of multiple data objects into a single object for storage management purposes. The TOC is stored in a storage hierarchy, such as magnetic disk, for fast access of and efficient operation on the aggregated TOC entries. The system, apparatus, and process also provide for aggregating the TOC entries from one or more TOCs into a TOC set in the storage management server database. The TOC set may be manipulated and queried in order to find a particular data object or image referenced by a TOC entry. The TOC entries, TOCs, and TOC sets may be dynamically managed by the hierarchical data storage management system through implementation of a set of policy management constructs that define appropriate creation, retention, and movement of the objects within the database and storage hierarchy.

Hierarchical storage management using dynamic tables of contents and sets of tables of contents

Provided is a method for managing retention of stored objects, comprising: receiving a modification request with respect to an attribute or archive policy for an object; determining whether an attribute modification protection flag or setting is set in response to the modification request requesting to modify the attribute for the object; allowing the modification of the attribute object in response to determining that the attribute modification protection flag or setting is not set; determining whether a protection retention mechanism or setting is set in response to the modification request requesting to modify the archive policy for the object; and allowing the modification of the archive policy for the object in response to determining that the protection retention mechanism or setting is not set.

Method, system, and program for retention management and protection of stored objects

Provided is a method for merging metadata on files in a backup storage. A query is received for information on files from a file system for a client node. A determination is made of metadata for files in a backup storage for the client node stored external to backup sets. At least one backup set in the backup storage for the client node is processed to determine metadata for files included in at least one backup set. The determined metadata for files in the backup storage and for files included in at least one backup set is merged to form merged metadata. The query is executed against the merged metadata to determine files whose metadata satisfies the query. Results including information from the merged metadata on the determined files are returned.

Method for merging metadata on files in a backup storage

Provided are a method, system, and program for managing retention of stored objects. A modification request is received with respect to a stored object. A determination is made as to whether a retention protection mechanism is set and a storage policy associated with the stored object is processed to determine whether the stored object has expired according to the storage policy in response to determining that the retention protection mechanism is set. The modification request is allowed to proceed in response to determining that the stored object has expired.

A system and method for transferring related data objects in a distributed data storage environment allows for data objects belonging to a common group to be transferred while preserving the grouping of the data objects. The data objects can be transferred in an order in which the data objects are stored, rather than in an order of grouping. The data objects are accompanied with attribute information including a unique group identifier when transferred from a source site to a target site. At the target site, the attribute information for each data object is received and analyzed. An import groups table listing the groups of data objects is used to associate each data object with its group as it is received. Data objects of groups for which any members have not been received are also listed in an unresolved objects table. When a group is complete, all data objects of the group are removed from the unresolved objects table. At the end of a data transfer session, all data objects still listed in the unresolved objects table are deleted.

System and method for transferring related data objects in a distributed data storage environment

A system and method for relating files in a distributed data storage environment allows for positive identification of membership of a file within a group, even in a loosely coupled environment where files are not available for comparison in real time. In disclosed embodiments, base files of a client are stored on a server and are accompanied by tokens uniquely identifying the base files. The tokens are generated on the client and may be derived from the contents of the base file using a digital signature. Each file transmitted to the server is accompanied with a token. Incremental backups may be used, and may employ file differencing. Accordingly, sub-files related to the base files may be transmitted to the server for backup. The sub-files are related to their respective base files using the tokens and are cross-linked to the base files so that any sub-files can be retrieved together with the base file from which the sub-file was derived.

System and method for relating files in a distributed data storage environment

A method, apparatus, and article of manufacture for performing a point-in-time backup using a snapshot function. Work space on a work virtual volume is obtained to hold the snapshot copy of the source data being copied from a source virtual volume. Updates to the source virtual volume are suspended during the snapshot function, so as to provide a logically consistent view of the source virtual volume at a common point in time. Pointers are copied from a virtual track table of the source virtual volume to a virtual track table of the work virtual volume without actually moving any data on data storage devices referenced by those pointers. As a result, the snapshot function provides a method for copying the source virtual volume to the work virtual volume very quickly. Upon completion of the snapshot function, updates to the source virtual volume may be resumed. Subsequently, a backup is performed in the usual manner, except that the backup retrieves the source data from the work virtual volume rather than the source virtual volume.

Growing community of inventors

Tucson, AZ, United States of America

Mark Alan Haye