International Business Machines Corporation

Lenovo (singapore) Pte. Ltd.

Jeffrey Richard Suarez

Robert Stanley Gensler, Jr

Lisa Joan Gundy

Christopher J Miller

Ernesto E Figueroa

Theresa Mary Brown

David Michael Shackelford

Warren Keith Stanley

Susan Kay Candelaria

Scott Brady Compton

Nedlaya Yazzie Francisco

Corey G Smeaton

Justin Paul Eastman

Jason R Luurs

Christian Jacobi

Matthew Michael Garcia Pardini

Andrew Nelson Wilt

Dave Bach

Nadim P Shehab

Henry Verdugo Valenzuela

Samantha Jean Wareing

Carly Joanne Fife

Vicky Vezinaw

Evelyn Brazelton

Sri Hari Kolusu

Dominik Steenken

A computer-implemented method, according to one embodiment, includes: receiving a data process that includes a plurality of sub-processes. A unique subset of the sub-processes is assigned to each of: a managing thread, and at least one other thread. Moreover, performance characteristics of each of the threads is evaluated while the respective subsets of sub-processes are being performed, and a determination is made as to whether the performance characteristics of each of the threads are substantially equal to the performance characteristics of each of the other threads. In response to determining that performance characteristics of each of the threads are not substantially equal, the subsets of the sub-processes are dynamically adjusted such that the performance characteristics of each of the threads become more equal. Moreover, the adjusted subsets of the sub-processes are reassigned to each of the managing thread and at least one other thread.

Dynamic workload distribution for data processing

A computer-implemented method, according to one embodiment, includes: storing records in an input data buffer, where each of the records include a key which is appended to payload data in the respective record. Moreover, for each of the records: shearing the key associated with the record from the payload data, normalizing the sheared key, and storing the normalized sheared key in a first target area of memory. A determination is made as to whether a size of the payload data in the record is outside a predetermine range, and in response to determining that the size of the payload data in the record is outside the predetermine range, the payload data is stored in a second target area of memory. A data locator is also appended to the normalized sheared key in the first target area of memory to form a sheared record.

Selectively shearing data when manipulating data during record processing

A computer-implemented method, according to one embodiment, includes: processing records by, for each of the records: shearing the key associated with the record from the payload data, normalizing the sheared key, and storing the normalized sheared key in a first target area of memory. A determination is made whether a size of the payload data is outside a first predetermined range. In response to determining that the size of the payload data is outside the first predetermined range, the payload data is stored in a second target area of memory, and a data locator is appended to the normalized sheared key. Furthermore, in response to determining that a storage capacity of the memory is outside a second predetermined range, some of the payload data is transferred to external physical storage. Moreover, an external list is integrated with each of the data locators that correspond to the transferred payload data.

Selectively evicting data from internal memory during record processing

A computer-implemented method includes determining that an update to data on a local computer has been initiated by an application and sending a notification to a remote computer that the update has been initiated. The method includes sending, to the remote computer, an indication of the data on the local computer being updated. The method includes, in response to determining that updates to the data on the local computer and meta data corresponding to the data have been completed, sending a second notification to the remote computer that the update has been completed.

Maintaining user data and metadata consistency in an asynchronous replication environment

A method for generating preview information related to data migrated to archival storage media. In an embodiment, the method includes one or more computer processors identifying data designated for archival. The method further includes identifying a set of preferences associated with generating a set of preview data corresponding to the data designated for archival. The method further includes determining metadata related to the data designated for archival based on the identified set of preferences. The method further includes archiving the data designated for archival. The method further includes responding to archiving the data designated for archival by determining information associated with archiving the designated data. The method further includes generating a set of preview data corresponding to the archived designated data based, at least in part, on the determined metadata and the information associated with archiving the designated data.

Generating preview information related to data migrated to archival media

A storage controller receives a command from a host application to perform a point-in-time backup of a source dataset to a storage cloud. The storage controller generates a target dataset via a point-in-time copy of the source dataset, and a mapping that indicates a correspondence between locations of the source dataset and locations of the target dataset. The storage controller copies the target dataset to the storage cloud to generate a backup dataset that is the point-in-time backup of the source dataset, wherein the backup dataset is accessible via reference to the locations of the source dataset.

Point-in-time backups via a storage controller to an object storage cloud

Provided are a computer program product, system, and method for defragmenting backup objects. A metadata object having first format addresses for data sets in data objects for a volume is copied to a temporary metadata object. The data sets in the data objects are copied to consecutive second format addresses in temporary data objects to defragment data in the data sets in the data objects. The first format and the second format addresses comprise different address formats. The temporary metadata object and the temporary data objects are stored in the storage to provide a backup of the volume.

Defragmenting backup objects

Provided are a computer program product, system, and method for accessing records of a backup file in a network storage. A backup file comprises a sequential file of metadata records and data set records is processed. The metadata records include metadata on data of data sets in the data set records. Backup objects store the metadata and the data set records in the backup file. A determination is made of at least one container in the network storage to store the backup objects. Backup object information indicates for each of the backup objects, an order of the metadata or data set record, stored in the backup object, in the backup file, and a container of the at least one container in which the backup object is stored. Multiple of the backup objects are concurrently transmitted to the network storage to concurrently write to the at least one container.

Accessing records of a backup file in a network storage

Provided are a computer program product, system, and method for performing a remote point-in-time copy to a source and target storages in further mirror copy relationships. Each of a plurality of source copy relationships is from the source storage to one corresponding source copy storage. Each of a plurality of target copy relationships is from the target storage to one corresponding target copy storage, where in each relationship an indicator indicates whether to use a remote first type copy operation. The first type copy operation is used to copy data from the source storage to the target storage and copy data from the source copy storage to the target copy storage for the determined source and target copy relationships having the indicator set. A second type of copy operations is used for source and target relationships not having the indicator set.

Performing a remote point-in-time copy to a source and target storages in further mirror copy relationships

Provided are a computer program product, system, and method for serializing access to data objects in a logical entity group in a network storage. Data objects associated with a logical entity at a client storage are generated. A determination is made of a prefix for a container in the network storage associated with the logical entity. The prefix is included in names of the data objects in the logical entity. The prefix is added to a lock queue shared by the client systems having access to the data objects in the container at the network storage. The data objects having the names including the prefix are transmitted to the network storage to store in the container in the network storage.

Serializing access to data objects in a logical entity group in a network storage

Provided are a computer program product, system, and method for providing integrity for data sets backed-up from client systems to objects in a network storage. Data set objects include data sets at a client storage and an inventory object has information on each of the data set objects, which are part of a backup object group to backup to the network storage. The data set and inventory objects in the backup object group are transferred to the network storage to store. The inventory object from the network storage is retrieved to select at least one of the data set objects in the network storage, which is requested. Notification is received that the backup object group has a data integrity error in response to one of the requested data set objects not located in the network storage.

Providing integrity for data sets backed-up from client systems to objects in a network storage

A storage controller maintains extent space efficient storage volumes in a primary allocation space and a secondary allocation space. An indicator is used to indicate that extents of the secondary allocation space are available for an extent pool, without releasing the extents from the secondary allocation space.

Growing community of inventors

Tucson, AZ, United States of America

Jeffrey Richard Suarez