International Business Machines Corporation

Lenovo (singapore) Pte. Ltd.

Takeshi Ishimoto

Atsushi Abe

Yutaka Oishi

Hiroshi Itagaki

Hiroshi Araki

Hiroyuki Miyoshi

Slavisa Sarafijanovic

Tohru Hasegawa

Takashi Ashida

Shinobu Fujihara

Dominic Mueller-Wicke

Khanh V Ngo

Harald Seipp

Simon Lorenz

Terue Watanabe

Setsuko Masuda

Thomas D Weigold

Tohru Sumiyoshi

Kazuhiro Ozeki

Martin Petermann

Mathias Bjoerkqvist

Masahide Washizawa

Joseph W Dain

Nilesh Prabhakar Bhosale

Satoshi Yamazaki

Tsutomu Kigoshi

A method includes receiving a plurality of files where each file represents an object. The method further combines selected files of the plurality of files into an aggregation file and stores the aggregation file on low-latency storage media, such as disk storage media. The method represents the aggregation file with a single inode that is stored on the low-latency storage media. The method migrates the aggregate file to high-latency storage media, such as tape storage media, while leaving the single inode representing the aggregation file on the low-latency storage media. By collecting files into larger aggregation files, the number of files archived is significantly reduced and the files archived are of larger size. The reduced number of files and increased size of the files improves archival and retrieval performance due to reduced metadata operation overhead. A corresponding system and computer program product are also disclosed.

Performance- and cost-efficient archiving of small objects

A computer-implemented method includes receiving custom metadata for several data items, the data items having system metadata associated therewith, selecting, based on the custom metadata, some of the data items to move between a primary storage system and a secondary storage system, and moving the selected data item(s) between the primary storage system and the secondary storage system. A computer program product includes a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a computer to cause the computer to perform the foregoing method. A system includes a processor and logic integrated with the processor, executable by the processor, or integrated with and executable by the processor. The logic is configured to perform the foregoing method.

Event driven migration, recall, and data placement optimization based on custom metadata

A method includes receiving a plurality of files where each file represents an object. The method further combines selected files of the plurality of files into an aggregation file and stores the aggregation file on low-latency storage media, such as disk storage media. The method represents the aggregation file with a single inode that is stored on the low-latency storage media. The method migrates the aggregate file to high-latency storage media, such as tape storage media. By collecting files into larger aggregation files, the number of files archived is significantly reduced and the files archived are of larger size. The reduced number of files and increased size of the files improves archival and retrieval performance due to reduced metadata operation overhead. A corresponding system and computer program product are also disclosed.

In an approach to automatically reconciling data in HSM without affecting system performance, responsive to migrating a file on a hierarchical storage system from a primary storage to one or more tape drives, one or more file migration records are recorded in a reconcile database. Responsive to the occurrence of a file event on the primary storage, the one or more file migration records in the reconcile database are updated. Responsive to receiving a command to unmount a first mounted tape on one of the one or more tape drives, a reconcile function is performed on the first mounted tape, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database.

Event based reconcile operation for hierarchical storage management

Embodiments are disclosed for a method for a tape library in hierarchical storage. The method includes receiving a recall request for a recall file having two copies stored in two tape libraries that are performing two migrations of two sets of files. The method also includes determining two migration progress values corresponding to the two migrations. Additionally, the method includes assigning the recall request to one of the two tape libraries having a greater value of the two migration progress values.

Selecting a tape library for recall in hierarchical storage

A system and method for adding a migration file group to a hierarchical storage management (HSM) system for data co-location are presented. A file group attribute may be automatically added to one or more files in the HSM system to enable one or more applications to co-locate data. The one or more files, having a similar file group attribute, may be migrated from one or more storage devices in a first tier in the HSM system to a tape storage device in an nth tier of the HSM system to enable recalling of the one or more files in the HSM system.

Adding a migration file group to a hierarchical storage management (HSM) system for data co-location

A system and method for data co-location in hierarchical storage management (HSM) system are presented. Related data units may be grouped to be collectively accessed from a plurality of data units stored on a first sequential media. The related data units may be migrated from the first sequential media in the HSM system to a second sequential media in the HSM system to sequential and continuous access to the related data units on the second sequential media.

Data co-location in a hierarchical storage management (HSM) system

A computer-implemented method according to one embodiment includes receiving a request to perform a high-latency media (HLM) action on an object or a group of objects, identifying metadata associated with the object or group of objects, and conditionally allowing the HLM action to be performed on the object or group of objects, based on the HLM action and the metadata associated with the object.

Regulating migration and recall actions for high latency media (HLM) on objects or group of objects through metadata locking attributes

Reducing time required to write a file to tape is provided. Synchronous processing is performed in a file system implementing a Linear Tape File System (LTFS) file format, wherein the synchronous processing includes writing, to a tape medium of a tape cartridge, index information and one or more files. A type of the synchronous processing is determined, wherein the type is either an index-MAM sync type or an index-only sync type. Updated information is stored to a media auxiliary memory of the tape cartridge in response to determining that the synchronous processing is of the index-MAM sync type.

Reduction in time required to write file to tape

An approach, for storing video data in a plurality of tape media via a ring buffer. A tape data splitter receives video data stored in a ring buffer. The tape data splitter writes the video data to a current tape media. The tape data splitter detects an end of tape media event. The tape data splitter responds to the end of tape media event, by switching the current tape media to a next tape media. The tape data splitter selects a resume point for the video data stored in the ring buffer and writes to the next tape media, the video data stored in the ring buffer that is subsequent to the resume point.

Multiple tape video data splitter

According to an aspect of the present invention, there is a method, computer program product and/or system for storing data that performs the following operations (not necessarily in the following order): (i) receiving a request to migrate a data file from primary storage to secondary storage; (ii) invoking a primary data extraction function, registered by a user, to determine primary data for the data file; and (iii) inserting the primary data into a stub file.

Storing selected data in a stub file in a hierarchical storage management system

A system according to one embodiment includes a processor and logic integrated with and/or executable by the processor. The logic is configured to cause the processor to store hierarchically-organized global configuration information for each node and each tape library resource in a storage cluster to at least one memory accessible by each node of the storage cluster. The storage cluster includes at least one tape library. Also, the logic is configured to cause the processor to migrate data to and/or recall data from a tape cartridge pool within a tape library, using the hierarchically-organized global configuration information and via a node which has access to the tape cartridge pool, in response to receiving a migration and/or recall request at any node of the storage cluster. Other systems, methods, and computer program products for management of data and resources in a tiered data storage system are described in more embodiments.

Scalable and efficient access to and management of data and resources in a tiered data storage system

In a general embodiment, a method includes storing hierarchically-organized global configuration information for each node and each tape library resource in a storage cluster to at least one memory accessible by each node of the storage cluster, the storage cluster comprising at least one tape library. The method further includes migrating and/or recalling, using the hierarchically-organized global configuration information, data to and/or from a tape cartridge pool within a tape library. The migration or recall is performed by an appropriate node of the storage cluster and in response to receiving a migration or recall request at an arbitrary node of the storage cluster.

Growing community of inventors

Kawasaki, Japan

Takeshi Ishimoto