International Business Machines Corporation

Cheng Ding

Yong Sen Zheng

Jin Cheng

Zhiyong Tian

Lin Feng Shen

Zheng Cai Yuan

Wei Gong

Shuo Feng

A pinned memory space for caching data can be provided in a data node. The data that is cached in the pinned memory space can be prevented from being swapped out. A virtual address can be assigned to the data. The virtual address can be mapped to a memory address of the data in the pinned memory space for accessing the data by an application. A first command can be received from the application for caching the data. The first command can indicate an attribute associated with the caching of the data. Responsive to receiving the first command from the application for caching the data, the data associated with the first command can be cached by storing the attribute in association with the data in the pinned memory space.

Unified in-memory cache

Embodiments of the present disclosure relate to IO initiator aware data migration. A set of statistical metrics for a replica of a data block on a first node of a plurality of nodes is obtained. The first set of statistical metrics is associated with read operations on the replica. The read operations are operations initiated by a second node of the plurality of nodes. If it is determined that a first statistical metric in the set of statistical metrics exceeds a predefined threshold, the replica is migrated from the first node to the second node.

Initiator aware data migration

An approach, for fileset based data locality management in Distributed File Systems. A data locality manager receives fileset identifiers and associated block allocation information, for storing in data block locality tables. The data locality manager determines data block locality factors based on the fileset identifiers and the block allocation information, creating a collection of the data block locality factors. The data locality manager stores the collection of the data block locality factors in the data block locality tables. The data locality manager receives the fileset identifiers for determining the collection of the data block locality factors associated to the fileset identifiers and outputs the collection of the data block locality factors.

Fileset-based data locality enablement in distributed file systems

In-memory caching can include providing, in a data node, a pinned memory space for caching data in a distributed file system. The data that is cached in the pinned memory space is prevented from being swapped out. A virtual address is assigned to the data. The virtual address is mapped to a memory address of the data in the pinned memory space for accessing the data by an application.

Growing community of inventors

Beijing, China

Cheng Ding