International Business Machines Corporation

Xiaoqiao Meng

Li Feng Zhang

Jian Tan

Parijat Dube

Michel H T Hack

Xavier Rene Guerin

Yandong Wang

Shicong Meng

Yuqing Gao

Wei Tan

Ankur Gupta

Tiia J Salo

Steven E Froehlich

Timothy P Ellison

Sreedhar B Kodali

Sivasakthi Thirugnanapandi

Neil G M Richards

Zhenhua Hu

Seetharami R Seelam

Yonggang Hu

Alicia Elena Chin

Michel Hack

Liana Liyow Fong

Michael H Dawson

Canturk Isci

John Michael Tracey

Graeme Johnson

David P Olshefski

Zhe Zhang

Megumi Ito

Yang Lei

Yanbin Liu

Guohui Wang

Pramod B Nagaraja

Nai K Ling

Xiao Yu

Alper Buyuktosunoglu

Pradip Bose

Douglas Morgan Freimuth

Vasileios Pappas

Jeffrey Owen Kephart

Peter Hans Westerink

Paolo Dettori

Ruhi Sarikaya

Michael Feiman

Jeff Kephart

Methods, systems and computer program products for data fetching in a networked computing environment. In one embodiment, the method comprises receiving a request from an analytical node for a set of data for a defined job, and identifying in networked storage a subset of the data for the job. The subset of data is loaded to the analytical node based on the sequence in which the data are projected to be accessed in the job. In an embodiment, the request includes a specification for the job, and the specification is analyzed to identify the subset of data. In one embodiment, the subset of data is identified by identifying another job having a relationship to the defined job, and identifying the data used for that other job. In an embodiment, the networked computing environment is a cloud computing environment, and the defined job is an analytics job.

Adaptive data fetching from network storage

In an approach for managing network sockets, a computer receives a request to create a network socket to transfer data. The computer identifies information associated with the received request, including one or more of: a default network protocol, one or more supported network protocols, ahead of time initialization, a data transfer policy, a failure policy, and a security policy. The computer creates a second level hash map based on the identified information, wherein the second level hash map includes the supported network socket protocols and a connection state. The computer determines a network protocol to utilize associated with the received request. The computer establishes a connection for the network socket over the determined network protocol.

Managing network sockets

Various embodiments manage dynamic memory allocation data. In one embodiment, a set of memory allocation metadata is extracted from a memory heap space. Process dependent information and process independent information is identified from the set of memory allocation metadata based on the set of memory allocation metadata being extracted. The process dependent information and the process independent information at least identify a set of virtual memory addresses available in the memory heap space and a set of virtual memory addresses allocated to a process associated with the memory heap space. A set of allocation data associated with the memory heap space is stored in a persistent storage based on the process dependent information and the process independent information having been identified. The set of allocation data includes the process independent allocation information and a starting address associated with the memory heap space.

Restorable memory allocator

A method, system and computer program product for remote direct memory access (RDMA) optimized producer-consumer message processing in a messaging hub is provided. The method includes initializing a shared memory region in memory of a host server hosting operation of a messaging hub. The initialization provides for a control portion and one or more data portions, the control portion storing an index to an available one of the data portions. The method also includes transmitting to a message producer an address of the shared memory region and receiving a message in one of the data portions of the shared memory region from the message producer by way of an RDMA write operation on a network interface of the host server. Finally, the method includes retrieving the message from the one of the data portions and processing the message in the messaging hub in response to the receipt of the message.

Remote direct memory access (RDMA) high performance producer-consumer message processing

A method to share remote DMA (RDMA) pointers to a key-value store among a plurality of clients. The method allocates a shared memory and accesses the key-value store with a key from a client and receives an information from the key-value store. The method further generates a RDMA pointer from the information, maps the key to a location in the shared memory, and generates a RDMA pointer record at the location. The method further stores the RDMA pointer and the key in the RDMA pointer record and shares the RDMA pointer record among the plurality of clients.

Efficient remote pointer sharing for enhanced access to key-value stores

Embodiments relate to methods, systems and computer program products for cache management in a Remote Direct Memory Access (RDMA) data store. Aspects include receiving a request from a remote computer to access a data item stored in the RDMA data store and creating a lease including a local expiration time for the data item. Aspects further include creating a remote pointer to the data item, wherein the remote pointer includes a remote expiration time and transmitting the remote pointer to the remote computer, wherein the lease is an agreement that that the remote computer can perform RDMA reads on the data item until the remote expiration time.

Cache management for RDMA data stores

Methods and arrangements for assembling tasks in a progressive queue. At least one job is received, each job comprising a dependee set of tasks and a depender set of at least one task. The dependee tasks are assembled in a progressive queue for execution, and the dependee tasks are executed. Other variants and embodiments are broadly contemplated herein.

Interleave-scheduling of correlated tasks and backfill-scheduling of depender tasks into a slot of dependee tasks

Growing community of inventors

Yorktown Heights, NY, United States of America

Xiaoqiao Meng