International Business Machines Corporation

Kalyanji Chintakayala

Krishna Kishore Bonagiri

Eric Allen Jacobson

Ritesh Kumar Gupta

Juan M George

Improving allocation of network resources by receiving node names for resource allocation, checking a bookmark file of bad nodes for the received node names, selecting good nodes from the received nodes for command execution, sending commands to selected good nodes, identifying bad nodes during command execution; and adding the identified bad nodes to the bookmark file.

Resource allocation for data integration

Disclosed aspects relate to data integration application execution management using both a set of managed nodes and a set of unmanaged nodes. An execution request for a data integration application may be sensed. A first set of commands of the data integration application may be assigned to the set of managed nodes. A second set of commands of the data integration application may be assigned to the set of unmanaged nodes. Execution of the data integration application may be initiated using the set of managed nodes to process the first set of commands and the set of unmanaged nodes to process the second set of commands.

Data integration application execution management

Performing an extract, transform, and load (ETL) process. Column data is received by a stage of the ETL process. The size of the received column data is ascertained by the stage. In response to determining that the size of the column data exceeds a predefined threshold, the stage saves the column data and creates a data locator associated with the column data. The created data locator advances through successive downstream stages of the ETL process as a replacement for the column data.

Shipping of data through ETL stages

Shipping of data though ETL stages

Insertion, in a data warehouse process, of a buffer operator between an upstream data operator and a downstream data operator. The processor processes a data record for the upstream data operator to pass to the downstream data operator. In response to determining that the downstream data operator is not ready to accept the data record from the upstream data operator, a buffer operator is inserted between the upstream data operator and the downstream data operator. The data record processed by the upstream data operator is passed to the buffer operator for storing into a buffer allocated for use by the buffer operator. The data record stored into the buffer is passed to the downstream data operator when the downstream data operator is ready to accept data. In another aspect, when the allocated buffer utilization decreases to a threshold value, the buffer operator is removed and the buffers are released.

Growing community of inventors

Hyderabad Telangana, India

Kalyanji Chintakayala