International Business Machines Corporation

Sowmya Kameswaran

Daniel Martin

Manogari Nogi Simanjuntak

Jia Heng Zhong

Peter Bendel

Vassil Radkov Dimov

Christian Michel

Björn Broll

An embodiment for archiving data in a data analysis system. The embodiment may receive a request to archive a source partition of a source table of source database system of the data analysis system. The embodiment may determine whether the source table is partitioned into partitions by ranges of an attribute of the source table. The embodiment may, in response to determining that the source table is partitioned by range, lock the source partition to prevent changes of the source partition. The embodiment may determine whether the source partition is synchronized with a corresponding partition in the target table. In response to determining that the source partition is synchronized with the corresponding partition in the target table, the embodiment may remove data in the source partition from the source table.

Archiving a table in a data analysis system

Technology for routing queries in a system with a plurality of nodes (for example online analytical processing sub-systems) where each node has an associated replicated local database and a local latency value and replication velocity values. The workload balancing for incoming received queries among and between the plurality of nodes is based, at least in part, on consideration of latency values and/or replication velocity values for the various nodes. The best node to handle a given query is thereby selected and the query is routed to the selected node for response.

Distribution of workloads among online analytics processing systems

Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: receiving by primary database system a query statement that references a first table, wherein the primary database system is associated to a first accelerator database system and a second accelerator database system, wherein modifications performed on tables of the primary database system are iteratively replicated into the first accelerator database system and the second accelerator database system; examining latency data that specifies a latency with which a modification to the first table has been replicated into the first accelerator database system and a latency with which a modification to the first table has been replicated into the second accelerator database system; selecting, in dependence on the examining, the first accelerator database system for execution of the query statement; routing the query statement to the first accelerator database system for execution in response to the selecting.

Reduced latency query processing

A computer-implemented method, system, and non-transitory computer program product for work assignment for parallelized database synchronization. Data changes to a source database are identified from a change log for the source database. The data changes are batched into data change chunks of data changes. An estimated processing cost for processing of each of the data change chunks to apply the data changes in the data change chunks to a target database is determined. A priority queue in which the data change chunks are identified in order of estimated processing cost is generated. Each data change chunk identified in the priority queue is assigned to a processing thread in a plurality of processing threads for processing in order by estimated processing cost from higher estimated processing cost to lower estimated processing cost to apply the data changes in the data change chunks to the target database.

Work assignment in parallelized database synchronization

A method, system, and program product for enabling multiple source database coherency is provided. The method includes detecting an incoming query to be executed with respect to an accelerator server. An initial timestamp of the incoming query is analyzed and additional timestamps of database tables referenced by the incoming query are retrieved. It is determined that each timestamp of the additional timestamps is reached with respect to a corresponding replication engine and target data from the database tables is synchronized with source data of a source database. In response, the incoming query is accelerated for execution with respect to a target database management system.

Multiple source database system consolidation

Loading a set of data into a target database management system (DBMS) from a source DBMS to increase workload performance and decrease resource usage is provided. Using a size and a change rate of tables eligible to be offloaded to the target DBMS, a total central processor unit (CPU) cost corresponding to loading the set of data into to the target DBMS and workload cost savings corresponding to executing one or more workloads on the target DBMS is determined based on a set of one or more load strategies. The total CPU cost is compared with the workload cost savings of each load strategy. An optimal load strategy is selected based on comparing the total CPU cost with the workload cost savings of each load strategy. The set of data is automatically loaded into to the target DBMS from the source DBMS in accordance with the selected optimal load strategy.

Growing community of inventors

San Jose, CA, United States of America

Sowmya Kameswaran