International Business Machines Corporation

Christian Zentgraf

Serge Bourbonnais

Xiao Li

Jonathan W Wierenga

Austin F M D'Costa

Hong Min

Gong Su

Yat On Lau

Kan Zhang

Austin D'costa

Knut Stolze

Xin Wu

Marion Else Behnen

David M Mooney

Benno Staebler

Roger L Zheng

Xiang Wei Zhou

Roger Zheng

David Mooney

Pooja Bhandari

A method, system and computer program product is provided. The method includes identifying a large statement, writing rows that are changed by the large statement into a set of files outside a database management system recovery log, and writing log records for the set of files to the database management system recovery log, such that the log records provide ordering of row changes made by the large statement. The log records include a log sequence number corresponding to a first row changed and a format and encoding used for the row changes. The method further includes streaming, by the one or more processors of the computer system, the set of files out-of-band by a replication capture process to a target database management system.

Replicating large statements with low latency

A method, system, and program product for implementing an automated query filtering process for spatial data is provided. The method includes selecting a set of common depth levels for geohash structures. Data indicating results of the selection is stored and a specified depth level of the set of common geohash depth levels is selected. The selected geohash depth level is associated with a spatial column for spatial data to determine a set of geohash depth levels required to generate geohash values. A filter table or index associated with the spatial column is generated based on the selected subset of common geohash depth levels and a relationship between the spatial column, the specified geohash depth level and the filter table is stored within a database. Geohash values for the filter table are generated and a query of the database is executed with respect to the specified geohash depth level, the filter entries, and the filter table.

Automated database query filtering for spatial joins

Transaction consistency query support is available for replicated data from recovery log to external data stores. An external data store is populated with records using entries of a change data table. The change data table has entries for each transaction that has committed and is to be replicated, and each of the entries stores information for each log entry in a recovery log from a database management system. Each log entry identifies a transactional change of data and a transaction completion indicator of one of commit and abort. In response to receiving a query about a transaction of the transactions, a set of records are retrieved from the external data store for the transaction. From the set of records, records whose sequence identifier values are larger than a maximum transaction commit sequence identifier are removed. From the set of records, remaining records having transaction consistency are returned.

Transaction consistency query support for replicated data from recovery log to external data stores

A method, system and computer program product is provided. The method includes identifying a large statement, writing the rows that are changed by the large statement into a set of files outside a database management system recovery log, and writing log records for the set of files to the database management system recovery log, such that the log records provide ordering of row changes made by the large statement. The log records include a log sequence number corresponding to a first row changed and a format and encoding used for the row changes. The method further includes streaming, by the one or more processors of the computer system, the set of files out-of-band by a replication capture process to a target database management system.

Several replication subscriptions are defined for a table in a database management system. The table is divided into partitions. Each replication subscription replicates transactions to a range of partitions. Subscriptions are assignable to different consistency groups. Transaction consistency is preserved at the consistency group level. A persistent delay table is created for each of several apply functions. Each apply function processes replication subscriptions for one consistency group, to replicate the table to a target table in parallel. Transactions for a given range of a partition are executed in parallel. When an apply function upon a row of the target table results in an error, the row is stored in the delay table. Application of each row in the delay table is repeatedly retried, and if successful, the row is removed from the delay table.

Parallel replication of data table partition

Provided are techniques for replicating relational transactional log data to a big data platform. Change records contained in change data tables are fetched. A relational change history with transaction snapshot consistency is rebuilt to generate consistent change records by joining the change data tables and a unit of work table based on a commit sequence identifier. The consistent change records are stored on the big data platform, and queries are answered on the big data platform using the consistent change records.

Recovery log analytics with a big data management platform

A method, system, and computer program product for transaction-controlled graph processing and management are provided. The method includes notifying an external component of a database management system (DBMS) controlled transaction including multiple operations, and acquiring a DBMS transaction identifier associated with the transaction at the external component. The method further includes storing the DBMS transaction identifier as an external component transaction identifier, and receiving notification at the external component of events associated with the operations. The method additionally includes monitoring the events for an end-of-transaction operation, and passing notification of the end-of-transaction operation to an external routine.

Growing community of inventors

Columbus, OH, United States of America

Christian Zentgraf