International Business Machines Corporation

Ronen Grosman

Adam J Storm

Vijayshankar Raman

Ronald Jason Barber

Christian Marcelo Garcia-Arellano

Matthew Albert Huras

Richard Sefton Sidle

Pinar Tozun

Mir Hamid Pirahesh

Xun Xue

Aamer U Sachedina

Keriley Kay Romanufa

Bret Ronald Olszewski

Ann Corrao

Yuanyuan Tian

Carlos D Cavanna

Hamdi Roumani

Ao Wan

Robert Francis

Guy Maring Lohman

Rene Mueller

Gary Valentin

Gustavo Arocena

David Arlen Elko

Chandrasekaran Mohan

Garret Frederick Swart

Roger C Raphael

Vaijayanthimala K Anand

Timothy Ray Malkemus

Paul Sherwood Taylor

Scott David Lashley

Daniele Costante Zilio

Sunil Sarin

Roger L Q Zheng

Yang Lei

Teresa Chung Kan

Kevin Leo Beck

Michael E Lyons

James Liam Finnie

Stewart L Palmer

Chen Luo

Paul Michael Brett

Matthew J Spilchen

Kelly W Schlamb

Nickolay V Tchervenski

Adrian Chan

An approach is provided in which the approach receives a query request to execute a query. The approach provides multiple query execution options based on multiple hardware configurations. The multiple query execution options include multiple execution times and multiple execution costs. The approach receives a selection that selects at least one of the query execution options and, in turn, executes the query on at least one of the hardware configurations based on the received selection.

Providing multi-tier query execution options in a serverless query environment

One embodiment provides for a method to track replication state and providing quorum visible retrievals. The method includes assigning, by a writer node performing write operations, a sequence number. The sequence number is replicated with a write operation to other replica nodes in an asynchronous fashion thru a first network channel. On a second network channel, a state of a local system is communicated by sending a latest sequence number available that has been hardened to the other replica nodes. A query is obtained by a reader node, and a sequence number limit is selected. Results up to the sequence number limit are returned.

Tracking data availability using heartbeats

One embodiment provides for a method including performing, by a processing thread, a process that analyzes transactional operations by maintaining the transactional operations in transaction local side logs, and waiting until a successful transaction commit to append the transaction local side logs to a log stream. The processing thread processes the transactional operations on a key used to determine whether existing data is found for the key. The transactional operations are sped up through parallelism based on partitioning tables across nodes handling the transactional operations. A first process is performed by a first processor that processes updates for values of a key based on updating a first start time table index using unique keys and a start time field of a row for a first appearance of each unique key from the transactional operations.

Resolving versions in an append-only large-scale data store in distributed data management systems

One embodiment provides for monotonic transactions in a multi-master database with loosely coupled nodes including performing, by a processor, a read transaction protocol including: performing, by the processor, a read transaction protocol including issuing read transactions at any one of the nodes; attempting to return rows that are known to be replicated by at least a read quorum of the nodes; and for timing-out of the attempting to return rows known to be replicated by at least the read quorum of the nodes based on the special-node being non-responsive: selecting a new special-node from the nodes; and repeating attempting to return rows that are known to be replicated by at least the read quorum of the nodes.

Monotonic transactions in a multi-master database with loosely coupled nodes

According to one or more embodiments of the present invention, a computer-implemented method includes creating a hybrid index for a multi-zone data storage system in which a first zone has data that is organized for transaction processing, and a second zone that has data organized for analytic processing. Each index entry in the hybrid index includes an index key including an equality column, a begin-timestamp column, and a tuple-sequence-number column. The method further includes building an index run to be included in the hybrid index, the index run includes multiple index entries. An index run is created by selecting columns by scanning data blocks from the first zone, computing tuple-sequence-number values for the index entries to be included in the hybrid index, and sorting the index entries according to a predetermined order using the columns to be included in the index run.

Indexing for evolving large-scale datasets in multi-master hybrid transactional and analytical processing systems

Reducing data access resources by creating a scoring mechanism for computing a running score for data objects in a database having an associated score value in order to determine whether or not a set of data object(s) should remain in a caching gateway or whether or not the set of data object(s) should be removed from the caching gateway.

Reducing data access resources in a serverless computing environment using caching

A request for changing data of a file system data structure stored on a shingled magnetic recording (SMR) drive is received. The data change is logged in a log entry of a log structure stored in a non-volatile random access memory (NVRAM). The log entry is added as a new entry at an end of the log structure. The log entry is marked within the NVRAM as modified and a predetermined criterion is determined to be satisfied. Responsive to determining that the predetermined criterion is satisfied, the NVRAM is searched for log entries marked as modified. The modified log entries are stored to the SMR drive.

Shingled magnetic recording drive mapping using nonvolatile random access memory for persistent updates

Optimizing database table scans in presence of SMDO records is provided. An SMDO record corresponding to a most recent span of rows for a column associated with a query predicate is read. It is determined whether a condition for excluding a span of rows is true for the SMDO record based on a type of the query predicate. In response to determining that a condition for excluding a span of rows is not true for the SMDO record, the most recent span of rows is added to a list of spans of rows to scan. It is determined whether a condition for excluding all preceding spans of rows is true for the SMDO record based on the type of the query predicate. In response to determining that a condition for excluding all preceding spans of rows is true for the SMDO record, reading the set of SMDO records is stopped.

Optimizing database table scans in the presence of ordered data

One embodiment provides for a method for grooming transactional operations in a multi-master distributed data management system including maintaining transactional operations in at least one transaction-local side-log. A table log scan is performed for a table including recording identification for each record in a log. Tuple sequence numbers are generated for the records and the records are written on groomed transaction blocks to the table.

Transactional operations in multi-master distributed data management systems

One embodiment provides for a method including processing transactional operations on a key used to determine whether existing data is found for that key. A first time index is updated using unique keys and a start time field of a first appearance of each key from the transactional operations. A deferred update of prior versions of the key is performed for non-recent data upon determining that recent data in the transactional operations is found for the key.

One embodiment provides for monotonic transactions in a multi-master database with loosely coupled nodes including performing, by a processor, a write transaction protocol including: a client device issuing write transactions at any of the nodes, recording a write transaction locally at a node that issues a write transaction and asynchronously replicating the write transaction to at least one other node, and waiting for reception of an acknowledgment from at least a quorum of the nodes before returning a response to the client device. The quorum is any set of the nodes that includes a special node and at least one other node.

One embodiment provides for a method for grooming transactional operations in a multi-master distributed data management system including maintaining transactional operations in at least one transaction-local side-log. A table log scan is performed for a table including recording identification for each record in a log. Each column in the table is loaded with column values based on the identifications. Records based on the column values are written to the groomed transaction blocks that are table based, and the tuple sequence numbers for each record on groomed blocks are generated. The table is shared/sharded across nodes handling transactional operations in the multi-master distributed data management system to increase processing handling of the transactional operations.

Shingled magnetic recording drive mapping using non-volatile random access memory for persistent updates

Technology for applying locks to memory pages. More specifically, a sticky lock is chosen by matching observed usage patterns with predetermined patterns associated with various sticky locks and/or types of stick locks increase database performance by reducing required communications and information transfers.

Increase database performance by reducing required communications and information transfers

Growing community of inventors

Thornhill, Canada

Ronen Grosman