International Business Machines Corporation

James L Finnie

Andreas Brodt

Knut Stolze

Oliver Schiller

Thomas F Boehme

Richard Sefton Sidle

Adam J Storm

Sam Sampson Lightstone

Oliver Koeth

Sunil Sarin

Gordon Andrew Booman

Mathias Trumpp

Michael Wurst

Torsten Steinbach

Marc Schwind

Toni Bollinger

Tobias Kevin Fränzel

Thomas Friedhelm Böhme

Ingo Schuster

Wieland Philipp Hoffmann

A method, a computer program product, and a system for scheduling a first query execution plan for executing a first query for accessing first data sets of data of a relational database system (RDBS) and a second query execution plan for executing a second query for accessing second data sets of the data. The data is divided into data blocks of data sets of the data, wherein metadata of the RDBS comprises respective information about at least one property of the data sets of a respective data block of the data blocks. The scheduling may be performed on the basis of an examination if there is a common partition between a first partition of data blocks which may fulfill a first condition according to the first query and a second partition of data blocks which may fulfill a second condition according to the second query.

Scheduling query execution plans on a relational database

Aspects of the invention include techniques for providing a query and data adaptive synopsis table. A non-limiting example method includes building a first synopsis table containing metadata for a database table. Information from queries executed against the database table is collected. The collected information is analyzed, responsive to a number of queries executed against the database table exceeding a query collection threshold, to identify one or more queries for which the first synopsis table was suboptimal. The method includes building, for each of the one or more queries for which the first synopsis table was suboptimal, a second synopsis table.

Query and data adaptive synopsis table

In updating a synopsis table of a database system, a database management unit performs a transaction to insert row(s) in a section of the base table and determines whether a synopsis entry for the section is stored in the memory. If stored in the memory, the in-memory synopsis entry is retrieved and metadata values in the in-memory synopsis entry are updated with data from the row(s) to be inserted. If not stored in the memory, the in-memory synopsis entry is generated and the metadata values in the in-memory synopsis entry are updated with data from the row(s). The insert transaction is then committed. Synopsis entry on-disk updates are thus avoided, significantly reducing the cost of updating the synopsis entries from the insert transaction. This yields enhanced performance especially for inserts of a small number of rows, while the benefits of synopsis entries are still available.

Updating of in-memory synopsis metadata for inserts in database table

Reorganizing a data table to improve analytical database performance. Attribute value information for data blocks of the data table is determined. One or more queries having respective query predicates involving the attribute may be received and processed. Data blocks having attribute value information matching a query predicate are selected. The selected data blocks are evaluated for the query predicate of the query. For each part of a set of the parts a false positive rate may be determined. The false positive rate may indicate the fraction of data blocks of the selected data blocks of the part, that each contains less than a determined maximum number of rows that satisfy the query predicate. In response to determining the false positive rate, determining a subset of parts including the sorted part that fit into a level of granularity higher than the selected level of granularity and sorting the subset of parts.

Reorganizing a data table to improve analytical database performance

The present disclosure relates to a method for processing data blocks of a data table. The data blocks comprise an attribute representing multidimensional spatial data objects, where the attribute has multiple values representing respective dimensions of the multidimensional spatial data object. The method comprises creating for each data block of the data blocks, a respective attribute metadata. The attribute metadata comprises attribute value information defining a multidimensional minimum bounding rectangle that covers attribute values of the attribute comprised in the data block. A query is processed on the multidimensional spatial data objects associated with a query area using the multidimensional minimum bounding rectangle to check whether a data block of the data blocks contains attribute values of the attribute in the query area.

Efficient spatial queries in large data tables

In an approach to storing data elements in a database, a database management unit provides a table-mapping file for enabling access to a table of a plurality of tables in a storage medium, the table-mapping file comprising a plurality of map records of a single table, a map record comprising information indicative of the table, a column of the table, a data section of the table, and a range of values of data elements included in the data section of the column. The unit receives a data element at the database via a communication interface, determines the table, column, and data section the data element is to be stored in, and stores the data element in the section file corresponding to the determined table, column and data section. The unit then updates the table-mapping file corresponding to the table, columns and data section the data element has been stored in.

Method for storing data elements in a database

Reorganizing a data table to improve analytical database performance is presented. Attribute value information for data blocks of the data table is determined. One or more queries having respective query predicates involving the attribute may be received and processed. Data blocks having attribute value information matching a query predicate are selected. The selected data blocks are evaluated for the query predicate of the query. For each part of a set of the parts a false positive rate may be determined. The false positive rate may indicate the fraction of data blocks of the selected data blocks of the part, that each contains less than a determined maximum number of rows that satisfy the query predicate. In response to determining for each part of the set of the parts that the determined false positive rates of the part meet a predefined condition sorting the part by the attribute.

The present disclosure relates to a method for processing a data table. The data table is divided into a plurality of data blocks, and a multidimensional data structure for representing the plurality of data blocks is generated. For each data block of at least part of the plurality of data blocks, a respective data element is added into the multidimensional data structure. The data element has multiple values indicative of a first attribute of the data block. The multidimensional data structure is stored for selectively processing a portion of the data blocks using the multidimensional data structure.

Processing large data tables

The method may include providing, in accordance with a column-oriented storage technique, the data table as columns corresponding to the plurality of attributes, whereby each column includes a plurality of separate data blocks. The method may also include determining the plurality of records of the provided data table for which a plurality of attribute values of at least one selected column is contained in a plurality of predetermined data blocks. The method may further include determining, for each column of at least a part of the plurality of columns within the determined plurality of records, a plurality of attribute value information descriptive of an associated attribute within the column and providing an indication of the one or more data blocks for which the plurality of attribute value information is determined. The method may also include storing the determined plurality of attribute value information for enabling query processing.

Growing community of inventors

Boeblingen, Germany

James L Finnie