International Business Machines Corporation

Hamid Pirahesh

David Everett Simmen

Roberta Jo Cochrane

Guy Maring Lohman

Richard Sefton Sidle

Calisto Paul Zuzarte

Kevin Scott Beyer

Ting Yu Leung

Fatma Ozcan

Yuanyuan Tian

Gary Valentin

Daniel Costante Zilio

George Lapis

Anjali Betawadkar-Norwood

Serge Philippe Rielau

Markos Zaharioudakis

Tao Zou

Biao Zhu

Kit Man Cheung

Samuel S Lightstone

Embodiments relate to joining data across a parallel database and a distributed processing system. Aspects include receiving a query on data stored in parallel database T and data stored in distributed processing system L, applying local query predicates and projection to data T to create T', and applying local query predicates and projection to L to create L&#x2032;. Based on determining that a size of L&#x2032; is less than a size of T&#x2032; and that the size of L&#x2032; is less than a first threshold, transmitting L&#x2032; to the parallel database and executing a join between T&#x2032; and L&#x2032;. Based on determining that a number of the nodes distributed processing system n multiplied by the size of T&#x2032; is less than the size of L&#x2032; and that the size of T&#x2032; is less than a second threshold; transmitting T&#x2032; to the distributed processing system and executing a join between T&#x2032; and L&#x2032;.

Joining data across a parallel database and a distributed processing system

Methods and apparatus, including computer program products, implementing and using techniques for processing a federated query in a federated database system. A federated query is received at a federated database server. A federated query execution plan is generated based on the received federated query. The federated query execution plan defines one or more source servers of the federated database and a unique subquery to be executed on each of the source servers. The subqueries are distributed to the source servers in accordance with the federated query execution plan. The respective subqueries are executed asynchronously at the source servers. The subquery results are passed to a first designated source server defined in the federated query execution plan. The subquery results are joined and aggregated at the first designated source server into a final query result. The final query result is returned to the federated database server.

Efficient processing of queries in federated database systems

A method and system for use in a computing environment for selecting a subset of records from a set of records for placement of the subset of records in a plurality of destinations. A group of replica records is formed for a record of the subset of records, and a destination identification is assigned to each replica record, except one, of the group of replica records. A replica record associated with one of the plurality of destinations can be selected and can be placed in the associated destination.

Classification of data for insertion into a database

The invention herein provides method and apparatus, including software for determining a set of materialized views or indices of the contents or a subset of the contents of a database in a data processing system to be created for one or more users of the database. The method and apparatus provide method and means for evaluating a workload presented by a user to the database; evaluating the data processing system characteristics; evaluating the database characteristics; and, using the above evaluations for recommending a set of suitable materialized views or indices to the user. Another aspect of the invention, which may be used for a workload presented by a user of a database in a data processing system, provides method and apparatus, including software for determining a set of materialized views or indices of the contents or a subset of the contents of the database, by: generating a plurality of materialized view candidates from evaluation of the workload, data processing system characteristics and database characteristics; estimating statistics for the materialized view candidates such as the number of rows, row size, and column statistics; generating a plurality of potential index candidates by evaluating the workload, data processing system characteristics, database characteristics and the materialized view candidates; and, from the materialized view candidates and index candidates selecting a set of suitable materialized views and/or indices for submission to the user.

Method for recommending indexes and materialized views for a database workload

Growing community of inventors

San Jose, CA, United States of America

Hamid Pirahesh