International Business Machines Corporation

Tao Zou

Fatma Ozcan

Yuanyuan Tian

Hamid Pirahesh

Embodiments relate to joining data across a parallel database and a distributed processing system. Aspects include receiving a query on data stored in parallel database T and data stored in distributed processing system L, applying local query predicates and projection to data T to create T', and applying local query predicates and projection to L to create L&#x2032;. Based on determining that a size of L&#x2032; is less than a size of T&#x2032; and that the size of L&#x2032; is less than a first threshold, transmitting L&#x2032; to the parallel database and executing a join between T&#x2032; and L&#x2032;. Based on determining that a number of the nodes distributed processing system n multiplied by the size of T&#x2032; is less than the size of L&#x2032; and that the size of T&#x2032; is less than a second threshold; transmitting T&#x2032; to the distributed processing system and executing a join between T&#x2032; and L&#x2032;.

Growing community of inventors

Ithaca, NY, United States of America

Tao Zou