International Business Machines Corporation

Rares Vernica

Kevin Scott Beyer

Andrey Balmin

Vuk Ercegovac

Described herein are methods, systems, apparatuses and products for adaptive parallel data processing. An aspect provides providing a map phase in which at least one map function is applied in parallel on different partitions of input data at different mappers in a parallel data processing system; providing a communication channel between mappers using a distributed meta-data store, wherein said map phase comprises mapper data processing adapted responsive to communication with said distributed meta-data store; and providing data accessible by at least one reduce phase node in which at least one reduce function is applied. Other embodiments are disclosed.

Growing community of inventors

Irvine, CA, United States of America

Rares Vernica