International Business Machines Corporation

Scott J McCallen

Douglas S Meil

Timothy M Fox

Kaveh Noorbakhsh

Matthew J Wollerman, Ii

Christopher L Crabtree

Anyi Li

Maxwell T Hallum

Patrick Sullivan

In one embodiment, a system transfers data between source and target systems. The system receives a module including procedural logic for transforming source data of a source data model to a target data model to produce one or more target data objects for the target data model. The procedural logic is expressed by one or more elements of a domain specific language implemented by an underlying computer language. The one or more elements define mappings and structure for the one or more target data objects. The module is executed to produce the one or more target data objects for loading in the target system in accordance with the mappings and structure defined within the procedural logic by the one or more elements. Embodiments of the present invention further include a method and computer program product for transferring data between source and target systems in substantially the same manner described above.

Transforming and loading data from a source data system to a target data system

A method, a processing device and a computer program product are provided. Based on parameters pertaining to a data source, a first processing device may determine whether a data source is a known data source. If the data source is determined to be the known data source, then the first processing device sends respective configuration information to multiple processing devices. The respective configuration information being based on configuration information from a previous integration and configuring the multiple processing devices as an operational data pipeline to extract data from the known data source, transform the extracted data to a first data model employed by a data system, and load the transformed data into the data system.

Automating configuration of operational data pipelines for extraction, transformation and load

A system processes streaming data and includes at least one processor. The system may write streaming data received from a data source as messages in queues at a queuing cluster. The queuing cluster includes a coordinator node to direct the messages to non-coordinator nodes of the queuing cluster. The system may retrieve the data from the queues based on subscription of topics and store the retrieved data in a consumable repository.

Scalable event stream data processing using a messaging system

Growing community of inventors

Stow, OH, United States of America

Scott J McCallen