International Business Machines Corporation

Sergej Schuetz

Martin Oberhofer

Albert Maier

Mike W Grasselt

Oliver Suhre

Thomas Schwarz

Stefanie Scherzinger

Hemanth Kumar Babu

Karin Steckler

Steffen Kabisch

Helmut Baumgartner

Theresa Schmitt

Christian Gaege

A computer-implemented method for managing data records subject to placement condition rules in a distributed data management system comprising a plurality of nodes. The method may include receiving, by an endpoint management component of the distributed data management system, a request for a data record. The method may also include routing, by the endpoint management component of the distributed data management system, the request to a node of the distributed data management system. The method may also include upon determining that the request is a create request, verifying, by a service component of the distributed data management system, a placement condition rule for the data record, where the placement condition rule is retrieved from a configuration component of the distributed data management system.

Multi-partitioned global data system

The present invention relates to a method for processing data quality exceptions in a data processing system, the data processing system having access to one or more data sources and having access to multiple technical support systems, the multiple technical support systems having one or more predefined technical tasks. The method comprises providing a predefined grouping rule for assigning data quality exceptions to exception groups, and associating each exception group using at least one technical task; receiving a first description of at least a first data quality exception in a data set of the first data source; using the grouping rule for assigning the first data quality exception to at least a first exception group using the first description, and for associating the first exception group with a first technical support system; routing by the exception engine at least part of the first description to the first technical support system.

Method for processing data quality exceptions in a data processing system

Reroutable data columns are identified in an ETL process by receiving an ETL process definition describing a set of processing stages and how each processing stage output data column is a result of a function that operates on a set of input data columns, representing the ETL process definition as a directed graph with nodes representing processing stages and links representing data flow between processing stages, traversing at least part of the directed graph and identifying a set of subsequent nodes of the directed graph where at least one data column is involved only as input data in identity functions, the at least one data column being reroutable between outmost nodes of the set of subsequent nodes, and in connection with traversing the at least part of the directed graph, maintaining information about reroutable data columns and the respective outmost nodes.

Identifying reroutable data columns in an ETL process

Growing community of inventors

Boblingen, Germany

Sergej Schuetz