Oracle International Corporation

John K Rees

Michael D Grossman

Ludmila Kozina

Rohit Chaturvedi

Abhishek Narayan

Systems, methods, and other embodiments associated with a unit of work for incremental data processing are described. In one embodiment, a method includes selecting a unit of work key for a program that processes records in a source table. The unit of work key is selected such that modifications to a record having a certain unit of work key value will not affect the program's processing of records having a different unit of work key value. The selected unit of work key is associated with the program. When a record in the source table is created, modified, or deleted, a unit of work key value is identified for the record and a selected set of records having the identified unit of work key value is provided to the program. Thus, records in the data source that do not have the identified unit of work key values are not provided to the program.

Unit of work based incremental data processing

A data lineage system is provided that traces a data lineage of a data warehouse. The data lineage system maps a target data element to one or more source data elements. The data lineage system further stores one or more source surrogate keys within one or more auxiliary columns of a target data record. The data lineage system further stores, for each source data element, a data lineage mapping system record within a data lineage mapping system table that represents the mapping of the target data element and the corresponding source data element. The data lineage system further maps a source data element to one or more target data elements. The system further stores, for each target data element, a shadow system record within a shadow system table that represents the mapping of the source data element and the corresponding target data element.

Data lineage system

An associated information system is provided that propagates visibility of associated information. The associated information system traces a data lineage of a data warehouse. The associated information system further identifies an association between a primary data element and an associated object, where the association between the primary data element and the associated object is identified as a primary link. The associated information system further stores a first associated object mapping system record within an associated object mapping system table that represents the primary link. The associated information system further identifies an association between a secondary data element and the associated object using the data lineage, where the association between the secondary data element and the associated object is identified as a secondary link, and where the secondary data element is related to the primary data element within the data lineage. The associated information system further stores a second associated object mapping record within the associated object mapping system table that represents the secondary link.

Associated information propagation system

A method and system for definition control in a data repository application. Each structure for the repository application is defined. Each structure and a corresponding definition for the structure are stored in a library. An object is created for each structure stored in the library that points to the definition. The structures are interconnected as the application is built. The repository application is built for a specific use includes each of the interconnected structures and provides automatic tracking of each use of each definition and automatic cascading of definition changes to each use.

Method and system for definition control in a data repository application

A method and system for determining currency of data in a data processing system. The processing steps along a dependency chain used to populate a data reporting program are back tracked recursively through each processing step until a first originating set of processing steps are reached. The currency of each data source for the programs is identified and it is determined whether the program has run since that time. If any one of the sources for the program of the processing step is more recent than a last run time of the program associated with the processing step, the program is re-run and outputs updated. The same process is executed moving forward along the dependency chain, to each other processing step.

Growing community of inventors

Brookline, MA, United States of America

John K Rees