Business Objects Software Limited

Sap Se

Sap France S.a.

David Kung

Min He

Suryanarayana Mangipudi

Wu Cao

Anil Samudrala

Nancy Yan

Hui Xu

Balaji Gadhiraju

Monfor Yee

Hemant Puranik

Kurinchi Kumaran

Frank Le

Abhiram Gujjewar

Hongfan Qian

Mengdan Ma

Hiren Kotadia

Marc Maillart

Aun-Khuan Tan

Systems and methods for just-in-time data quality assessment of best records created during data migration are disclosed. A data steward includes tools for creating and editing a best record creation strategy that defines how records from multiple systems will be integrated into target systems. At design time, the data steward can generate best record creation and validation rules based on the best record creation strategy. The data steward can apply the best record creation and validation rules to a sample of matched records from multiple data sources to generate a sample set of best records. The efficacy of the best record creation rules can be evaluated by assessing the number of fields in the sample set that fail the validation rules. During review, the validation rules can be applied to edits to the best records received from a human reviewer to ensure compliance with the best record creation strategy.

Just-in-time data quality assessment for best record creation

A method and system are presented of automatically suggesting rules for data stored in a table, with the table comprising a plurality of columns. The table is profiled to identify a content type for each of one or more of the plurality of columns. A rule knowledge base is accessed to locate rules specified for identified content types. Then, one or more of the located rules specified for identified content types are presented as suggestions. Acceptance of one or more of the suggested rules is received from a user, and the received validations are stored in the rule knowledge base. The accepted rules are applied to data for quality detection and monitoring. Embodiments are also described where columns are suggested based on a given rule.

System and method for automatically suggesting rules for data stored in a table

According to some embodiments, a method and an apparatus of enriching search results with metadata are provided to receive a plurality of metadata associated with an entity and storing the plurality of metadata in a repository. A search request associated with the entity is received and search results that comprise a portion of the plurality of metadata stored in the repository are determined.

Metadata search based on semantics

In an example embodiment, a method of automatically generating data validation rules from data stored in a column of a table is provided. Outliers for the data are determined by analyzing a profiling statistic for the data, the profiling statistic having a type. Then it is determined if a predefined limit is exceeded, based on a quantity of the outliers determined for the data through the analysis of the profiling statistic. A data validation rule is then automatically generated based on non-outliers detected in the data through the analysis of the profiling statistic, the generated data validation rule also being based on the type of the profiling statistic. The data validation rule can then be applied to data subsequently entered for the column, causing at least a portion of the data subsequently entered for the column to be rejected.

Automatic rule generation

Various embodiments of systems and methods for evaluating a trust value for a report are disclosed herein. The method includes obtaining one or more reports by the computer, where the reports are formed of one or more fields of data. An end-to-end lineage for the data is determined to trace the data back to the data source system from which the data had originated initially. Further, the method includes validating each of the multiple data source systems including intermediate tables, and determining a data quality score for each of the multiple data source systems. A trust value for the report is calculated based on the data quality scores for the one or more data source systems and intermediate tables, and rendered along with the report.

Evaluating a trust value of a data report from a data processing tool

A computer readable storage medium includes executable instructions to assess system cache resources, inter-process communication requirements and staging requirements to divide an extract, transform, load (ETL) dataflow task into a plurality of sub-tasks. The sub-tasks are then executed in parallel on distributed resources.

Apparatus and method for dataflow execution in a distributed environment using directed acyclic graph and prioritization of sub-dataflow tasks

Growing community of inventors

Cupertino, CA, United States of America

David Kung