Yahoo! Inc.

Jagannatha Narayanareddy

Long-ji Lin

Jagdish Chand

Peiji Chen

Suresh Antony

Avanti Nadgir

Rajesh Bhargava

In an embodiment of the present invention, a record is read a single time, and it is evaluated against all conditions to identify the ones that it satisfies. By organizing the conditions into appropriate data structures, the process may be further optimized by ensuring that the record is not scanned multiple times.

Extraction of logical events from network data

Data quality measurement is provided for use in a data processing stream, which comprises at least one upstream data processing system and at least one downstream data processing system. An input alert component can be used to provide a measurement of data prior to its input to a data processing system (e.g., a downstream data processing system or an upstream data processing system). An output alert component can be used to provide a measurement on data output by a data processing system. A self-consistency component can be used to measure consistency between items of input, or output data. An end-to-end component can be used to measure data quality using data items from both input data and output data. These components can be used in some combination, or independent of the other, and in any order. In addition, the data quality measurements can be performed separate from that processing performed by either the upstream or downstream processing system.

Method and system of measuring data quality

Growing community of inventors

San Jose, CA, United States of America

Jagannatha Narayanareddy