Ab Initio Technology LLC

Ab Initio Software Corporation

Carl Richard Feynman

Craig W Stanfill

Joel M Gould

Paul Bay

David Fournier

Ian Schechter

In one aspect, in general, a computer-implemented method includes receiving an order-dependent list of rules generating a binary decision diagram based on the order-dependent list of rules, the binary decision diagram including decision nodes that include expressions including Boolean operators and operands, and generating an order-independent list of rules based on the binary decision diagram.

Converting rules in data processing systems

Generating test data includes: reading values occurring in at least one field of multiple records from a data source; storing profile information including statistics characterizing the values; generating a model of a probability distribution for the field based on the statistics; generating multiple test data values using the generated model such that a frequency at which a given value occurs in the test data values corresponds to a probability assigned to that given value by the model; and storing a collection of test data including the test data values in a data storage system.

Generating test data

Processing data includes profiling data from a data source, including reading the data from the data source, computing summary data characterizing the data while reading the data, and storing profile information that is based on the summary data. The data is then processed from the data source. This processing includes accessing the stored profile information and processing the data according to the accessed profile information.

Data profiling

Systems and techniques are disclosed that include in one aspect a computer implemented method storing a received stream of data elements in a buffer, applying a boundary condition to the data elements stored in the buffer after receiving each individual data element of the stream of data elements, and producing one or more data elements from the buffer based on the boundary condition as an output stream of data elements sorted according to a predetermined order.

Sorting

Systems and techniques include, in some implementations, a computer implemented method storing a portion of data elements present in a first buffer in a second buffer in response to detecting an overflow condition of the first buffer, wherein the data elements in the first buffer are sorted according to a predetermined order, and inserting a proxy data element in the first buffer to represent the portion of data elements stored to the second buffer.

Managing buffer conditions through sorting

Processing data includes accepting information characterizing values of a first field in records of a first data source and information characterizing values of a second field in records of a second data source. Quantities characterizing a relationship between the first field and the second field are computed based on the accepted information. Information relating the first field and the second field is presented.

Joint field profiling

Processing data includes identifying a plurality of subsets of fields of data records of a data source, determining co-occurrence statistics for each of the plurality of subsets, and identifying one or more of the plurality of subsets as having a functional relationship among the fields of the identified subset.

Growing community of inventors

Waban, MA, United States of America

Carl Richard Feynman