International Business Machines Corporation

Initiate Systems, Inc.

Scott Ellard

Scott Schumacher

Norm Adams

James B Cushman, Ii

Norman S Adams

Erik Hume Jones

Embodiments of systems and methods for reducing false positives during the linking of data records are disclosed herein. Broadly speaking, embodiments of the present invention may be used in the generation of an overall weight from the comparison of various attributes of data records, where the linking of the data records is dependent on the overall weight. More specifically, embodiments of the present invention may calculate a false positive penalty based on a set of results, each of the set of results based on a comparison of an attribute. The false positive penalty may be subtracted from the overall weight generated from the comparison of the attributes of data records to adjust the overall weight. By configuring which attributes of the data records are used as the set of attributes for generating the false positive penalty, and the penalties associated with a particular combination of results for the comparisons of these attributes, the incidence of false positives in the linking of data records may be significantly reduced.

Method and system for filtering false positives

Systems and methods for indexing, associating or compositing data records and hierarchies from various information sources are disclosed. Embodiments of the present invention may provide the ability to link data records and thus to link data records to known hierarchies of data records. More specifically, embodiments of the present invention may provide the capability to associate data records in varying information sources and to thereby associate incoming data record with existing data records or existing data hierarchies such that an incoming data record may not only be associated with an existing data record comprising information about the same entity but may additionally be associated with other members of the data hierarchy in the same manner as the existing data record. In addition to associating an incoming data record with an existing data record and incorporating the incoming data record into an existing data hierarchy, embodiments of the present invention may provide the capability of reconciling an incoming data hierarchy to which an incoming data record belongs with an existing data hierarchy belongs such that the two data hierarchies may be composited.

Indexing information about entities with respect to hierarchies

Embodiments of systems and methods for comparing attributes of a data record are presented herein. Broadly speaking, embodiments of the present invention generate a weight based on a comparison of the name (or other) attributes of data records. More particularly, embodiments of the present invention generate a weight based on a comparison of name attributes. More specifically, embodiments of the present invention may calculate an information score for each of two name attributes to be compared to get an average information score for the two name attributes. The two name attributes may then be compared against one another to generate a weight between the two attributes. This weight can then be normalized to generate a final weight between the two business name attributes.

Method and system for comparing attributes such as business names

Embodiments disclosed herein provide an implementation defined segments (IDS) subsystem which allows new data segments to be added to an identity hub after deployment. A set of metadata tables are utilized to describe IDS, each of which is a data structure encapsulating a single row from a master data record residing in the identity hub. Once a segment (an object) is described, the identity hub can use the information to define persistent storage for the object in the database for any relational database management system, create internal structures to hold the data and process business rules and demographic comparisons against the data object, describe the data object to remote clients, and allow the clients to query the identity hub at runtime about what data objects exist, what fields and data types they contain, and additionally how they might be displayed or formatted on various clients.

Implementation defined segments for relational database systems

Embodiments of the invention provide a system and method of automatically generating weights for matching data records. Each field of a record may be compared by an exact match and/or close matches and each comparison can result in a mathematical score which is the sum of the field comparisons. To sum up the field scores accurately, the automatic weight generation process comprises an iterative process. In one embodiment, initial weights are computed based upon unmatched-set probabilities and default discrepancy weights associated with attributes in the comparison algorithm. A bulk cross-match is performed across the records using the initial weights and a candidate matched set is computed for updating the discrepancy probabilities. New weights are computed based upon the unmatched probabilities and the updated discrepancy probabilities. Test for convergence between the new weights and the old weights. Repeat with the new weight table until the weights converge to their final value.

System and method for automatic weight generation for probabilistic matching

Embodiments of the present invention may be used in the generation of an overall weight from the comparison of various attributes of data records, where the linking of the data records is dependent on the overall weight. More specifically, embodiments of the present invention may calculate a false positive penalty based on a set of results, each of the set of results based on a comparison of an attribute. The false positive penalty may be subtracted from the overall weight generated from the comparison of the attributes of data records to adjust the overall weight. By configuring which attributes of the data records are used as the set of attributes for generating the false positive penalty, and the penalties associated with a particular combination of results for the comparisons of these attributes, the incidence of false positives in the linking of data records may be significantly reduced.

Embodiments of systems and methods for comparing attributes of a data record are presented herein. Embodiments of the present invention generate a weight based on a comparison of attributes of data records. More specifically, embodiments of the present invention may compare each of the tokens of one name to each of the tokens of the other name. Each of these comparisons may generate a match score. These match scores can then be summed to generate the weight for the two names. Specific embodiments may adjust the weight based on various criteria such as the position of the tokens which match or subtracting a mismatch penalty.

Growing community of inventors

Marietta, GA, United States of America

Scott Ellard