International Business Machines Corporation

Misook A Choi

Yael Ravin

Faye Nina Wacholder

Roy Jefferson Byrd

Descriptive canonical forms of entity types are created by scanning one or more documents in a database of a computer system to identify one or more proper names that appear in the documents as raw names. Each of the raw names has zero or more proper names, zero or more medial substrings, zero or more leading substrings, and zero or more trailing substrings. The raw names of one or more documents are 'cleaned' and 'split' until certain 'cleaning and splitting conditions' are no longer met to obtain a list of clean and split candidate names. Anchor names are selected from the list that unambiguously represent an entity type. The anchor names have one or more entity-type attribute values. Variant names, clean and split candidate names having one or more shared attribute (values) with the anchor name, are combined with the anchor name to create an equivalence group of names that refer to the same entity. A canonical form is generated for the group from a subset of the anchor name attributes. A canonical form is created in this manner for all of the clean and split candidate names on the list.

Using canonical forms to develop a dictionary of names in a text

Occurrences of proper names in text are identified by scanning one or more documents in a database of a computer system to identify one or more sequences of capitalized words and other specially defined words that appear in the documents as raw names. Each of the raw names has zero or more proper names, zero or more medial substrings, zero or more leading substrings, and zero or more trailing substrings. The raw names of one or more documents are 'cleaned' and 'split' until certain 'cleaning and splitting conditions' are no longer met to obtain a list of clean and split candidate names.

Growing community of inventors

Mt. Kisco, NY, United States of America

Misook A Choi