Lucent Technologies Inc.

At+t Corp.

William Arthur Gale

Kenneth Ward Church

Oscar Ernesto Agazzi

David Dolan Lewis

David E Yarowsky

Jason A Catlett

A method downsamples characters in a document by font substitution when the characters in the document are identified with sufficient reliability. Otherwise, the characters are downsampled by decimation. The method also allows downsampling by applying characters to a two-dimensional nonlinear filter and decimating.

Method of downsampling documents

Apparatus and methods for training classifiers. The apparatus includes a degree of certainty classifier which classifies examples in categories and indicates a degree of certainty regarding the classification and an annotating classifier which receives classified examples with a low degree of certainty from the degree of certainty classifier and annotates them to indicate whether their classifications are correct. The annotated examples are then used to train another classifier. In one version of the invention, the other classifier is a new version of the degree of certainty classifier, and training continues until the degree of certainty classifier has satisfactory performance. The degree of certainty classifier of the embodiment is a probabilistic binary classifier which is trained using relevance feedback. The annotating classifier may include an interactive interface which permits a human user of the system to examine an example and indicate whether it was properly classified.

Training apparatus and method

Apparatus and methods for determining whether a word/sense pair is proper for a context. Wide contexts (100 words) are employed for both training and testing, and testing is done by adding the weights of vocabulary words from the context. The weights are determined by Bayesian techniques which interpolate between the probability of occurrence of a vocabulary word in a conditional sample of the training text and the probability of its occurrence in the entire training text. A further improvement in testing takes advantage of the fact that a word is generally used in only a single sense in a single discourse. Also disclosed are automated training techniques including training on bilingual bodies of text and training using categories from Roget's Thesaurus.

Growing community of inventors

Maplewood, NJ, United States of America

William Arthur Gale