Inso Corporation

Lernout & Hauspie Speech Products N.v.

Michael Wiesner

Alwin B Carus

Keith Boone

Deborah Krause

Ateeque R Haque

A word breaker utilizing a lexicon module and a processing module to identify word breaks in a stream of Asian (e.g. Japanese, Chinese, or Korean) language text. The lexicon module is a dictionary or database containing words native to the language of the input text. The processing module includes a plurality of analysis modules which operate on the input text. In particular, the processing module can include modules that analyze the input text using heuristic rules and statistical analysis to identify a first set of work breaks, thereby reducing the size of segments with undefined word breaks. The processing module also includes a database analysis module that identifies the remaining undefined word breaks in those smaller segments that have undergone heuristic or statistical analysis.

Method and apparatus for breaking words in a stream of text

This invention improves information retrieval and the precision of language processing by providing an apparatus and method for organizing, utilizing, analyzing, and generating morphological data. The apparatus and method involve locating a stored lexical expression representative of a candidate word found in a stream of natural language text, identifying a paradigm for the candidate word based upon the stored lexical expression, and applying transforms contained within the identified paradigm to the candidate word.

Method and apparatus for morphological analysis and generation of

An apparatus and method for the identification of noun phrases in a stream of natural language text receives an input stream of text, identifies tokens within the stream of text, and processes the tokens to identify noun phrases. The system processes the tokens by annotating the tokens with tags identifying characteristics of the tokens and by contextually analyzing each token and its associated characteristics. During processing, the system can also disambiguate individual token characteristics and identify agreement between tokens.

Growing community of inventors

West Roxbury, MA, United States of America

Michael Wiesner