International Business Machines Corporation

Qiongkai Xu

Hui Zhu

Feng Cao

Yuan Ni

Noam Slonim

The present invention relates to text analysis, and discloses a text representation method. Aspects include identifying concepts in the text by using a knowledge base and determining relationship between the concepts and generating a concept graph by using the relationship between the concepts. Aspects also include determining connected components of the concept graph; calculating weight of the connected components and determining the concepts representing the text according to the weight of the connected components. By using correlation between concepts in a knowledge base and according to connected component theory of a graph, finds out a set of concepts which best represents subject of the text, and removes concepts irrelevant to the subject, thus improving accuracy of text representation and reducing noise.

Text representation method and apparatus

Disambiguation in mention detection. The method includes: determining at least one location in a text at which a target surface form in the text appears; obtaining an overall word-bag context of the target surface form in the text, the word-bag context at each of the at least one location including words within a predetermined neighborhood of the location; obtaining an overall resource context of the target surface form in the text, the resource context at each of the at least one location including resources corresponding to a further surface form within a predetermined neighborhood of the location; and determining a similarity between the target surface form and a candidate resource for the target surface form based on the overall word-bag context and the overall resource context. A system for disambiguation in mention detection is also provided.

Growing community of inventors

Shanghai, China

Qiongkai Xu