Tencent Technology (shenzhen) Company Limited

Quanchen Lin

Lichun Liu

Jianchun Zhao

The disclosure provides a text information processing method. Training textual data is determined according to text information, and characters and strings are identified from the training textual data. For each of the identified characters, a respective independent probability of appearance among the training textual data is calculated. For each of the identified strings, a respective joint probability of appearance among the training textual data is calculated. Whether a particular string of the identified strings corresponds to a candidate neologism is determined according to independent probabilities of various characters of the particular string and the joint probability of the particular string. Moreover, the candidate neologism is determined as a neologism when the candidate neologism is not in a preset dictionary and a joint probability of the candidate neologism is greater than a preset threshold.

Growing community of inventors

Shenzhen, China

Quanchen Lin