Zhejiang Gongshang University

Yukuan He

Kai Liu

Xiaoning Jiang

Yuhan Zhou

Jie Zhang

Hongmin Xie

Zhen Liu

Weijie Liu

A method and a system for filtering ill corpus are provided. The method includes following steps: acquiring a text corpus to be recognized, and preprocessing the text corpus to be recognized to obtain a basic text corpus; extracting entities in the basic text corpus, and performing matching search on the entities of the basic text corpus according to an ill-text knowledge graph to obtain a first recognition result; detecting and recognizing the basic text corpus according to a corpus recognition model to obtain a second recognition result; and filtering the text corpus to be recognized according to the first or/and the second recognition result, and updating the ill-text knowledge graph according to the second recognition result. With semantic network essence and strong correlation ability of knowledge graph technology, candidate ill entities can be obtained, thus facilitating filtering of obscure ill information in forms of pinyin, homophonic words and split words.

Method and system for filtering ill corpus

Growing community of inventors

Zhejiang, China

Yukuan He