The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Apr. 12, 2005
Filed:
Jun. 29, 2001
Hubert Crepy, Boulogne, FR;
Hubert Crepy, Boulogne, FR;
International Business Machines Corporation, Armonk, NY (US);
Abstract
Disclosed herein is a method for automatically filtering a corpus of documents containing textual and non-textual information of a natural language. According to the method, through a first dividing step (), the document corpus is divided into appropriate portions. At a following determining step (), for each portion of the document corpus, there is determined a regularity value (V) measuring the conformity of the portion with respect to character sequences probabilities predetermined for the language considered. At a comparing step (), each regularity value (V) is then compared with a threshold value (V) to decide whether the conformity is sufficient. Finally, at a rejecting step (), any portion of the document corpus whose conformity is not sufficient is rejected and removed from the corpus. An apparatus for carrying out such a method is also disclosed.