Generating a content signature of a textual communication using optical character recognition and text processing

Abstract

Techniques are described herein that are capable of generating a content signature of a textual communication using OCR and text processing. The textual communication is rendered. Text is extracted from the rendered textual communication using OCR. Customization is removed from the text to provide a templatized version of the rendered textual communication that includes de-customized text. The de-customized text is parsed into tokens. Each token includes a respective subset of a plurality of characters. The tokens are converted into respective numbers. Each number is processed using fuzzy hash functions to provide respective hash values associated with the respective token. Representative hash values are selected for the respective fuzzy hash functions by selecting each representative hash value from the hash values that are processed using the respective fuzzy hash function. A content signature of the textual communication is generated by bitwise concatenating at least portions of the respective representative hash values.