Optimizing data loss prevention performance during file transfer operations by front loading content extraction

Abstract

Latency of DLP policy application during file transfer operations is decreased, by front loading the extraction of file content. The potential extraction latencies of files are quantified based on attributes such as size and/or type. Files with potential extraction latencies that meet a given threshold are identified for pre-transfer content extraction, and their content is extracted and stored. An index of the stored extracted content is maintained, tracking all files from which content has been extracted, according to factors such as size and checksum. When a specific file in the filesystem is transferred, it is determined whether its content has already been extracted, for example by matching the file size and checksum against those for which extracted content has been stored. Responsive to determining that content of the specific file has already been extracted and stored, the stored content is utilized when applying DLP, thereby greatly increasing performance.