Single instance store for file systems

Abstract

A method and system for storing the data of files having duplicate content, by maintaining a single instance of the data, and providing logically separate links to the single instance. Files of duplicate content have their data stored in a common store file by a single instance store (SIS) facility, which also converts the original file or files to links to that common store file and creates additional links thereto as needed. The SIS facility may reside above a file system as a filter driver. File system requests directed to the link file (e.g., open, write, read, close and delete) reach the SIS filter, which then transparently handles each request as if the link file was a normal file. To preserve logical separation, writes to a SIS link file are to the link file, and the written portion recorded as dirty. The SIS filter intercepts SIS read requests, and reads clean portions from the common store file and any dirty portions from the link file. When the link file is closed, the common store file also may be closed, and, if the link file has been written, the non-dirtied portions of the link file are filled in with clean data from the common store file, and the link file reconverted to a normal file. Security is provided to prevent unauthorized access to the common store files, as is a volume check facility that repairs any inconsistencies in SIS metadata.