Veritas Operating Corporation

Symantec Corporation

Symantec Operating Corporation

James P Ohr

Graham Bromley

Weibao Wu

David Teater

Thomas Lanzatella

Stephan Gipp

Timothy J Stevens

Thomas L Krinke, Ii

Xianbo Zhang

Yi Qu

Thomas G Clifford

Timothy Michael Naftel

Sinh Nguyen

Shelley A Schmokel

Steven Kappel

Girish Sureshrao Jorapurkar

James Olson

Jon Genda

Michael John Zeis

Guy Barry Owen Bunker

Christopher James Elphinstone Chandler

Dean Elling

William DesJardin

Wei-Zhen Zhu

Jian Jun Lu

Emery Wang

Sinh D Nguyen

James Robert Olson

A system and method for partitioning a data stream into a plurality of segments of varying sizes. A data stream manager partitions a received data stream into segments which are then conveyed to a deduplication engine for processing. The data stream received by the data stream manager includes metadata corresponding to the data stream. Based upon the metadata, which may include an indication as to a type of data included in the data stream, the data stream is partitioned into segments for further processing. A size of a segment used for partitioning given data is based at least in part on a type of data being partitioned. The variable segment sizes may be chosen to balance between maximizing the deduplication ratio and minimizing both the segment count and the size of the fingerprint index.

System and method for partitioning backup data streams in a deduplication based storage system

A computer-implemented method for migrating an object from a deduplication store to an external domain in an external media is described. A deduplication store (dstore) deduplication map (dmap) is retrieved from a dstore for an object stored in the dstore. A determination is made as to whether an external dmap exists in the external domain for an object referenced in the dstore dmap. If the external dmap exists, a determination is made as to whether data referenced in the dstore dmap exist in the external dmap. If the referenced data do not exist, the referenced data is extracted from the dstore to the external domain. If the external dmap does not exist, the object and the associated dmap are extracted from the dstore to the external domain.

Systems and methods for migrating an object from a deduplication store to an external domain

A method, system, and computer-readable storage medium are disclosed for recovering a backup catalog from replicated data. A set of catalog metadata may be stored in a metadata object on a first storage device. The set of catalog metadata may describe a plurality of files stored in an archive. The metadata object and the archive may be copied to a second storage device, thereby generating a replicated metadata object and a replicated archive on the second storage device. The set of catalog metadata may be imported from the replicated metadata object into a destination backup catalog. The destination backup catalog describes the plurality of files stored in the replicated archive.

Backup catalog recovery from replicated data

A system and method for backing up a virtual machine executing on a virtualization server computer are described. A snapshot of a virtual disk image file of the virtual machine may be created on a network-attached storage (NAS) device coupled to the virtualization server computer. The snapshot may be used to backup the virtual disk image file from the NAS device to a backup storage device without transferring the virtual disk image file through the virtualization server computer. Mapping information useable to access the plurality of files stored in the virtual disk image file on an individual basis may be created and stored together with the backup copy of the virtual disk image file on the backup storage device.

Proxy backup of virtual disk image files on NAS devices

Various embodiments of a system and method for updating backup configuration information used by backup software to perform backup operations for a storage cluster are described. Backup configuration information specifying a configuration of the storage cluster may be stored. Subsequently, a particular change to the configuration of the storage cluster may be automatically detected. In response to detecting the particular change, the backup configuration information may be automatically updated to reflect the particular change to the configuration of the storage cluster. Subsequent backup operations may then be performed using the updated backup configuration information.

Dynamically updating backup configuration information for a storage cluster

A method and apparatus for optimizing a de-duplication rate for backup streams is described. In one embodiment, the method for optimizing data de-duplication using an extent mapping of a backup stream includes processing a backup stream to access an extent mapping associated with a plurality of data files, wherein the plurality of the data files are arranged within the backup stream and examining the extent mapping to identify at least one extent group within the backup stream, wherein the plurality of the data files are de-duplicated using at least one location of the at least one extent group.

Optimizing the de-duplication rate for a backup stream

A method, system, and computer-readable storage medium are disclosed for sharing non-distributed, random-access storage resources among a plurality of computer systems. A first backup or restore operation may be initiated. In response to initiation of the first backup or restore operation, a volume of a random-access storage device may be automatically mounted at a first computer system. The random-access storage device may be coupled to the first computer system by a network, and the volume may store a non-distributed file system. The first backup or restore operation may be completed by transmitting a first set of data between the random-access storage device and the first computer system. In response to completion of the first backup or restore operation, the volume of the random-access storage device may be automatically unmounted at the first computer system.

Automatically mounting and unmounting a volume during a backup or restore operation

Method and apparatus for file-level restore from raw partition backups. A backup mechanism may be provided that is configured to perform raw partition backups to a media server and to support file-level restores from the raw partition backups through, for example, Fibre Channel (FC) or iSCSI Logical Unit (LUN) export of the raw partition backup images to client systems. Once a LUN is exported and mounted on the client system, direct file manipulation using standard file system commands may be performed. Embodiments achieve both fast backup and individual file retrieval without the necessity of understanding native file system formats and without requiring a file system mapping of the source (client) partition. Thus, embodiments may be used in heterogeneous environments.

Method and apparatus for file-level restore from raw partition backups

Systems, methods, apparatus and software can utilize storage resource locks to prevent modification (including relocation) of data in the storage resource while a third-party copy operation directed at the storage resource is occurring. A data transport mechanism such as a data restore application requests that a relevant portion of the storage resource be locked. Once locked, the data transport mechanism requests a data mover to perform a third-party copy operation whereby data is moved from a data source to the locked portion of the storage resource. When the third party-copy operation is complete, the data transport mechanism requests release of the lock on the portion of the storage resource.

System and method using locks for providing safe movement of data using third party copy techniques

System and method for policy-based lifecycle management of data in file systems. In embodiments, an expiration policy for the files may be stored as part of the file system metadata. The expiration policy may be as simple as an expiration date for the file, or a more complex policy that specifies one or more metrics to be evaluated to determine if a file is expired. The expiration policy may also specify one or more actions to be taken if the file has expired. The expiration policy may be evaluated on attempts to access the files in the file system, on other file systems, and on backup/archive images to determine if the files are expired and thus whether access to the files is to be allowed. In one embodiment, a scan mechanism may periodically or aperiodically delete files in the file system for which the expiration date has passed.

System and method for policy-based data lifecycle management

Various methods and systems for performing extent-level backups that support single file restores are disclosed. For example, one a method involves accessing a list, which identifies several extents of a first storage device in a non-contiguous order. The non-contiguous order is non-contiguous with respect to an order in which the extents are arranged on the first storage device. The method then involves reading information from the extents of the first storage device, in the non-contiguous order identified by the list, and the writing the information to backup media. The information is written to the backup media in the non-contiguous order identified by the list. As a result, a first portion of the information, which is included in a first data object, may be less fragmented on the backup media than on the first storage device.

System and method for performing extent level backups that support single file restores

A virtual tape library may be configured to delete or free data blocks corresponding to expired backup images. A virtual tape volume may comprise multiple backup images, each corresponding to data stored by a backup application. The backup application may expire individual backup images of a virtual tape volume without expiring the entire virtual tape volume. In contrast to traditional virtual tape libraries, the virtual tape library described herein may delete, free and/or reuse the data blocks corresponding to expired backup images even before the entire virtual tape volume is expired.

Method to delete partial virtual tape volumes

Systems, methods, apparatus and software can utilize an extent guard to prevent modification (including relocation) of data in the storage resource while a third-party copy operation directed at the storage resource is occurring. A data transport mechanism such as a data restore application provides an extent list to the extent guard, which monitors read and/or write activity to storage resources described by the extent list. The data transport mechanism requests a data mover to perform a third-party copy operation whereby data is moved from a data source to the storage resource. If a modification attempt is made on the portion of the storage resource described by the extent list, the extent guard stalls the modification attempt until the third-party copy operation is aborted.

System and method for providing safe data movement using third party copy techniques

A system for protecting a block in a destination storage device including a data mover operable to move data from a source storage device to the block, and a controller coupled to the data mover, the controller operable to detect an application write request to the block and to stall the application write request while a data move operation initiated by the data mover is terminated.

System and method for preventing sector slipping in a storage area network

System and method for performing restores from backups while applications are active and accessing the data being restored. A map correlating destination locations on primary storage to source locations on backup storage for files to be restored may be generated. A restore of the files from the backup storage to the primary storage may be started. During the restore, one or more blocks of data of a file needed by an application may be determined. The map may be accessed to determine if the blocks have been restored. If the blocks have not been restored, the blocks may be restored from the backup storage to the primary storage. The restored blocks of data are accessible by the application while the restore is in progress. The map may be updated to indicate blocks of data that have been restored to the primary storage.

Growing community of inventors

Saint Paul, MN, United States of America

James P Ohr