Emc IP Holding Company LLC

Emc Corporation

Dell Products Inc.

Stephen Smaldone

Arieh Don

Ian Wigmore

Hyong Shim

Philip N Shilane

Grant R Wallace

Frederick Douglis

Mark D Malamut

Vinay G Rao

Arun Murti

Owen Martin

Sanjib Mallick

Marik Marshak

Windsor Hsu

Jian Xing

Felix Shvaiger

Cheng Li

Gabriel Benhanokh

Gabi Benhanokh

Adnan Sahin

Jonathan I Krasner

Steven R Chalmer

Chakib Ouarraoui

Alexander Veprinsky

Bruce Ferjulian

Application discovery from access patterns is disclosed. Access histories from multiple servers are collected and stored at a warehouse, which may be part of a data protection system. A time series analysis is performed on the access history to identify consistency groups and applications from the perspective of devices and storage arrays. Data protection operations such as backup operations can then be performed on the basis of devices or storage in storage arrays or other arrangements that pertain to specific consistency groups or to specific applications.

Application discovery using access pattern history

Embodiments for migrating hash values for backup data blocks in a network of data protection targets (DPTs) and a common data protection target implementing a Gold image library management system in which backups of Gold images used as templates for physical machines and virtual machines are stored on the CDPT. The CDPT and each DPT stores backup data split into chunks that are uniquely identified by a respective hash of its contents, and maintains data structures comprising the hash, chunk size, chunk data, and a list of DPT and CDPT identifiers. The hashes are partitioned into a set of buckets in the CDPT. A Bloom filter is generated for each bucket of hashes, and stored in each DPT so that each DPT stores Bloom filters for all CDPTs in the network. Each DPT checks its list of hashes against the Bloom filters in each of the DPTs to determine whether to keep or free chunks of data.

Hash migration using a gold image library management system

Automatically updating operating system and application programs in a large-scale network using Gold image data. An asset update process receives validation by a user for use of an updated program comprising new Gold image data. The process automatically updates the previous version of the updated version with the updated program to generate new user content data, without requiring further user intervention by using a defined tag linking the new Gold image data with previous Gold image data for the older version of the program. The Gold image data is stored in a central data protection target storage separate from data protection target storage for the user content data.

Automatic update of network assets using gold images

Reducing backup data by providing a data protection target for storing content data from clients running operating system and applications, and a common data protection target (CDPT) separate from the data protection target for storing Gold image data for the operating system and applications. Gold image data is stored by a user in a defined location or tagged with a defined tag. The stored or tagged Gold image data is identified by the backup software and copied to the CDPT. The identified Gold image data is cataloged. During backup, the CDPT is queried to determine if the Gold image exists, and if so, the DP target does not store the Gold image data in the DP target, but uses the reference to indicate the location of the Gold image data corresponding to the backed up content data. During a restore, the restore stream is built from the DP target and CDPT to combine user content data and Gold image data.

Automatic detection and identification of gold image library files and directories

Reducing backup data by providing a data protection target for storing content data from clients running operating system and applications, and a common data protection target (CDPT) separate from the data protection target for storing Gold image data for the operating system and applications. During backup, user content data is copied from the client to the data protection target, and Gold image data is copied to the CDPT. It is also referenced in the DP target to prevent redundant storage. During backup, the CDPT is queried to determine if the Gold image exists, and if so, the DP target does not store the Gold image data in the DP target, but uses the reference to indicate the location of the Gold image data corresponding to the backed up content data. During a restore, the restore stream is built from the DP target and CDPT to combine user content data and Gold image data.

Gold image library management system to reduce backup storage and bandwidth utilization

Embodiments provide for a primary storage array having multiple storage tiers. The multiple storage tiers include one or more performance tiers and at least one deduplicated storage tier storing deduplicated data. One embodiment provides for a data storage system including the storage array and an I/O engine to manage I/O requests for the storage array. The data storage system additionally includes a virtual execution environment to execute a virtual backup engine, the virtual backup engine to generate backup data for the one or more storage tiers of primary storage and deduplicate the backup data and a resource manager to manage a resource allocation to the virtual backup engine based on a hint received from the virtual backup engine, the hint associated with a backup operation that has a characterization selected from a set including computationally intensive and I/O intensive.

System and method of dynamic system resource allocation for primary storage systems with virtualized embedded data protection

Transferring files directly from a storage system to a backup storage system includes determining identifiers for blocks on the storage system that correspond to files that are to be backed up, providing the identifiers for the blocks to the storage system, and the storage system pushing the blocks indicated by the identifiers directly from the storage system to the backup storage system. The identifiers may be logical block addresses. Determining the logical block addresses may vary according to a file system for files that are to be backed up. Determining the logical block address may include determining an inode value for each of the files that are to be backed up or may include determining a logical cluster number for each of the files that are to be backed up. The backup storage system may include a media server and a storage device.

Storage based file FTP

In a storage system in which a storage array accesses cloud storage via a cloud gateway, the cloud gateway provides signals to control data rate between the storage array and the cloud. The signals may include commands to reduce or stop all volume streams or a select subset of volume streams. Data rate may be controlled on the basis of available buffering capacity of the cloud gateway and available bandwidth between the cloud gateway and cloud storage. The signals may be SCSI VU commands, where the cloud gateway is a SCSI initiator and the storage array is a SCSI target.

Avoiding failures in sending data to the cloud due to performance gradient

In a data processing system having multiple production hosts, each with a backup agent, interfaced to a storage array and to a backup server, an array I/O priority engine on the storage array establishes and enforces I/O priorities for I/O backup and production communications with the array to ensure that backup does not consume a disproportionate CPU processing and array bandwidth load or disrupt more critical production processing.

Meeting backup window requirements while managing storage array backup load

Embodiments are described for a multi-node file system, such as a clustered or distributed file system, with a file system buffer cache and an additional host-side tier non-volatile storage cache such as 3DXP storage. Cache coherency can be maintained by one of three models: (i) host-side tier management, (ii) file system management, or (iii) storage array management. performing a storage tier-specific file system action in a file system that comprises a namespace that spans multiple tiers of storage.

Using persistent memory technology as a host-side storage tier for clustered/distributed file systems, managed by cluster file system

Embodiments are described for dynamically allocating and reallocating system resources between production work tasks and administrative tasks using policies. A resource monitor continuously monitors all resources in a computing system, and whether the resources are used for production work or administrative tasks. A policy can define resources needed to execute an administrative task and conditions which can be used to determine whether or not the administrative command is allocated the resources, even at the expense of a negative impact to production work.

Administrative resource management QoS for storage appliances

Systems and methods for scheduling multiple flows in a computing system or for allocating resources to the flows in the computing system. Each flow may be associated with a target priority and a target performance. A current priority can be determined for each flow and resources are allocated based on the highest current priority. Over time, the current priorities change and each flow will receive resources as the flows are scheduled for execution. No flow is starved of resources.

Service level based priority scheduler for multi-tenancy computing systems

An apparatus comprises a host device configured to communicate over a network with a storage system comprising a plurality of storage devices. The host device is further configured to execute multiple processes that generate input-output (IO) operations for delivery to the storage system. The host device comprises a multi-path input-output (MPIO) driver configured to store for each of one or more of the storage devices information specifying one or more of the processes executing on the host device that are permitted to access that storage device, and for each of at least a subset of the IO operations, to determine the particular storage device to which the IO operation is directed, to identify the process that generated the IO operation, and to control delivery of the IO operation based at least in part on whether or not the stored information indicates that the identified process is permitted to access the particular storage device.

Secure storage access utilizing multi-path layer of host device to identify processes executed on the host device with authorization to access data of a storage system

A system for improving backup performance includes an interface, a processor, and a memory. The interface is to receive a volume identifier to backup. The processor is to determine allocation for data of a volume associated with the volume identifier in a plurality of storage tiers to improve backup processing, move data based at least in part on the allocation, and backup data of the volume. The memory is coupled to the processor and configured to provide the processor with instructions.

Growing community of inventors

Woodstock, CT, United States of America

Stephen Smaldone