Netapp, Inc.

Dell Products Inc.

Emc IP Holding Company LLC

Sandeep Nirmale

Linda Ann Riedle

Deepan Natesan Seeralan

Mayank Saxena

Chaitanya V Patel

Kyle Diggs Sterling

Loellyn Jane Cassell

Laurent Nicolas Lambert

Vikram Harakere Krishnamurthy

Brandon Taylor Long

Daniel Curtis Wilson

Yong Cho

Bhoovaraghan Subramanian

Manali Kulkarni

Fani Jenkins

Nitin Madan

Ramprasad N Chinthekindi

Yubing Wang

Kedar Godbole

Gobikrishnan Sundharraj

Nishesh Gupta

Rahul Goyal

Manali Kulkami

Deep Desai

Rajendra Kumar Bhairy Raj

Disclosed is a storage system comprising: receiving a first data segment and first metadata associated with the first data segment to be stored in the storage system; storing the first data segment and the first metadata in a persistent storage device of the storage system; compressing the first data segment using a predetermined compression algorithm to generate a first compressed data segment; and storing the first metadata and the first compressed data segment in a solid state drive (SSD) cache device of the storage system, including aligning the first metadata and the first compressed data segment to a page boundary of the SSD device to reduce a number of input and output (IO) operations required for accessing the first metadata and the first compressed data segment from the SSD cache device.

Method to opportunistically reduce the number of SSD IOs, and reduce the encryption payload, in an SSD based cache in a deduplication file system

A method for assigning data to similarity groups (sim-groups). The method includes: partitioning a data stream, originating from a data source, into stream chunks; for at least a first stream chunk of the stream chunks: initializing a first chunk bin-map for the first stream chunk; partitioning the first stream chunk into first chunk segments; updating the first chunk bin-map based on a chunk segment processing of the first chunk segments; computing, to obtain a first similarity distance set, a similarity distance between the first chunk bin-map and each sim-group bin-map in a first set of sim-group bin-maps; identifying a first sim-group corresponding to a first similarity distance in the first similarity distance set; and assigning the first stream chunk to the first sim-group.

Data assignment to sim-groups using fingerprint distribution mapping

Data segments and metadata segments to be stored in a storage system, where the data segments are deduplicated segments and each of the metadata segments includes a fingerprint for the corresponding data segment, for each of the metadata segments. It is determined that the metadata segment contains one or markers inserted by a client device of the storage system. The metadata segment is examined to determine whether the metadata segment satisfies a predetermined condition. In response to determining that the metadata satisfies the predetermined condition, the metadata segment is compressed using a predetermined compression algorithm. The compressed metadata segment is stored in the storage system, otherwise the metadata segment is stored in the storage system without compression. Thereafter, the data segments are stored in the storage system.

Intelligent metadata compression

A method, article of manufacture, and apparatus for analyzing a distributed file system is discussed. A metadata operation is captured in an audit log, wherein the metadata operation is on an object stored in the distributed file system. An event is pushed to a distributed commit log and a real-time analytics engine in response to capturing the metadata operation. The event is persistently stored in the distributed commit log.

Distributed file system analytics

One or more techniques and/or systems are provided for mirror vote synchronization. For example, a first storage device is located at a first storage site, and a second storage device is located at a second storage site. The second storage device is configured according to a data mirroring configuration where data from the first storage device is mirrored to the second storage device. Mirror vote metadata is generated based upon an up-to-date state of the data mirroring configuration. The mirror vote metadata indicates whether the first storage device and/or the second storage device are up-to-date or not. The mirror vote metadata may be replicated between the first storage site and the second storage site. If the first storage site fails, then the second storage site may provide switchover operation using the second storage device based upon the mirror vote metadata.

Mirror vote synchronization

One or more techniques and/or systems are provided for controlling restoration of a storage aggregate. For example, a local storage device, located at a first storage site, and a remote storage device, located at a second storage site, may be assigned to a first storage aggregate. Responsive to a disaster of the first storage site, a gate may be created for the local storage device. The gate may block automated reconstruction and/or automated synchronization that may otherwise occur with respect to the local storage device. Until the local storage device is restored, the remote storage device may be used to service I/O requests that were otherwise directed to the local storage device. Responsive to receiving a user restoration command, the gate may be removed from the local storage device. Synchronization between the local storage device and the remote storage device may then be facilitated.

Storage aggregate restoration

One or more techniques and/or systems are provided for storage device health status synchronization. For example, a first health status registry is maintained for a first storage controller at a first storage site. The first storage controller stores storage device health status information of storage devices currently owned by or assigned to the first storage controller within the first health status registry. A second health status registry is maintained for a second storage controller at a second storage site. The second storage controller stores storage device health status information of storage device currently owned by or assigned to the second storage controller within the second health status registry. The first health status registry and the second health status registry are synchronized during operation of the first storage site and the second storage site and/or are merged between the first storage site and the second storage site after disaster recovery.

Storage device health status synchronization

In one aspect of the disclosure, progress identifiers (e.g., a plurality of flags) and/or generation numbers are utilized to determine a 'correct' non-volatile random access memory (NVRAM) replay source to use during a retried switchover or early switchback. Initially, a switchover sequence is initiated. The switchover sequence includes a replay of logged information to storage devices of an aggregate to ensure data consistency of the aggregate. Progress of the switchover sequence is tracked using the progress identifiers and/or generation numbers. After an interruption during the switchover sequence, switchover is retried or an early switchback is performed. The retried switchover or early switchback decides whether to replay logged information, and, if so, determines an NVRAM replay source to replay logged information from based on states of the progress identifiers and/or comparison of the generation numbers.

Providing data integrity in a non-reliable storage behavior

Growing community of inventors

Santa Clara, CA, United States of America

Sandeep Nirmale