Lsi Corporation

Emc IP Holding Company LLC

Avago Technologies General IP (singapore) Pte. Ltd.

Dell Products Inc.

Agere Systems Inc.

Symantec Corporation

Avago Technologies International Sales Pte. Limited

Dell USA L.p.

Symantec Operating Corporation

George Mathew

Yuan Xing Lee

Hongwei Song

Jongseung Park

Shaohua Yang

Murthy V Mamidi

Abhinav Duggal

Philip N Shilane

Erich Franz Haratsch

Pengju Shang

Abhishek Rajimwale

Eui Seok Hwang

Ming Jin

Pranay Singh

Bruce Alexander Wilson

Haitao Xia

Xiufeng Song

Weijun Tan

Jeffrey Paul Grundvig

Craig Harmer

Richard Rauschmayer

Charles J Hickey

Jefferson E Singleton

Chegu Vinod

Suharli Tedja

Dhawal Bhagwat

Englin Koay

Hao Zhong

Donna Barry Lewis

Timothy B Lund

Prajakta Balkrishna Ayachit

Anand Rudrabhatla

Ajith Krishnamurthy

Fan Zhang

Jehuda Shemer

Mukund Purshottam Khatri

Adolfo Sandor Montero

Bing Liu

Zongwang Li

Yang Han

Kalyan Chakravarthy Gunda

Jingfeng Liu

Viswanath Annampedu

Jun Xiao

Kelly K Fitzpatrick

Keyur B Desai

Carl E Forhan

Scott M Dziak

Haotian Zhang

Timothy W Swatosh

Senthil Ponnuswamy

Murthy Mamidi

Kurt J Worrell

Mukesh Sharma

Louis M Davis

Robert Alan Greene

Xiaohong W Wang

Krithika Subramanian

Shefali Gautam

Ronald S Karr

Shu Li

Oleg Kiselev

Travis Roger Oenning

Ramprasad N Chinthekindi

Xun Zhang

Mahesh Kamat

Nitin Madan

Nayak Ratnakar Aravind

Dheer Moghe

Basant Rajan

Angelo Rocco Mastrocola

Wai-Ming Richard Chan

Poornima Gupte

Srisailendra Yallapragada

Shobhan Chinnam

Terry Gene Hahn

Srikant Viswanathan

Mahadev Karadigudda

Naveen Rastogi

Frank L Wu

Li Du

Viral Kirtikumar Mehta

Andrew R Huber

Nagaraj Shyam

Omkar Anand Ekbote

Shaojie Li

Albert John Bolian

Han Fang

Harley Burger

Tariq Saeed

Pradeep Padukone

Rahul Goyal

Chetan Risbud

Sai Chivukula

Liu Jingfeng

Du Li

Foad Askari

Sirisha Kapoor

Geetha Shendge

Sampath Jayaram

One or more embodiments of the invention relates to a method of managing data in a cluster. The method includes receiving, by a global event manager of the cluster, a notification that an event has occurred on the cluster, wherein the cluster comprises a plurality of file system redirector proxy (FSRP) nodes. In response to the notification, the global event manager performs a load balancing analysis on the cluster to assign an export location of a file system export to a FSRP node of the plurality of FSRP nodes, and notifying each of the plurality of FSRP nodes in the cluster of the event, wherein the notifying results in an update of a global export table of each of the plurality of FSRP nodes of the assigning of the export location to the FSRP node.

Scaling and distributing namespaces and clients across multiple file system redirector proxies

Embodiments for performing load balancing in a filesystem of a distributed network comprising worker nodes accessing shared resources that are controlled by distributed locks to grant and prevent access from clients, by assigning a range of directory entries to each worker node, and providing feedback from each worker node to a load balancer to expose an internal state of acquired resources and other parameters of each worker node. In response to periodic updates of the directory ranges to be collocated, the system maintains directory ranges in each worker so that complete subtrees of the directory tree fit in a single range assigned to a worker. Upon receipt of a client request to access a data asset, the load balancer selects the most optimum worker to satisfy the request based on the worker internal states and other parameters.

Intelligent load balancing in a distributed system

System creates mapping of storage intent, defined for digital asset, to primary storage tier, of primary storage tiers in primary protection storage system, that matches storage intent. System receives request to store copy of digital asset, and stores the copy with storage intent in primary storage tier, based on mapping of storage intent to primary storage tier. System identifies expanded group of storage tiers comprising primary storage tiers combined with additional storage tier. If additional storage tier matches storage intent more than primary storage tier matches storage intent, which is mapped to primary storage tier, system changes mapping of storage intent to primary storage tier into mapping of storage intent, defined for digital asset, to additional storage tier. System relocates each copy of digital asset, based on mapping of storage intent to primary storage tier, to additional storage tier, based on mapping of storage intent to additional storage tier.

Intent-driven storage tiers that protect and relocate assets

Embodiments are described for providing backup resources in a multi-tier network, by providing a plurality of different storage devices, each with different operating characteristics and costs for storage of data assets, and organizing the storage devices into a plurality of tiers based on respective operating characteristics, such as based on performance versus cost parameters. Certain Service Level Agreements (SLAs) dictating storage requirements for each of the data assets to a backup program are provided to the backup system, and a mapper maps each SLA to one or more tiers of the plurality of tiers based on the storage requirements of a respective SLA to the operating characteristics of each tier.

Mapping service level agreements for backup systems to multiple storage tiers in a clustered network

Described is a system (and method) that maintains deduplication efficiency when storing data within a clustered data storage environment that implements a global namespace. To provide such a capability, the system may obtain granular data source identifying information from a client system that provides data to be backed-up by a backup component. The data source identifying information may take the form of a placement tag that is associated with the received data. The backup component may then provide such placement tags when providing the backup data to the clustered storage system. The placement tags may then be used to intelligently distribute backup files to particular storage nodes of the clustered storage system to improve deduplication efficiency.

Granular data source identification for obtaining deduplication storage efficiency within a clustered environment

A fencing service receives a cluster message based on a first service's removal from membership in a first node in a cluster, and generates an access key based on a generation identifier in the cluster message. The fencing service sends the access key to a shared storage, thereby enabling the shared storage to create signing keys based on the access key, and which are used to validate signed requests to access resources stored by the shared storage. A second service in a second node in the cluster receives the cluster message, and generates the access key based on the generation identifier. The second service accesses a resource previously accessed by the first service, by generating a signing key based on the access key and a request to access the resource stored by the shared storage, and then sending the request signed by the signing key to the shared storage.

Fencing off cluster services based on access keys for shared storage

A system creates a mapping of a storage intent, defined for a digital asset, to one of the primary storage tiers, in a primary protection storage system, which matches the storage intent. The system receives a request to store a copy of the digital asset and stores the copy with the storage intent in the primary storage tier, based on the mapping of the storage intent to the primary storage tier. Upon receiving a request to replicate the copy of the digital asset, the system creates a mapping of the storage intent to one of the secondary storage tiers, in a secondary protection storage system, which matches the storage intent. The system replicates each copy of the digital asset, which is stored in the primary storage tier, and the storage intent to the secondary storage tier, based on the mapping of the storage intent to the secondary storage tier.

Intent-driven storage tiers that protect and replicate assets

Embodiments are described for migrating data and load balancing in a multi-domain network having a clustered network partitioned into a number of separate domains. Each domain contains resources like processors and memory, as well as deduplication and compression services. A single global namespace for the network is presented by combining all of the namespaces in the domains. A multi-domain manager component with an analytics engine facilitates analytics-driven migration of data among nodes in different domains, and a load balancer component monitors environmental operating conditions of each node in the clustered network, detects nodes having operating conditions exceeding defined tolerances, and migrates data and processes from nodes exceeding the defined tolerances to other nodes not exceeding the defined tolerances.

Data migration and namespace management across domains in multi-domain clustered file systems

A distributed and deduplicating file system that stores backup metadata to object storage is described. A node, in a cluster of nodes, receives backup data associated with a write operation to back up a data file, and identifies metadata associated with deduplicated data by deduplicating the backup data. If the access frequency associated with the metadata is greater than or equal to an access threshold, and the size of the metadata is less than or equal to a storage threshold, the cluster writes the metadata to each of the memory devices corresponding to the nodes in the cluster. If the access frequency associated with the metadata is less than the access threshold, or the size of the metadata is more than the storage threshold, the node writes information which includes the metadata to an object storage that stores data objects for the nodes in the cluster.

Distributed and deduplicating file system for storing backup metadata to object storage

Mapping information identifies ranges of files, a set of front-end microservices, and assignments of the ranges to the front-end microservices. Each front-end microservice is thereby responsible for a range of files. The files are represented by segment trees and the front-end microservices handle operations involving an upper-level of the segment trees. A file system request on a file is directed to a particular front-end microservice that is responsible for handling a particular range of files within which the file falls according to the mapping information. An indication is received from a container orchestration service that a number of front-end microservices has changed. The mapping information is updated based on the change in the number of front-end microservices.

Scale out deduplicated file system as microservices

A security level tagging process to enable a user to associate a security level descriptor with a file, or a namespace directory where files and subdirectories inherit the security level descriptor from a parent directory. A parser can be used to automatically set a security level descriptor based on the contents of the file and/or attributes of files, or an administrator can associate a security level to a storage tier in the file system so that files are placed on the storage tiers with the matching security level as the file security level descriptor. The placement of the file on a storage tier depends on the data security level descriptor of the file and the security level of the storage so that files are placed on tiers where security level associated with the tier is greater than or equal to data security level of the file. Files can be migrated among storage tiers as their security levels may change.

Data security classification for storage systems using security level descriptors

Embodiments are described for a multi-domain and multi-tier architecture for clustered network file systems. This system allows a user to create sub-cluster of physical nodes, called domains, and file system resources for the data placed in a domain are allocated only from the nodes in the domain. It limits the impact of system failures to the files within a domain. A file system redirection service manages a global namespace spanning the domains and redirects file accesses to the appropriate domain where it is stored. In each domain, there are different classes of storage, tiers, with different cost and performance characteristics. Files can be placed on a set of tiers depending on a storage level agreement (SLA) specified for a file. Tier examples include a higher performance tier consisting of SSDs and a lower performance tier of HDDs.

Multi-domain and multi-tier scale-out architecture for clustered file systems

An access object service receives a communication of a stream of fingerprints, corresponding to segments of a file, from a source of the file, and identifies sequential fingerprints in the stream of fingerprints as a group of fingerprints. The access object service identifies a similarity group identifier for the group of fingerprints. The access object service communicates the group of fingerprints to a deduplication service associated with a range of similarity group identifiers that include the similarity group identifier. The deduplication service identifies fingerprints in the group of fingerprints which are missing from fingerprint storage. The deduplication service communicates the identified fingerprints to the access object service, which communicates a request for segments of the file, corresponding to the identified fingerprints, to the source of the file. The deduplication service receives a communication of the requested segments from the source of the file and stores the requested segments.

Destination file copying

A method of generating a hybrid snapshot includes receiving a request to generate a snapshot of a distributed file system and identifying a first storage resource of the distributed file system and a second storage resource of the distributed file system based on the request. The method further includes generating the snapshot of the distributed file system, the snapshot including a data-full snapshot of the first storage resource and a data-less snapshot of the second storage resource.

Hybrid snapshot of a global namespace

Systems and methods for reconstructing a namespace in response to a loss of data are described herein. To reconstruct the namespace, metadata super segments within a set of file containers may be located in response to a determination that original namespace metadata associated with files stored within the containers is unreadable. Content handles linking the super segment to metadata for each of the files may then be reconstructed from the super segments. Both inode numbers and M-tree identifiers are also extracted from the super segments for each of the files referenced by the super segments. Then, a plurality of U-trees is assembled by aggregating and linking the inode numbers of the files referenced within the super segments based on the M-tree identifiers. Finally, the recovered namespace metadata tree data structure for all of the files within the plurality of LP containers is assembled by aggregating and linking the U-trees.

File system namespace reconstruction

Growing community of inventors

San Jose, CA, United States of America

George Mathew