Emc IP Holding Company LLC

Dell Products Inc.

Emc Corporation

Dell & Products L.p.

Adrian Michaud

Kenneth J Taylor

Jean-Pierre Bono

Roy E Clark

Randall Shain

Marc A De Souter

Dragan Savic

Stephen Wing-Kin Au

Michael Robillard

Junping Zhao

John S Harwood

Said Tabet

Robert W Beauchamp

Amnon Izhar

Patrick J Weiler

JoonJack Yap

Kelly G Kanellakis

Qin Xin

Wing-Kin Au

A system for managing storage and access to data for a file system includes a client device, a file system server, and a storage device. The file system server may perform a method that includes receiving a request for a file system object from the client device, wherein the request comprises a logical block address (LBA) associated with a data block of the file system object. The LBA includes a storage device index corresponding to the storage device, a block size index corresponding to a size of the data block, and a block number corresponding to a block index of a plurality of data blocks stored in the storage device. In response to the request: the method further includes determining a storage location of the data block using the LBA, obtaining data associated with the data block from the storage device, and providing the data to the client device.

Distributed fabric logical block addressing

A system for managing the storage of metadata includes a client device, a network, and two or more file system servers, including a first file system server and a second file system server. The first file system server is programmed to: receive a request for a file system object from the client device, in response to the request: make a determination that the second file system server is to manage the file system object, based on the determination, generate an index node (I-node), and send the I-node to the second file system server. The I-node includes an object type field corresponding to a type of the file system object, a server base index field corresponding to the second file system server, and a directory index field corresponding to an index in a file system object metadata of the second file system server.

Index node distribution and disaggregation

File system management is disclosed. File system metadata is stored in local memory of a client. The portion of local memory storing the file system metadata is under control of the metadata server. The construction and management of the metadata stored in the local memory of the client is driven, initiated and managed by the remote metadata server.

High-performance remote file system meta data

A system for managing data includes a client device, a remote direct memory access (RDMA) fabric network, and a persistent memory (PMEM) system comprising a plurality of PMEM servers, wherein a RDMA fabric device of the RDMA fabric is programmed to: obtain a RDMA request, associated with the data, from the client device, wherein the RDMA request specifies a PMEM address of a PMEM region, identify a PMEM server of the plurality of PMEM servers based on the PMEM address, and access the PMEM region using the PMEM server to service the RDMA request.

Method and system for a disaggregated persistent memory system using persistent memory servers

One example method may be performed in an operating environment including distributed and/or disaggregated compute nodes that communicate with each other and with a shared computing resource by way of an RDMA fabric. The method may include obtaining, by a first one of the compute nodes, ownership of an atomic synchronization object that controls access to the shared computing resource, using, by the first compute node, the shared computing resource until the shared computing resource is no longer needed by the first compute node, and when the shared computing resource is no longer needed by the first compute node, relinquishing, by the first compute node, the ownership of the atomic synchronization object.

High-performance remote atomic synchronization

A method for generating a thread queue, that includes obtaining, by a user space file system, central processing unit (CPU) socket data, and based on the CPU socket data, generating a plurality of thread handles for a plurality of cores, ordering the plurality of thread handles, in the thread queue, for a first core of the plurality of cores, and saving the thread queue to a region of shared memory.

Methods and systems for optimizing file system usage

A method for storing data, the method comprising receiving, by an offload component in a client application node, a request originating from an application executing in an application container on the client application node, wherein the request is associated with data and wherein the offload component is located in a hardware layer of the client application node, and processing, by the offload component, the request by a file system (FS) client and a memory hypervisor module executing in a modified client FS container on the offload component, wherein processing the request results in at least a portion of the data in a location in a storage pool.

Methods and systems for storing data in a distributed system using offload components

A method for rebuilding data, comprising: obtaining, from a metadata node, a source file data layout for a source file and a target file data layout for a target file, wherein the source file is associated with a degraded mapped RAID group and the target file is associated with a new mapped RAID group; generating, by the client application node, a plurality of input/output (I/O) requests to read a portion of the data associated with the source file using the source file data layout; obtaining, in response to the plurality of I/O requests, the portion of the data associated with the source file; rebuilding a second portion of the data associated with source file using the portion of the data; and initiating, storage of at least the second portion of the data associated with the source file in the storage pool using the target file data layout.

Methods and systems parallel raid rebuild in a distributed storage system

A method for managing file systems includes receiving, by a unified namespace manager, a first message that indicates a new file system has been created on a first node, performing an update on a top level file system namespace to include a reference to the new file system to generate an updated top level file system namespace, generating, based on the update, a second message that indicates the top level file system namespace has been updated, and sending, to a second node, the second message.

Methods and systems for utilizing a unified namespace

A method for managing nodes includes detecting, by a failover node, a failure of a primary node, based on the detecting, updating a sparse virtual space to indicate that a file system previously local to the primary node is now local to the failover node, wherein the sparse virtual space is managed by a file system container executing on the failover node, and initiate execution of an instance of an application on the failover node, wherein a second instance of the application was previously executing on the primary node, and wherein the instance of the application uses the file system.

Methods and systems for mirroring and failover of nodes

A method for managing file systems, includes receiving, by a processor coordinator, a first operation request, identifying a file system associated with the first operation request, making a first determination that the file system is local, and in response to the first determination identifying a core thread pool associated with the file system, and directing operation of the first operation request to be executed on a core associated with the core thread pool, wherein the core is associated with a processor.

Method and system for identifying a preferred thread pool associated with a file system

A method for moving data includes identifying, by a staging manager in a container, a trigger condition associated with data being used by an application external to the container, performing an analysis on the trigger condition, making a first determination, based on the analysis, that the trigger condition is satisfied, and processing, based on the first determination, a data movement action.

Methods and systems for optimizing storage resources

A method for processing requests includes receiving a request comprising a virtual address, wherein the request is associated with an application executing on an operating system, identifying, based on data specified in the request, a logical volume associated with the data, making a first determination, based on the logical volume, that the logical volume is managed by a remote node, generating a data layout request to receive a data layout of the data from the remote node, receiving the data layout, wherein the data layout specifies a first physical address on the remote node that stores the data, initiating a copy request to copy the data from the first physical address to a second physical address on a local node, generating, based on the copy request, a virtual-to-physical address mapping between the virtual address and the second physical address; and initiating processing the request using the virtual-to-physical address mapping.

Methods and systems for servicing data requests in a multi-node system

A system includes a host processor, a volatile memory device coupled to the host processor, and at least a first persistent memory device coupled to the host processor. The host processor is configured to execute one or more applications. The volatile memory device and the first persistent memory device are in respective distinct fault domains of the system, and at least one of a plurality of data objects generated by a given one of the applications is accessible from multiple distinct storage locations in respective ones of the distinct fault domains. For example, the host processor and the volatile memory device may be in a first one of the distinct fault domains and the first persistent memory device may be in a second one of the distinct fault domains. The data object remains accessible in one of the fault domains responsive to a failure in another of the fault domains.

System comprising non-volatile memory device and one or more persistent memory devices in respective fault domains

A system includes a host processor and at least one storage device coupled to the host processor. The host processor is configured to execute instructions of an instruction set, the instruction set comprising a first move instruction for moving data identified by at least one operand of the first move instruction into each of multiple distinct storage locations. The host processor, in executing the first move instruction, is configured to store the data in a first one of the storage locations identified by one or more additional operands of the first move instruction, and to store the data in a second one of the storage locations identified based at least in part on the first storage location. The instruction set in some embodiments further comprises a second move instruction for moving the data from the multiple distinct storage locations to another storage location.

Growing community of inventors

Carlisle, MA, United States of America

Adrian Michaud