Emc IP Holding Company LLC

Patrick S Combes

Sorin Faibish

John Michael Bent

Eriks Sasha Paegle

James M Pedone, Jr

Joshua E Simons

Methods and apparatus are provided for filtering dynamically loadable namespaces (DLNs). An exemplary method comprises, in response to a job submitted by an application, obtaining a DLN portion of a global single namespace of a file system, wherein the DLN is associated with the job and is maintained in a capacity tier of a storage system; obtaining filtering directives from a user; reducing the DLN using a filtering mechanism on a directory tree associated with the DLN, based on the filtering directives, by removing files in the directory tree of the DLN that do not satisfy requirements of the filtering directives to generate a filtered DLN; and dynamically loading the filtered DLN, including reduced metadata for the filtered DLN relative to the DLN, from the capacity tier into a performance tier of the storage system for processing by the application.

Methods and apparatus for filtering dynamically loadable namespaces (DLNs)

Methods and apparatus are provided for reorganizing dynamically loadable namespaces (DLNs). In one exemplary embodiment, a method comprises the steps of, in response to a job submitted by an application, obtaining a DLN portion of a global single namespace of a file system, wherein the DLN is associated with the job and is maintained in a capacity tier of object storage of a storage system; obtaining one or more reordering directives from a user; rearranging one or more files in the DLN into a new directory hierarchy based on the one or more reordering directives to generate a reordered DLN; and dynamically loading the reordered DLN, including the metadata only for the reordered DLN, from the capacity tier of object storage into a performance tier of storage of the storage system for processing by the application. The reordered DLN is merged into the DLN following one or more modifications to the reordered DLN.

Methods and apparatus for reorganizing dynamically loadable namespaces (DLNs)

Methods and apparatus are provided for fault resilient distributed computing using a continuous data protection feature of virtual machines. An exemplary method by a compute node for executing a process of a distributed application comprises providing a virtual machine having continuous data protection to store a copy of a state of the process in a performance storage tier; and providing a virtual machine to intercept messages of the process and to store a copy of the intercepted messages in a message log, wherein the process communicates with a plurality of other processes executing on other compute nodes, and wherein the plurality of processes employ asynchronous checkpointing. The process optionally communicates with the other processes in the distributed application using one or more virtual networks. The state is optionally moved from the performance storage tier to a capacity storage tier when a new state is stored. The stored state and/or the message log can be purged using a stored epoch counter, or when an explicit checkpoint routine has completed.

Fault resilient distributed computing using virtual machine continuous data protection

Methods and apparatus are provided for filtering dynamically loadable namespaces (DLNs). In one exemplary embodiment, a method comprises the steps of, in response to a job submitted by an application, obtaining a dynamically loadable namespace (DLN) portion of a global single namespace of a file system, wherein the DLN is associated with the job and is maintained in a capacity tier of object storage of a storage system; obtaining one or more filtering directives from a user; reducing the DLN based on the one or more filtering directives to generate a filtered DLN; and dynamically loading the filtered DLN, including the metadata only for the filtered DLN, from the capacity tier of object storage into a performance tier of storage of the storage system for processing by the application. The filtered DLN is merged into the original DLN following one or more modifications to the filtered DLN.

Growing community of inventors

Seattle, WA, United States of America

Patrick S Combes