Emc Corporation

Vmware, Inc.

Emc IP Holding Company LLC

Emc Coropration

Sairam Veeraswamy

Jean-Pierre Bono

Rajesh Venkatasubramanian

Keerthi B Kumar

Peter C Bixby

Morgan A Clark

Philippe Armangau

William C Davenport

John Michael Hayden

Sachin Mullick

Pratap Subrahmanyam

Marcos Kawazoe Aguilera

David Noveck

Daniel Alan Muntz

Pramod Kumar

Hongliang Tang

Upanshu Singhal

Kiran Tati

Uresh K Vahalia

Ravi Wijayaratne

Yubing Wang

Sitaram D Pawar

Peter W Madany

Ajay Potnis

Thirumale N Niranjan

Pranit Sethi

Michael Scheer

Karthikeyan Srinivasan

Halesh Sadashiv

Thomas J Dwyer, Iii

Alex Burlyga

Kiran Dikshit

Assaf Natanzon

Sorin Faibish

Xiaoye Jiang

Hari Sivaraman

Uday Pundalik Kurkure

Alexander S Mathews

Lan Vu

Anat Parush Tzur

Marc DeSouter

Anshuj Garg

Saurabh Ramchandra Godbole

Animesh Singh

Nir Goldschmidt

Rahul Bhagwat

Arun Ramanathan

Kallol Par

Linton Vadakedathu

Manish Mishra

Rolland Santimano

Chandra Prakash

Janarthanan Palanichamy

George Asirvatharaj

Techniques for implementing RDMA-based recovery of dirty data in remote memory are provided. In one set of embodiments, upon occurrence of a failure at a first (i.e., source) host system, a second (i.e., failover) host system can allocate a new memory region corresponding to a memory region of the source host system and retrieve a baseline copy of the memory region from a storage backend shared by the source and failover host systems. The failover host system can further populate the new memory region with the baseline copy and retrieve one or more dirty page lists for the memory region from the source host system via RDMA, where the one or more dirty page lists identify memory pages in the memory region that include data updates not present in the baseline copy. For each memory page identified in the one or more dirty page lists, the failover host system can then copy the content of that memory page from the memory region of the source host system to the new memory region via RDMA.

Remote direct memory access (RDMA)-based recovery of dirty data in remote memory

Disclosed are various embodiments for improving resiliency and performance of clustered memory. A computing device can acquire a chunk of byte-addressable memory from a cluster memory host. The computing device can then identify an active set of allocated memory pages and an inactive set of allocated memory pages for a process executing on the computing device. Next, the computing device can store the active set of allocated memory pages for the process in the memory of the computing device. Finally, the computing device can store the inactive set of allocated memory pages for the process in the chunk of byte-addressable memory of the cluster memory host.

Resiliency and performance for cluster memory

Disclosed are various embodiments for improving the resiliency and performance of cluster memory. First, a computing device can submit a write request to a byte-addressable chunk of memory stored by a memory host, wherein the byte-addressable chunk of memory is read-only. Then, the computing device can determine that a page-fault occurred in response to the write request. Next, the computing device can copy a page associated with the write request from the byte-addressable chunk of memory to the memory of the computing device. Subsequently, the computing device can free the page from the memory host. Then, the computing device can update a page table entry for the page to refer to a location of the page in the memory of the computing device.

Copy and restore of page in byte-addressable chunks of cluster memory

Disclosed are various embodiments for improving the resiliency and performance for clustered memory. A computing device can mark a page of the memory as being reclaimed. The computing device can then set the page of the memory as read-only. Next, the computing device can submit a write request for the contents of the page to individual ones of a plurality of memory hosts. Subsequently, the computing device can receive individual confirmations of a successful write of the page from the individual ones of the plurality of memory hosts. Then, the computing device can mark the page as free in response to receipt of the individual confirmations of the successful write from the individual ones of the plurality of memory hosts.

The disclosure provides an approach for creating a pool of memory out of local memories of host machines, and providing that pool for the hosts to use. The pool is managed by a controller that keeps track of memory usage and allocated memory among hosts. The controller allocates or reclaims memory between hosts, as needed by the hosts. Memory allocated from a second host to a first host may then be divided into smaller portions by the first host, and further allocated to virtual machines executing within the first host.

Remote memory in hypervisor

Disclosed is a method, apparatus, and system for dynamically changing a backup policy, the operations comprising: automatically detecting a change in a backup source system; automatically activating a new backup policy, wherein the new backup policy is determined based on the change in the backup source system and an old backup policy; and performing a backup session based on the new backup policy.

Redefining backup SLOs for effective restore

Various examples are disclosed for dynamic kernel slicing for virtual graphics processing unit (vGPU) sharing in serverless computing systems. A computing device is configured to provide a serverless computing service, receive a request for execution of program code in the serverless computing service in which a plurality of virtual graphics processing units (vGPUs) are used in the execution of the program code, determine a slice size to partition a compute kernel of the program code into a plurality of sub-kernels for concurrent execution by the vGPUs, the slice size being determined for individual ones of the sub-kernels based on an optimization function that considers a load on a GPU, determine an execution schedule for executing the individual ones of the sub-kernels on the vGPUs in accordance with a scheduling policy, and execute the sub-kernels on the vGPUs as partitioned in accordance with the execution schedule.

Dynamic kernel slicing for VGPU sharing in serverless computing systems

A computing node of a data storage system includes a data transform component. The data transform component identifies data that is maintained by the storage system and has a particular data structure. The data transform component may also perform analytics on the data based on the data structure. For example, different data sets that are dependent, e.g. related via association with the same application or type of application, or which are typically accessed in temporal proximity, can be discovered based on data structure and analytics. Data relationships may be used to prepare dependent data for access in advance of an IO associated with that dependent data.

Transforming dark data

Embodiments are described for detecting a data organization issue in a storage system by analyzing static and dynamic layout characteristics for data stored in the storage system, workload characteristics for applications utilizing the data, virtualization effects of the storage system on the organization of the data, input/output characteristics of processes storing the data in the storage system, and cache usage characteristics of the data. For fragmentation issues, the system uses the analysis to provide defragmentation advisories to reduce fragmentation by at least one of: re-layout or re-tiering of the data in the data storage system, or cache memory reconfiguration.

Metadata analytics for online fragmentation detection on Unix file systems and common block file systems

Techniques are disclosed for managing workloads across a distributed virtual infrastructure. In one example, a method comprises the following steps. Information is collected relating to services offered by service providers across a multi cloud environment implemented in accordance with a distributed virtual infrastructure. A service capability model is maintained based on the collected information. Service level claim conformance is validated for the services offered by the service providers. One or more recommendations are generated based on the collecting, maintaining and validating steps for presentation to a subscriber to assist in management of one or more workloads across the multi cloud environment.

Workload management in multi cloud environment

A system includes a metadata monitor configured to discover and manage metadata associated with a plurality of data protection mechanisms distributed and operating throughout a computing platform, and metadata representing a schema of the computing platform and one or more user applications executed thereon. The system also includes a data protection analytics manager comprising a set of one or more data protection analytics applications configured to determine, from the metadata, which resources are and are not protected by the plurality of data protection mechanisms. For the protected resources, the data protection analytics applications are configured to compute an effectiveness value, and for the non-protected resources, the data protection analytics applications are configure to compute an exposure value. A data protection model can then be adapted in a data protection mechanism-agnostic manner.

Data protection analytics in cloud computing platform

Large files in a file system are mapped by extents of contiguous indirect blocks in order to reduce the time for read or write access to the large files while allowing allocation of data blocks one at a time. The inode of a file includes an indication of whether file mapping metadata of the file includes either an extent of contiguous indirect blocks or a tree of blocks. In a preferred mapping scheme, an inode contains an array of block pointer entries, and each entry includes a flag indicating whether the block pointer is pointing to either an extent of indirect blocks or a tree of blocks. For sharing of data blocks between files, the block pointer fields of the indirect blocks each contain an ownership flag indicating whether the pointed-to block is shared or not.

Using extents of indirect blocks for file mapping of large files

A method, computer program product, and computing system for grouping storage blocks within a file system into a plurality of storage pools including a free-backed storage pool, a free-unbacked storage pool, and an allocated-backed storage pool. The free-backed storage pool identifies unused storage blocks within the file system that are already associated with physical storage space within a backend storage system. The free-unbacked storage pool identifies unused storage blocks within the file system that are not yet associated with physical storage space within the backend storage system. The allocated-backed storage pool identifies used storage blocks within the file system that are already associated with physical storage space within the backend storage system. A request is received for one or more unused storage blocks within the file system. The request is fulfilled by selecting one or more unused storage blocks identified within the storage pools while prioritizing the selection of unused storage blocks identified within the free-backed storage pool.

System and method for thin provisioning

Described are techniques for creating a snapshot of a distributed file system or a file thereof. The distributed file system includes metadata file systems storing metadata about files in the distributed file system and includes data file systems storing file content data. Quiescing is performed for requests affecting the distributed file system, or a file thereof, for which a snapshot is being created. A snapshot of metadata is obtained. For the distributed file system, this includes a snapshot of each metadata file system. For a file, this includes a snapshot of the file's metadata. A snapshot of file data is obtained. For distributed file systems, this includes a snapshot of each data file system. For a file, this includes a snapshot of the file's data. Unquiescing is performed for requests affecting the distributed file system, or the file thereof, upon successful completion of obtaining snapshots of metadata and file data.

Distributed file system having separate data and metadata and providing a consistent snapshot thereof

Growing community of inventors

South Grafton, MA, United States of America

Sairam Veeraswamy