Emc IP Holding Company LLC

Emc Corporation

Dell Products Inc.

Other

Emc Coropration

Jean-Pierre Bono

Philippe Armangau

William C Davenport

Himabindu Tummala

Walter Forrester

Miles Aram De Forest

Marc A De Souter

Christopher Alan Seibel

Frederic Corniquet

Sudhir Srinivasan

Sitaram D Pawar

Sairam Veeraswamy

Ye Zhang

Srinivasa Rao Vempati

Yubing Wang

Morgan A Clark

Assaf Natanzon

Dennis Thomas Duprey

Alexander S Mathews

Yingchao Zhou

Xiangping Chen

Adrian Michaud

Michal Marko

Karl M Owen

John Michael Hayden

Michael Scheer

Sachin Mullick

Uresh K Vahalia

Ahsan Rashid

Yining Si

Dixitkumar Vishnubhai Patel

Marc DeSouter

Qi Mao

Michael D Schouten

Marshall Hansi Wu

Xiaoye Jiang

Nagasimha G Haravu

Rohit K Chawla

Mark K Ku

Monica Chaudhary

Yaming Kuang

Pranit Sethi

Thomas Fridtjof Dahl

Scott W Keaney

Ivan Bassov

David W Harvey

Doron Tal

Peter C Bixby

John Forecast

Ming Yang

Bruce E Caram

Xianlong Liu

Alexander Daniel

Dixit Patel

Yunfei Chen

Henry Hao Fang

James O Owens

Sorin Faibish

Gaurav Chawla

Jimmy Doyle Pike

Walter A O'Brien, Iii

Adnan Sahin

Uday K Gupta

John S Harwood

Dmitry Nikolayevich Tylik

Shyamkumar Thiyagarajan Iyer

Robert Anthony Lincourt, Jr

Feng Zhang

Daniel E Cummins

Wai Chuen Yim

Jonathan I Krasner

Milena Bergant

Chao Zheng

Ivan Basov

Douglas L Farley

Sergey Alexandrovich Alexeev

Jiannan Zheng

Ajay Potnis

Alexey Vladimirovich Shusharin

Anurag Bhatnagar

Christopher H Stacey

Hongliang Tang

Samuel L Mullis, Ii

Yuanyang Wu

Ruiling Dou

Mukesh Gupta

John F Gillono

Chakib Ouarraoui

William C Whitney

Matthew H Fredette

Jia Zhai

Diane Delgado

Kamakshi Viswanadha

Saurabh Ramchandra Godbole

Changyong Yu

Kumari Bijayalaxmi Nanda

Raymond Angelone

Suchitra Raman

Santosh PasulaReddy

Weigang Zhong

Committing of mappings and data lock transitioning associated with files can be performed and managed. Regarding a write operation to write a file portion to a node of a node network, network management component (NMC) can analyze write stream value associated with file portion and write stream-related index value associated with the file, where write stream-related index values can be associated with tracks of a track table. Based on the analyzing, NMC can determine whether a file access pattern associated with file portion is sequential or random; and, if sequential, whether there is an overflow condition associated with the track table. If sequential, and an overflow condition exists, NMC can commit, to data store, a mapping of another file portion associated with another stored stream value stored in track table, and/or transition exclusive data lock to shared data lock with respect to the other file portion.

Detecting sequential file access

A method for managing composed information handling systems to perform workflows. The method includes obtaining a first request for data from a system control processor to perform a first portion of a workflow; making a first determination that the first request is associated with a first change of the data; performing first transformations on the data based on the first request to obtain first transformed data; providing the first transformed data to the system control processor; obtaining a second request for the data from the system control processor to perform a second portion of the workflow; making a second determination that the second request is associated with a second change of the data; performing second transformations on the data based on the second request to obtain second transformed data; and providing the second transformed data to the system control processor.

Method and system for performing data management services for composed information handling systems

In general, embodiments relate to a method for storing data, the method comprising generating, by a memory hypervisor module executing on a client application node, at least one input/output (I/O) request, wherein the at least one I/O request specifies a location in a storage pool and a physical address of the data in a graphics processing unit (GPU) memory in a GPU on the client application node, wherein the location is determined using a data layout, and wherein the physical address is determined using a GPU module and issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the data being stored at the location.

Methods and systems for storing data in a distributed system using GPUS

A method for securing data, the method including obtaining, from a metadata node and by file system (FS) client executing on a client application node, a data layout and an encryption key, encrypting, by the client application node, the data stored on the client application node using the encryption key to obtain encrypted data, generating, by a memory hypervisor module executing on the client application node, at least one input/output (I/O) request, wherein the at least one I/O request specifies a location in a storage pool, wherein the location is determined using the data layout, and issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the encrypted data being stored at the location.

Methods and systems for securing data in a distributed storage system

In general, embodiment relate to a method for provisioning a plurality of client application nodes in a distributed system using a management node, the method comprising: creating a file system in a namespace; associating the file system with a scale out volume; mounting the file system on a metadata node in the distributed system, wherein mounting the file system comprises storing a scale out volume record of the scale out volume; storing file system information for the file system in a second file system on the management node, wherein the file system information specifies the file system and the metadata node on which the file system is mounted; wherein storing the file system information triggers distribution of the file system information to at least a portion of a plurality of client application nodes.

Methods and systems for seamlessly provisioning client application nodes in a distributed system

A method for managing client resources by receiving a desired load factor representing the number of instructions being executed per second (IOPS) to implement an application on a set of cores of a client device, based on the desired load factor and a latency factor, determining a maximum number of IOPS that can be executed by the cores of the client device before reaching system saturation, determining a pattern of the IOPS being executed on the set of cores based on historical IOPS information for the latency factor, and based on the historical IOPS information, determining to execute the IOPS on a subset of the set of cores.

Greener software defined storage stack

A method for storing data, the method comprising receiving, by an offload component in a client application node, an augmented write request originating from an application executing in an application container on the client application node, wherein the augmented write request is associated with data and wherein the offload component is located in a hardware layer of the client application node, and processing, by the offload component, the augmented write request by a file system (FS) client and a memory hypervisor module executing in a modified client FS container on the offload component, wherein processing the request results in at least a portion of the data being written to a location in a storage pool.

Methods and systems for storing data in a distributed system using offload components and a GPU module

A method for processing requests, the method comprising: receiving, from a client application node and by a metadata node, a request for a data layout, determining a QoS tag associated with the request, identifying at least one file system block (FSB) in a sparse virtual space, wherein the FSB is mapped to a location in a storage pool that is associated with the QoS tag, generating the data layout based on the at least one identified FSB; and providing the data layout to the client application, wherein the client application node uses the data layout to directly write data to the location in the storage pool, wherein the metadata node does not participate in the writing of the data to the location in the storage pool.

Methods and systems for seamless tiering in a distributed storage system

A method for storing data, the method comprising receiving, by an offload component in a client application node, a request originating from an application executing in an application container on the client application node, wherein the request is associated with data and wherein the offload component is located in a hardware layer of the client application node, and processing, by the offload component using an advanced data services pipeline, the request by a file system (FS) client and a memory hypervisor module executing in a modified client FS container on the offload component, wherein processing the request results in at least a portion of the data in a location in a storage pool.

Methods and systems for storing data in a distributed system using offload components with advanced data services

A method for processing requests includes receiving a request to write data, in response to the request, identifying a sparse virtual space segment using an available space tracking metadata hierarchy, and initiating writing of the data to a physical segment, wherein the physical segment is associated with the sparse virtual space segment.

Methods and systems for allocating free space in a sparse file system

A method for storing data, comprising: obtaining, from a metadata node and by file system client executing on a client application node, a data layout, generating, by the client application node, an error detection value (EDV) for the data stored on the client application node; generating, by a memory hypervisor module executing on the client application node, at least one input/output (I/O) request specifying a location in a storage pool, wherein the location is determined using the data layout; issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the data being stored at the location; and after issuing the at least one I/O request to the storage pool, transmitting the EDV to the metadata node, wherein the metadata node stores the EDV.

Methods and systems for error detection and correction in a distributed storage system

In general, embodiments relate to a method for distributing topology information to client application nodes in a distributed system, the method comprising: creating a file system on a management node, enabling a plurality of client application nodes to access the file system on the management node, obtaining a topology file, wherein the topology file comprises information about a plurality of storage devices to enable the plurality of client application nodes to issue input/output (IO) requests directly to the plurality of storage devices, and storing, by the management node, the topology file in the file system, wherein the topology file is accessible to the plurality of client application nodes once the topology file is stored in the file system.

Methods and systems for distributing topology information to client nodes

A method for deduplicating data comprising: obtaining, from a metadata node and by file system client executing on a client application node, a data layout; generating, by the client application node, a fingerprint for the data stored on the client application node; generating, by a memory hypervisor module executing on the client application node, at least one input/output (I/O) request specifying a location in a storage pool, wherein the location is determined using the data layout; issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the data being stored at the location; and after issuing the at least one I/O request to the storage pool, transmitting the fingerprint to the metadata node, wherein the metadata node attempts to deduplicate the data using the fingerprint.

Methods and systems for methods and systems for in-line deduplication in a distributed storage system

A method for storing data, the method comprising receiving, by an offload component in a client application node, a request originating from an application executing in an application container on the client application node, wherein the request is associated with data and wherein the offload component is located in a hardware layer of the client application node, and processing, by the offload component, the request by a file system (FS) client and a memory hypervisor module executing in a modified client FS container on the offload component, wherein processing the request results in at least a portion of the data in a location in a storage pool.

Methods and systems for storing data in a distributed system using offload components

A method for rebuilding data, comprising: obtaining, from a metadata node, a source file data layout for a source file and a target file data layout for a target file, wherein the source file is associated with a degraded mapped RAID group and the target file is associated with a new mapped RAID group; generating, by the client application node, a plurality of input/output (I/O) requests to read a portion of the data associated with the source file using the source file data layout; obtaining, in response to the plurality of I/O requests, the portion of the data associated with the source file; rebuilding a second portion of the data associated with source file using the portion of the data; and initiating, storage of at least the second portion of the data associated with the source file in the storage pool using the target file data layout.

Methods and systems parallel raid rebuild in a distributed storage system

Growing community of inventors

Westborough, MA, United States of America

Jean-Pierre Bono