Emc IP Holding Company LLC

Eron D Wright

Stephen Glen Graham

Mark A O'Connell

Cui Lin

Vijayaraghavan Srinivasaraghavan

Andrea L Heyda

Erik Riedel

Jimmy K Seto

A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. Various metadata records formats are supported. Related methods are also described.

Method and apparatus for processing object metadata

In one aspect, a method includes determining an allocation of nodes in a cluster to application containers using a node capacity and a policy, publishing the allocation to a coordinator, the coordinator configured to manage the nodes comprising a first node, reading the allocation from the coordinator and instructing a container manager in the first node to generate an application container in the first node conforming to the allocation.

Cluster aware container manager

A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. A distributed processing job can specify a metadata query to narrow the set of objects returned. Related methods are also described.

Object metadata query with distributed processing systems

In one aspect, a method includes associating disk devices with containers based on a policy, allocating a disk device to a container based on the policy and allowing access to the disk device from the container. In another aspect, an apparatus includes electronic hardware circuitry configured to associate disk devices with containers based on a policy, allocate a disk device to a container based on the policy and allow access to the disk device from the container. In a further aspect, an article includes a non-transitory computer-readable medium that stores computer-executable instructions. The instructions cause a machine to associate disk devices with containers based on a policy, allocate a disk device to a container based on the policy and allow access to the disk device from the container.

Growing community of inventors

San Ramon, CA, United States of America

Eron D Wright