International Business Machines Corporation

Emc IP Holding Company LLC

Emc Corporation

Stephen Glen Graham

Thomas R Maguire

Dominique Prunier

Steven Michael Miller

James Campbell Colson

John P Field

Jeffrey Mark Nick

Ajamu Akinwunmi Wesley

Stephen James Todd

David Stephen Reiner

Shashwat Srivastav

Mark A O'Connell

Salvatore DeSimone

Peter David Niblett

Stephen L Burbeck

Cornelia R Davis

Eron D Wright

Aaron W Spiegel

Paul R Kingston

Xiaotao Liu

Toufic Boubez

James B Casler

Fonda Jonette Daniels-Barnes

Stephen J Todd

David Louis Kaminsky

Qi Zhang

Robert Anthony Lincourt, Jr

Brian Lee White Eagle

Kathryn Heninger Britton

Kyle Gene Brown

Brent Alan Miller

Cheuk Lam

Sriram Sankaran

Jun Luo

David Ohsie

John Daniel Hushon

Vishrut Shah

Edgar J St Pierre

Mark Douglas Weitzel

John D Hushon, Jr

Jurgen Leschner

Raphaël Aubert

Kenneth Fickie

Maryann Hondo

Matthew L Troutman

Robert M Polansky

Frederic Meunier

Flavio Paiva Junqueira

Harrison Roberts

Alexandre Lemay

Vijay Ganti

Mark Venguerov

Kent Bair

Shankar Jagannathan

Eric Gelinas

A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. Various metadata records formats are supported. Related methods are also described.

Method and apparatus for processing object metadata

Systems and methods are disclosed for efficiently indexing stream data to facilitate full-text search of the stream data. A stream comprises large amount of data, only some of which is deemed useful for full-text search indexing. An administrator can specify an indexing specification for a stream. The indexing specification can specify one or more sub-streams within the stream for indexing, and/or specify one or more time intervals of stream data for indexing. A query against the stream can specify the indexing specification to use to index the stream before returning results for the query. The query can alternatively specify an indexing specification to apply to a previously indexed stream. Full-text search indexes generated using an indexing specification can return results that are more relevant to a user because the results are more narrowly focused than an index of, e.g., the entire stream.

Method and system for indexing and searching data sub-streams

Systems and methods are disclosed for efficiently indexing stream data to facilitate full-text search of the stream data. A stream comprises a plurality of intervals of log data records. An interval of log data records are indexed. The index and log data records for the interval are written to an indexed stream data file. The index for each interval contains pointers to the terms in the log data records for the interval. After a number of intervals of index and log data records have been written, a merge operation can merge the number of intervals of index into a single merged index. The merged index and intervals of log data records are written to the indexed data stream file. A full-text search index is generated by traversing and merging the interval indexes for the data stream.

Use of stream-oriented log data structure for full-text search oriented inverted index metadata

Techniques disclosed herein describe a client and/or server process for managing Information Technology (IT) assets, such as servers and storage devices. The process dynamically generates customized information objects based on subscription requests. A client generates a request for information. The request specifies information associated with a specific managed entity or IT resource. A server that monitors the specific managed entity does not maintain such information in an existing information object. Information associated with the specific managed entity can be performance information, health information, usage information, and the like. A notification manager receives the request and identifies that existing subscription resources don not contain the requested information. The notification manager generates a new information object that contains the requested information, and notifies the client.

Method for dynamically generating information objects based on a restful subscription request

Systems and methods are disclosed for a streaming service generating an aggregation of data streams in response to a query from a client device for data streams matching the query. The aggregation of data streams matching the query is presented to the requesting client as a single virtual stream. The streaming service modifies the virtual stream in real-time by adding data streams matching the query that come online to the virtual stream, or deleting data streams from the virtual stream that go offline. The streaming service can partition the virtual stream if the data flow rate increases above a threshold, and reduce partitions if the data flow rate falls below a threshold. The client device can add or terminate consumer processes in response to changes in the data flow rate and partitioning.

Aggregating streams matching a query into a single virtual stream

An improved technique involves using a systems dynamics model in an information technology (IT) data center in order to determine an optimal distribution of data among data center devices. Along these lines, a data center control server takes measurements of devices across an IT data center over time and compares these measurements to quantities specified in set points (e.g., a service level agreement (SLA)) to produce deviations. The data center control server then inputs the deviations from the set points into a systems dynamics engine that determines a configuration of the devices in the IT data center so that output from the IT data center satisfies a set of constraints, including those specified in the SLA. The data center control server then configures the IT data center devices according to the configuration to send incoming data along the specified data paths.

System modeling of data centers to drive cross domain characterization, automation, and predictive analytics

Example embodiments of the present invention relate to a method, a system, and a computer program product for data analytics. The method includes receiving a plurality of first data streams from respective managed elements in a network and partitioning data of the plurality of first data streams according to an attribute regarding the data into a partitioned second data stream. The partitioned second data stream then may be streamed toward a data analytics platform for consumption by the data analytics platform. In a preferred embodiment, WebSockets are used.

Ingesting data from managed elements into a data analytics platform

A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. A distributed processing job can specify a metadata query to narrow the set of objects returned. Related methods are also described.

Object metadata query with distributed processing systems

A distributed security information and event management system comprises a centralized portion and a plurality of remote portions, with the remote portions being implemented in respective applications within information technology infrastructure. Each of the remote portions comprises one or more remote components inserted into the corresponding application. At least a subset of the remote components of the remote portion are configured for interaction with one or more corresponding centralized components of the centralized portion of the system. The remote components may each be configured to process one or more specified eXtensible Access Control Markup Language (XACML) Obligations or other constructs.

Distributed security information and event management system with application-injected remote components

Methods and apparatus for providing resource quality estimation in a resource sharing platform having a master and resources on slaves. Embodiments include storing resource performance data for the resources and estimating resource performance using the stored performance data. A framework can use the estimated resource performance data to select between a first resource offer and a second resource offer, which can be equivalent.

Methods and apparatus for a resource sharing platform having resource quality estimation

An object storage system having object metadata query capability. Clients can pose queries to the object system in a high-level, declarative language. A query is evaluated against stored object metadata, and only objects satisfying the query's predicates are returned. The object storage system can evaluate alternative logical and physical query plans using a cost model. Queries can be posed using familiar REST-based APIs. The object storage system includes a distributed key-value store for secondary indexing of object metadata. A user can define secondary indexes considering the most common object access patterns.

Object metadata query with secondary indexes

An object storage system having object metadata query capability. Clients can pose queries to the object system in a high-level, declarative language. A query is evaluated against stored object metadata, and only objects satisfying the query's predicates are returned. The object storage system can evaluate alternative logical and physical query plans using a cost model. Queries can be posed using familiar REST-based APIs.

Object metadata query

Example embodiments of the present invention provide a method and a system for using consistent-hashing to ensure proper sequencing of message processing in a scale-out environment. The method includes receiving a stream of a plurality of messages and performing a consistent-hash on each message of the plurality of messages. Each message then may be distributed toward a respective downstream worker of a plurality of downstream workers for processing according to results of the hash.

Method and apparatus for using consistent-hashing to ensure proper sequencing of message processing in a scale-out environment

A multi-tenancy adapter is configured to provide an interface between a plurality of tenants and a service provider product that is shared by those tenants. The multi-tenancy adapter in one embodiment comprises a plurality of tenant-specific mashup functions or other service composition functions associated with respective ones of the plurality of tenants. In conjunction with receipt of a service request from a given one of the plurality of tenants, the multi-tenancy adapter generates a corresponding request directed to the product, applies the particular service composition function associated with the given tenant in order to filter response information received back from the product in a manner specific to that tenant, and provides the filtered response information to the given tenant.

Adapting service provider products for multi-tenancy using tenant-specific service composition functions

Growing community of inventors

Chapel Hill, NC, United States of America

Stephen Glen Graham