Paypal, Inc.

Hewlett-Packard Development Company, L.p.

Ebay, Incorporated

Entit Software LLC

Bin Yu

Sergiy Pereshyvaylo

Aswani Kumar Raveendran Nair

Sudheendra Vasudeva Murthy

Wei T Huang

Yizheng Zhou

Wenting Tang

Christian Friedrich Beedgen

Wei Huang

A method and a system to provide daisy chain distribution in data centers are provided. A node identification module identifies three or more data nodes of a plurality of data nodes. The identification of three or more data nodes indicates that the respective data nodes are to receive a copy of a data file. A connection creation module to, using one or more processors, create communication connections between the three or more data nodes. The communication connections form a daisy chain beginning at a seeder data node of the three or more data nodes and ending at a terminal data node of the three or more data nodes.

Daisy chain distribution in data centers

In some examples, a set of events is received. A row-based chunk includes the set of events and metadata about the set of events is generated, and a column-based chunk that includes metadata about the set of events and, for each event in the set of events, a value of a first field of the multiple fields. The metadata about the set of events includes at least one of a minimum value or a maximum value of the first field over the events in the set of events.

Generating row-based and column-based chunks

A logging system includes an event receiver and a storage manager. The receiver receives log data, processes it, and outputs a column-based data 'chunk.' The manager receives and stores chunks. The receiver includes buffers that store events and a metadata structure that stores metadata about the contents of the buffers. Each buffer is associated with a particular event field and includes values from that field from one or more events. The metadata includes, for each 'field of interest,' a minimum value and a maximum value that reflect the range of values of that field over all of the events in the buffers. A chunk is generated for each buffer and includes the metadata structure and a compressed version of the buffer contents. The metadata structure acts as a search index when querying event data. The logging system can be used in conjunction with a security information/event management (SIEM) system.

Storing log data efficiently while supporting querying

A query pipeline is created () from a query request. The query pipeline includes multiple query operations including multiple query operators. A first query operator and a second query operator perform first and second query operations on a database () and on data outside the database (). A result from the first query operation in the query pipeline is fed to the second query operation in the query pipeline.

Query pipeline

Growing community of inventors

San Ramon, CA, United States of America

Bin Yu