Yahoo! Inc.

Verizon Patent and Licensing Inc.

Hewlett-packard Development Company, L.P.

Excalibur Ip, LLC

Lee Rhodes

Anirban Dasgupta

Kevin John Lang

Edward Bortnikov

Idit Keidar

Eshcar Hillel

Alexander Spiegelman

The present teaching relates to a method and system generating a data sketch. A plurality of local data sketches are generated, wherein for each local data sketch, it is determined whether a propagation condition is satisfied. In response to the condition being satisfied, the local data sketch is processed when a synchronization parameter satisfies a criterion. The synchronization parameter is set to a predetermined value to enable propagation of the local data sketch to the data sketch. Upon the local data sketch being propagated to the data sketch, the above steps are repeated.

Method and system for concurrent generation of data sketches

The present teaching relates to a system and method for providing a response to a query related to a data sketch. A local data sketch is obtained in response to a synchronization parameter being set to a first value. The data sketch is updated based on the obtained local data sketch. The synchronization parameter is set to a second value that is different than the first value and thereafter propagated. A response to a query is generated based on the updated data sketch.

Techniques are provided for improving the accuracy of analytics on big data using sketches and fixed-size buckets. In a technique for enhancing a unique count (cardinality) estimate of a large data set, a request for a cardinality estimate for the large data set is received. An initial cardinality estimate is determined using a sketch or a fixed-size bucket. If the initial cardinality estimate is within a range where the initial estimate could be further enhanced, the initial estimate is used for a lookup into a lookup table. Based on retrieved values from the lookup table and the initial estimate, an enhanced cardinality estimate is calculated.

System and method for enhanced accuracy cardinality estimation

Techniques are provided for improving the speed and accuracy of analytics on big data using theta sketches, by converting fixed-size sketches to theta sketches, and by performing set operations on sketches. In a technique for performing a set operation, two sketches are analyzed to identify the maximum value of each sketch. The maximum values of the two sketches are compared. Based the comparison, one or more values are removed from the sketch whose maximum value is greater. After the removal, a set operation (e.g., union, intersection, or difference) is performed based on the modified sketch and the unmodified sketch. A result of the set operation is a third sketch, which may be used to estimate a cardinality of the larger data sets that are represented by the two input sketches.

System and method for performing set operations with defined sketch accuracy distribution

A system and method is provided herein for detecting congested locations within a network. The method includes receiving a stream of UDRs from one or more observation points within the network. The method further comprises computing an amount of bandwidth utilized by each UDR as each UDR is received from the observation point, generating a statistical distribution of the UDRs based on the amount of bandwidth utilized by each UDR, and analyzing the statistical to detect a congested location associated with the observation point.

Growing community of inventors

Los Altos, CA, United States of America

Lee Rhodes