Framework for nested probabilistic data structures as a service for big data analytics

Abstract

A system may include a nested probabilistic data structure that contains nested tables, each table having electronic records associated with different hash functions. A data analytics engine may receive information about a detected action, including action characteristics. In response to the detected action, insertions are executed into the nested probabilistic data structure at multiple levels based on the action characteristics (each insertion incrementing an entry in the data structure selected using the hash functions). The engine then continues to monitor for detected actions. Upon receipt of a query associated with the monitored action (including a query type), a key and level of nesting associated with the query is determined based on the query type. The hash functions are executed on the determined key to retrieve a value from each electronic record in an appropriate nested table, and a minimum of the retrieved values is output in response to the query.