Amazon Technologies, Inc.

Zhuonan Song

Daniel Opincariu

Baosheng Wang

Miradham Kamilov

Systems, devices, and methods are provided for incremental partition updates. In at least one embodiment, indexing Bloom filters and incremental update Bloom filters are utilized to identify a set of candidate partitions of a distributed data set, such as in the context of a data lake. Queries may be processed using these candidate partitions.

Incremental partition index update using bloom filters

Systems, devices, and methods are provided for efficient query execution on distributed data sets, such as in the context of data lakes. In at least one embodiment, indexing information is used to identify candidate and non-candidate portions of a data set. Non-candidate portions may be irrelevant to the query. Indexing information can be encoded using Bloom filters.

Growing community of inventors

Bellevue, WA, United States of America

Zhuonan Song