Snowflake Inc.

Eric Robinson

Nithin Mahesh

Robert Bengt Benedikt Gernhardt

Benoit Dageville

Martin Hentschel

Subramanian Muralidhar

Mikhail Kazhamiaka

Sahaj Saini

Damien Carru

Prasanna V Krishnan

Shreyas Narendra Desai

German Alberto Gil Echeverri

Rodney Weaver

Pui Kei Johnston Chu

Lin Chan

Tianyi Chen

David Schultz

Jun Luo

Brian Smith

Kristopher Wagner

Yiming Kang

Shigeyuki Takeda

Thierry Cruanes

Khalid Zaman Bijon

Simon Holm Jensen

Daniel N Meredith

Zixi Zhang

Jennifer Wenjun Bi

A method of implementing sub-table replication starts with the processor detecting an update to an entitlements table. The processor performs filtering of a data table based on the update to the entitlements table. The data table including an entitlements column. The processor detects an update to the entitlements column and performs incremental replication of the data table by causing a version-based replication to be executed. Other embodiments are also described herein.

System for list-based database replication

Systems of methods of directing requests to databases based on client account association is disclosed. A method includes determining a first client account associated with a first request to perform a first transaction. The method includes determining a second client account associated with a second request to perform a second transaction. The method includes selecting, for the first request, a primary deployment that stores a first dataset responsive to determining the first client account associated with the first request. The method includes selecting, for the second request, a secondary deployment that stores a second dataset that includes the first dataset responsive to determining the second client account associated with the second request. The method includes executing, while the primary deployment and the secondary deployment are both available, the first transaction on the first dataset at the primary deployment and the second transaction on the second dataset at the secondary deployment.

Directing requests to databases based on client account association

Replication and failover of data is disclosed. A method includes replicating the data stored in a primary deployment such that the data is further stored in a secondary deployment. The method includes executing one or more transactions on the data at the primary deployment to cause a change to the data to be stored in the primary deployment. The method includes propagating the one or more transactions on the data to the secondary deployment to perform a failover to the secondary deployment while the change to the data is absent from the secondary deployment.

Data replication and data failover in data storage systems

As described herein, a N-Gram index may be created and the search may be conducted using the index, which will lead to faster search results. The N-Gram index may also include partial N-Gram components to capture more relevant data. Moreover, as described herein, the search may also take into account recent log data that has not yet been indexed. Techniques for building an index store using log data and efficiently searching the index store and log data to process search requests are described herein.

Metadata search via N-gram index

Techniques for creating, sharing, and using bundles (also referred to as packages) in a multi-tenant database are described herein. A bundle is a schema object with associated hidden schemas. A bundle can be created by a provider user and can be shared with a plurality of consumer users. The bundle can be used to enable code sharing and distribution without losing control while maintaining security protocols.

Bundle creation and distribution

Methods and systems of managing database failure based on transaction request time is disclosed. A method includes copying a first dataset stored in a primary deployment to a secondary deployment to generate a second dataset. The method includes determining a first arrival time of a first request to perform a first transaction. The method includes determining a second arrival time of a second request to perform a second transaction. The method includes executing the first transaction on the first dataset at the primary deployment in response to determining the first arrival time of the first request to perform the first transaction. The method includes executing the second transaction on the second dataset at the secondary deployment in response to determining the second arrival time of the second request to perform the second transaction.

Managing database failover based on transaction request time

Replication and failover of database data is disclosed. A method includes replicating database data stored in a primary deployment such that the database data is further stored in a secondary deployment. The method includes executing one or more updates to the database data at the secondary deployment when the primary deployment is unavailable and propagating the one or more updates to the primary deployment when the primary deployment becomes available again. The method includes executing queries on the database data at the primary deployment when the primary deployment is available.

Data replication and data failover in database systems

Different database deployments, or other data system deployments, may want to communicate with each other without sacrificing security or control. To this end, embodiments of the present disclosure may provide secure message exchange techniques for a source and/or target deployment. Configurable rule sets may be stored in the deployments; the rule sets may define what messages may be communicated between deployments. The deployments may implement a selective filtering scheme in one or more stages based on the rule sets to filter outgoing and/or incoming messages.

Secure message exchange between deployments

A system for sub-table replication within a materialized view of a source data table. A materialized view of a source data table is generated based on a query, the source data table having a plurality of data table rows associated with a plurality of client identifiers and including an entitlements column and data content, the entitlements column including a plurality of provider account identifiers and a plurality of consumer account identifiers. An update to an entitlements table of the source data table is detected where the entitlements table includes a plurality of entitlements table rows and where the entitlements table rows are associated with the client identifiers, the consumer account identifiers, and the provider account identifiers. An update to the source data table based on the first update to the entitlements table is detected, and an incremental replication of the materialized view of the source data table is performed.

Materialized view sub-database replication

Techniques for executing show commands are described herein. A plurality of navigation steps is utilized, each navigation step corresponding to a different layer in a database structure and each navigation step including an operator to fetch items from a metadata database up to respective bounded limits. Dependency information is also fetched for objects of the specified object type in the show command. After a set of objects from the last layer are processed, memory for the navigation steps is flushed and the next set of objects are processed.

Catalog query framework on distributed key value store

A method includes selecting, by at least one hardware processor of a first database deployment, data for transmission to a second database deployment. The data includes a plurality of files forming a data stream. At least a first file of the plurality of files is encoded using a first encryption key which is stored in at least a second file of the plurality of files. The at least a first file is further encoded to include a second encryption key associated with at least a third file of the plurality of files. A set of nodes is identified in a virtual private network connected to the first and second database deployments. The data stream is transmitted from the first database deployment to the second database deployment via the set of nodes of the virtual private network that is connected to the first database deployment and the second database deployment.

Virtual network replication using staggered encryption

Systems and methods for generating transient object references are provided. The systems and methods perform operations including establishing a session between a first entity and a second entity. The operations include identifying an object that the first entity is authorized to access according to a first set of access privileges. The operations include generating a reference associated with the object. The operations include temporarily authorizing the second entity to access the object using the reference according to a second set of access privileges, the second set of access privileges being derived from the first set of access privileges.

Growing community of inventors

Sammamish, WA, United States of America

Eric Robinson