Snowflake Inc.

Xinglian Liu

Jiaqi Yan

Benoit Dageville

Thierry Cruanes

Subramanian Muralidhar

Istvan Cseri

Polita Paulus

Nileema Shingte

Marianne Shaw

Muthunagappan Muthuraman

Wai Sing Wong

Selcuk Aya

Marcia Feitel

James Malone

Steven P Herbert

Nithin Mahesh

Varun Ganesh

Yi Fang

Yizhi Zhu

Ryan Michael Thomas Shelly

Dennis Huo

Ronald Lee Ortloff

The subject technology provides embodiments for supporting a unified table which may be a managed table or an unmanaged table. Managed tables are those where the subject technology manages the metastore/catalog for the table, whereas unmanaged tables are tables where an external catalog controls the table and the subject technology integrates with that catalog to work with the table, but does not assume control of the table.

Unified table data access in user-specified formats on internal storage and user-managed storage

The subject technology receives a command to commit a table in a different table format on an external volume. The subject technology generates a first snapshot of the table on internal storage. The subject technology generates a first list of metadata files on the internal storage. The subject technology generates, based on the first list of metadata files, a first set of metadata files on the internal storage. The subject technology generates a second snapshot of the table on the external volume. The subject technology generates a second list of metadata files on the external volume. The subject technology generates, based on the second list of metadata files, a second set of metadata files on the external volume. The subject technology generates a first set of data files in a different file format on the external volume.

Providing table data access in user-specified formats on user-managed storage

Embodiments of the present disclosure describe systems, methods, and computer program products for improving query processing of a database. An example method can include: storing table data for a table in a plurality of micro-partitions, each micro-partition comprising a portion of the table data for the table; for each micro-partition of the plurality of micro-partitions, storing metadata for the micro-partition in at least one of a plurality of expression properties; and selecting, by a processing device, a subset of the plurality of expression properties to be grouped into a grouping expression property based at least partially on the metadata of the subset of the plurality of the expression properties. The grouping expression property may include cumulative metadata associated with the metadata of the subset of the plurality of expression properties.

Metadata clustering

Growing community of inventors

Redmond, WA, United States of America

Xinglian Liu