Oracle International Corporation

Databricks Inc.

Amazon Technologies, Inc.

Sriram Krishnamurthy

Zhen Hua Liu

Vikas Arora

Beda Christoph Hammerschmidt

Ying Lu

Douglas James McMahon

Geeta Arora

Alexander Behm

Hui Joe Chang

Joshua Jeffrey Spiegel

Srividya Tata

Hui Zhang

Sundeep Abraham

Shoumik Palkar

Srikrishnan Suresh

Alfonso Colunga Sosa

Yannis Papakonstantinou

Gokul Soundararajan

Vuk Ercegovac

George Constantin Caragea

Balakrishnan Narayanaswamy

Adiel Yoaz

Nikolaos Koulouris

Jiayuan Chen

Prashanth Menon

Utkarsh Agarwal

Muralidhar Krishnaprasad

Ying Hu

Seema Sundara

Dinesh Das

Mark Ture

Wesley Lin

Qin Yu

Mostafa Mokhtar

Vishu Krishnamurthy

Sneha Chandrababu

Sunitha Subramanyam

Zhen Liu

Douglas Mcmahon

Disclosed herein is a method, system, or non-transitory computer readable medium for evaluating a query on a columnar dataset comprising one or more dictionaries associated with columns in the dataset. The method includes receiving a request to perform a query comprising at least a operator and a request to return information about a value of interest in a columnar dataset stored on cloud storage. At least one column in the columnar dataset is based on a dictionary. The dictionary maps one or more values for a column to one or more respective identifiers. The method determines whether to perform dictionary filtering for the query by calculating a metric based on one or more factors. Responsive to the metric being below a threshold, which may be predetermined, the method performs the dictionary filtering.

Dictionary filtering and evaluation in columnar databases

Disclosed herein is a method, system, or non-transitory computer readable medium for evaluating a query on a columnar dataset comprising one or more dictionaries associated with columns in the dataset. The method includes receiving a request to perform a query comprising at least an operator for a columnar dataset on cloud storage. At least one column in the dataset is based on a dictionary, and the dictionary maps one or more values for a column to one or more respective identifiers. The method evaluates the operator on one or more values of the dictionary to generate an updated dictionary comprising updated values. The method may decode the updated dictionary into an updated column comprising updated data values.

Evaluating expressions over dictionary data

The present application discloses a method, system, and computer system for parsing files. The method includes receiving an indication that a first file is to be processed, determining to begin processing the first file using a first processing engine based at least in part on one or more predefined heuristics, indicating to process the first file using a first processing engine, determining whether a particular error in processing the first file using the first processing engine has been detected, in response to determining that the particular error has been detected, indicate to stop processing the first file using the first processing engine and indicate to continue processing using a second processing engine, and storing in memory information obtained based on processing the first file by one or more of the first processing engine and the second processing engine.

Scan parsing

Disclosed herein is a method for determining whether to apply a lazy materialization technique to a query run. A data processing service receives a request to perform a query identifying a filter column and a non-filter column in a columnar database. The data processing service accesses a first task of contiguous rows in the filter column from a cloud-based object storage. The data processing service applies a filter defined by the query to the first task. The data processing service generates filter results for the first task that may include a percentage of the first task discarded and a run-time. The data processing service determines, based on the filter results for the first task, a likelihood value that indicates a likelihood of gaining a performance benefit by applying the lazy materialization technique to a second task of the query.

Adaptive approach to lazy materialization in database scans using pushed filters

Herein is a self-tuning database management system (DBMS) storing JavaScript object notation (JSON) documents and operating a JSON datatype as native to the DBMS. In an embodiment, a computer hosts a DBMS that executes a data definition language (DDL) statement that defines, in a database dictionary of the DBMS, a JSON document column of a database table that stores JSON documents as instances of the JSON datatype that is native in the DBMS. The DBMS may autonomously set or adjust configuration settings that control behaviors such as a default width of a JSON document column, in lining or not of the JSON document column, kind and scope and duration of indexing of the JSON document column, and/or caching of the JSON document column such as in an in memory columnar unit (IMCU). The DBMS may use the various configuration settings to control how JSON documents and the native JSON datatype are stored and/or processed.

Technique of efficiently, comprehensively and autonomously support native JSON datatype in RDBMS for both OLTP and OLAP

A database system may use a machine learning model creation system to create a machine learning model from data stored in the database system responsive to a request from a client. The database system may obtain an executable version of the machine learning model, based on an uncompiled hardware agnostic version of the machine learning model, according to the hardware configuration of one or more computing resources selected by the database system to perform requests to the database system that invoke the machine learning model to generate predictions.

Dynamic compilation of machine learning models based on hardware configurations

A database system may include a machine learning model which may be used to perform various data analytics for data stored in the database system. In response to a request to invoke the machine learning model to generate a prediction from data stored in the database system, the database system may perform one or more optimization operations, as part of a query plan, to prepare the data to make it suitable for use by the machine learning model.

Integrating query optimization with machine learning model prediction

Techniques are described herein for leveraging and extending relational data sharding infrastructure to provide comprehensive support for sharding semi-structured and unstructured data, in addition to the relational data, in a single sharded database system. Specifically, techniques are described in which a catalog server pre-gathers all data it needs to answer fetches from a dynamically created temporary lob. In addition, techniques are provided in which a catalog server encodes shard identifiers in lob locators sent to the client. Techniques are provided for pushing down various operators to shard servers.

Handling semi-structured and unstructured data in a sharded database environment

Described are improved systems, computer program products, and methods for an improved approach to access small to medium size objects (MOBs) stored in LOB data type columns of a RDBMS. The approach includes receiving a SQL statement comprising a retrieval of a large object (LOB). The approach also includes determining whether to return a value of the LOB or a reference to a storage location storing the value of the LOB based on: a data dictionary property of the LOB to return the value of the LOB, a function included in the SQL statement to return the value of the LOB, or a flag derived from a SQL operator tree propagation to return the value of the LOB.

Efficiently supporting value style access of MOBs stored in SQL LOB column by providing value based semantics for LOBs in RDBMS

The present invention relates to autonomous tuning of a data grid of documents in a database. Herein are techniques for storage cells to autonomously maintain local indices and other optimization metadata and algorithms to accelerate selective access into a distributed collection of documents. In an embodiment, each storage cell persists a respective subset of documents. Each storage cell stores, in memory, respective index(s) that map each item to location(s), in one or more documents of the respective subset of documents, where the item occurs. One or more computers execute, based on at least a subset of the indices of the storage cells, a data access request from a database management system. In an embodiment, a cloud of JSON document services provides an easy-to-use, fully autonomous JSON document database that horizontally and elastically scales to deliver fast execution of document transactions and queries without needing tuning by a database administrator.

Technique of comprehensively support autonomous JSON document object (AJD) cloud service

Growing community of inventors

San Francisco, CA, United States of America

Sriram Krishnamurthy