Paraccel LLC

Adam Birnbaum

Raymi Dyskant

Scott Graupmann

David G Wilhite, Jr

Mayank Pradhan

David Benedict Galimberti

Brian Pak-Ning Chu

A database system performs hash join process for processing queries that join an inner and an outer database table. The hash join processes builds a hash table in memory for the inner table. The database system receives a limit on the memory for storing the hash table. The database system maximizes the number of partitions stored in memory for the hash table. If the hash table exceeds the limit of the memory while adding rows from the inner table, the database system selects a partition for spilling to a persistent storage. The partition selected for spilling to may be the largest partition or a partition larger than most of the partitions. The database system initializes the hash table to a number of partitions that is substantially equal to half of the total number of blocks that can be stored within the specified limit of memory for the hash table.

Disk-based hash join process

Data of a columnar database is organized into extents. Each extent occupies contiguous storage on the disk. An extent stores database blocks of a column of a database table. The database system adds new database blocks of a column to the extents assigned to that column. When a request for adding a block to a table is received, the extent for the table and column combination is obtained and the block added to the extent. Prefetching strategies are used to retrieve database blocks in advance of an actual request. The rate of prefetching is determined per column. The rate of prefetching is adjusted based on the number of faults encountered for the column. Database blocks no longer needed in memory are pushed out. When a scan process is reading blocks, as soon as the block has been processed it is scheduled to be pushed out.

Strategies for pushing out database blocks from cache

Management of database blocks

Strategies for prefetching database blocks

Growing community of inventors

La Jolla, CA, United States of America

Adam Birnbaum