Oracle International Corporation

Sap Se

Negar Koochakzadeh

Nipun Agarwal

Sam Idicula

Nitin Kunal

Cagri Balkesen

Thomas Chang

Seema Sundara

Jian Wen

Alexei Potiagalov

Farhan Tauheed

Aarti Basant

Techniques for non-power-of-two partitioning of a data set as well as generation and selection of partition schemes for the data set. In an embodiment, one or more iterations of a partition scheme is for a non-power-of-two number of partitions. Extended hash partitioning may be used to partition a data set into a non-power-of-two number of partitions by determining the partition identifier of each tuple of the data set using the extended hash partitioning algorithm. In an embodiment, multiple partition schemes are generated for multiple data sets, based on properties of the data sets and/or availability of computing resources for the partition operation or the subsequent operation to the partition operation. The generated partition schemes may use non-power-of-two partitioning for one or more iterations of a generated partition scheme. The most optimal partition scheme may be selected from the generated partition schemes based on optimization policies.

Efficient partitioning of relational data

A system includes reception, at a first computing node in a cluster of computing nodes, of a request to subscribe to a first message queue of a messaging middleware software component, determination, at the first computing node, of a preferred number of computing nodes of the cluster of computing nodes to listen to the first message queue, determination, at the first computing node and based on data stored in a shared database accessible to each computing node of the cluster, a current number of computing nodes of the cluster which are listening to the first message queue, and, based on a difference between the preferred number and the current number, sending one or more requests to the messaging middleware software component to associate one or more of the computing nodes of the cluster with the first message queue.

Rest gateway for messaging

Techniques are described herein for grouping of operations in local memory of a processing unit. The techniques involve adding a first operation for a first leaf operator of a query execution plan to a first pipelined group. The query execution plan includes a set of leaf operators and a set of non-leaf operators. Each leaf operator of the set of one or more leaf operators has a respective parent non-leaf operator and each non-leaf operator has one or more child operators from among the set of leaf operators or others of the set of non-leaf operators. The techniques further involve determining a memory requirement of executing the first operation for the first leaf operator and executing a second operation for the respective parent non-leaf operator of the first leaf operator. The output of the first operation is input to the second operation. The techniques further involve determining whether the memory requirement is satisfied by an amount of local memory. If it is determined that the memory requirement is satisfied by the amount of local memory the second operation for the respective parent non-leaf operator is added to the first pipelined group. The techniques further involve assigning the first pipelined group to a first thread and the first thread executing the first pipelined group. Executing the first pipelined group involves: storing first output of the first operation in the local memory of the first thread; using the first output as input for the second operation; storing second output of the second operation in the local memory; and moving second output from the local memory to a tier of memory different than the local memory relative to the first thread.

Dynamic grouping of in-memory data processing operations

Growing community of inventors

Vancouver, Canada

Negar Koochakzadeh