Pivotal Software, Inc.

Emc Corporation

Alon Goldshuv

Matthew Clark McCline

Dov Yaron Dorin

Luke Lonergan

Alex Shacked

Jeffrey Ira Cohen

Milena Bergant

John Glenn Eshleman

Kurt Harriman

Caleb E Welton

King Lun Choi

Noa Horn

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for streaming external data in parallel from a second distributed system to a first distributed system. One of the methods includes receiving a query that requests a join of first rows of a first table in a first distributed system with second rows of an external table, the external table representing data in a second distributed system. Each of the segment nodes communicates with a respective extension service that obtains fragments from one or more data nodes of the second distributed system according to location information for the respective fragments, and provides to the segment node a stream of data corresponding to second rows of the external table. Each of the segment nodes computes joined rows between the first rows of the first table and the stream of data corresponding to second rows of the external table.

Parallel streaming of external data

Coarse-grained system-wide database privileges are transformed into new finer-grained database object privileges that are user-centric and specific to particular objects by creating an object class defining certain generic operations on objects, and defining within the object class a new object that embodies permissible actions on a particular database object. The new object is stored in a catalog table that comprises an object privilege table and is associated in the object privilege table with a consolidated grouping of object privileges of users relative to the new object.

Method of transforming database system privileges to object privileges

A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.

Apparatus and method for read optimized bulk data storage

A method, article of manufacture, and apparatus for recovering databases. In some embodiments, this includes switching an active segment to a resynchronization mode, receiving a change tracking log, determining a data block based on the change tracking log, and resynchronizing the determined data block with a non-active segment. In some embodiments, writes performed on the active segment are synchronized with the non-active segment.

Resynchronization of nonactive and active segments

Formatting data is disclosed. An indication of a specified data to be formatted between a format of a database and a format external to database is received. A formatter of the database is used to format the specified data between the format of the database and the format external to the database. The formatter has been integrated with the database using a formatter code defined external to the database.

Custom user parallel data import and export

A method, article of manufacture, and apparatus for recovering databases. In some embodiments, this includes switching an active segment to change tracking mode, intercepting write related changes on the active segment while in the change tracking mode, populating a change tracking log based on the intercepted write related changes, and storing the populated change tracking log in a storage device. In some embodiments, the storage device is memory. In some embodiments, the change tracking log if flushed from memory to disk.

Growing community of inventors

Tel Aviv, Israel

Alon Goldshuv