Pivotal Software, Inc.

Emc Corporation

Gopivotal, Inc.

Matthew Clark McCline

Milena Bergant

Alon Goldshuv

Jeffrey Ira Cohen

Kurt Harriman

John Glenn Eshleman

Luke Lonergan

In a mirrored database system, a careful write of intentions to perform file system actions is recorded in a persistent file system objects table that is flushed to disk prior to the actions being taken. The table durably and accurately records identities of file system objects that were in use by the database to facilitate creation and deletion of physical file directories and files on a database during crash recovery and during mirror resynchronize. In the event of a failure, crash recovery may quickly and easily identify file system objects which need to be cleaned up by reference to the persistent file system objects table. Similarly, resynchronization of the mirror database can be performed quickly by referring to the persistent file system table data to detect changes since the last database checkpoint.

Persistent file system objects for management of databases

In a database cluster comprising a plurality of mirrored database segments, a mirror database pair comprising a primary database and a mirror database are maintained substantially consistent by writing changes resulting from transactions to page data in parallel to the primary database and to the mirror database. Changes are sent to the mirror database over a network using network communications. Transaction logs are also written to the primary and mirrored databases in parallel, the transaction logs being sent to the mirror database using network communications. Bulk load changes resulting from transactions are written in parallel over the network to the primary database and the mirror database without writing the changes to a transaction log. In the event of a failure, resynchronization of the mirror database can be performed quickly while avoiding a lengthy ongoing redo process on the mirror database.

Parallel database mirroring

A CaQL API is provided by receiving a query directed to a catalog that includes metadata. A catalog access target is determined based at least in part on one or more of the following: a CaQL keyword which is included in the query, a name of a table in the catalog which is included in the query, or a predicate which is included in the query. A catalog function is generated based at least in part on the CaQL keyword and the catalog function is performed on the catalog access target.

Simplified query language for accessing metadata

In a mirrored database system, mirror resynchronization of bulk load and append-only tables during ongoing transactions is optimized for quick repair and high availability by catching up any changes to primary database tables that have not been made to mirror database tables during the transaction itself, and making changes due to ongoing transactions when the databases are synchronized to the resynchronization process.

Mirror resynchronization of bulk load and append-only tables during online transactions for better repair time to high availability in databases

In a mirrored database system, a careful write of intentions to perform the system actions is recorded in a persistent file system objects table that is flushed to disk prior to the actions being taken. The table durably and accurately records identities of file system objects that were in use by the database to facilitate creation and deletion of physical file directories and files on a database during crash recovery and during mirror resynchronize. In the event of a failure, crash recovery may quickly and easily identify file system objects which need to be cleaned up by reference to the persistent file system objects table. Similarly, resynchronization of the mirror database can be performed quickly by referring to the persistent file system table data to detect changes since the last database checkpoint.

In a mirrored database system, mirror resynchronization of fixed length pages is optimized for quick repair and high availability by identifying those lost page changes that must be made for resynchronization and ignoring other duplicate changes. Essential pages are identified using log sequence numbers (LSNs) to locate the most current version of a changed page, and other lower valued LSNs of less current versions of that page are eliminated as having changes that are duplicated in the current version of the page. Page changes since the last database checkpoint before losing mirror synchronization and the current LSN of the transaction log are identified as possibly necessary changes to be made.

Mirror resynchnronization of fixed page length tables for better repair time to high availability in databases

A computer readable storage medium includes executable instructions to store load data in new rows of an append only table within a data warehouse, without updating or deleting existing rows in the append only table. The new rows are added in a database transaction that guarantees that the distributed reads and writes of all transactions are processed reliably and that the transactions obey snapshot isolation rules. Data changes associated with the load data are maintained in a separate update table. Data from the append only table is merged with data changes from the update table to supply read data.

Apparatus and method for read optimized bulk data storage

A method, article of manufacture, and apparatus for recovering databases. In some embodiments, this includes switching an active segment to a resynchronization mode, receiving a change tracking log, determining a data block based on the change tracking log, and resynchronizing the determined data block with a non-active segment. In some embodiments, writes performed on the active segment are synchronized with the non-active segment.

Resynchronization of nonactive and active segments

In a mirrored database system, good quality of service and high availability is afforded by minimizing the time required for suspension of operations to transition between mirror states, and by keeping track of changes made to a primary database while the mirror database was out of communications so that a later mirror resynchronization process can quickly catch up the mirror database by making only the lost changes.

Online mirror state transitioning in databases

A method, article of manufacture, and apparatus for recovering databases. In some embodiments, this includes switching an active segment to change tracking mode, intercepting write related changes on the active segment while in the change tracking mode, populating a change tracking log based on the intercepted write related changes, and storing the populated change tracking log in a storage device. In some embodiments, the storage device is memory. In some embodiments, the change tracking log if flushed from memory to disk.

Growing community of inventors

Foster City, CA, United States of America

Matthew Clark McCline