International Business Machines Corporation

John Frederic Miller

Scott David Lashley

Raghupathi Keshava Murthy

Marco Greco

Sitaram Vemulapalli

Lynette D Adayilamuriyil

Clarence Madison Pruet, Iii

Daniel Alan Wood

According to embodiments of the present invention, machines, systems, computer-implemented methods and computer program products are provided for converting part or all of a document from an unstructured format into a structured format, and combining structured and unstructured data into an unstructured format. In some embodiments, documents are received in an unstructured format, and stored in a repository for querying (e.g., including updating and other operations (e.g., SQL SELECT, UPDATE, INSERT, DELETE, MERGE, etc.)). Responsive to detecting a predetermined number of the documents in an unstructured format stored in a repository for querying, an optimization criteria may be applied to identify one or more components of the stored documents for conversion, and the one or more components of the stored documents are converted from the unstructured format to a structured format.

Converting portions of documents between structured and unstructured data formats to improve computing efficiency and schema flexibility

Provided are techniques for cyclic based data partitioning policy with automatic physical schema management. A data partitioning policy for data is received, wherein the data partitioning policy identifies a condition for automatically implementing the data partitioning policy and criteria for modifying a set of partitions. In response to the condition occurring, the data partitioning policy is automatically applied to select at least one partition from the set of partitions based on the criteria. An operation is performed on the at least one partition to modify the set of partitions.

Policy based automatic physical schema management

Provided are techniques for building an undo log for in-memory blocks of data. Permission on a block of data in memory is set to prevent updates to that block of data using a memory protection function. In response to an update operation attempting to update the block of data in the memory, an interrupt with a location of the block of data is received, the block of data is copied to an undo log entry in an undo log, and the permission on the block of data in the memory is set to allow the update to that block of data to proceed using the memory protection function.

Building an undo log for in-memory blocks of data

A partial-blocking consistency point system identifies transaction updates with a consistency point ID associated with a consistency point sequence number, records consistency point data that identify a location of the partial-blocking consistency point, flushes to a non-volatile storage the transaction updates identified with the consistency point sequence number without blocking transaction activity, and hardens to the non-volatile storage the recorded partial-blocking consistency point so that data associated with the recorded partial-blocking consistency point can be recovered. The consistency point sequence number is incremented each time the partial-blocking consistency point is recorded to uniquely identify the partial-blocking consistency point and transaction updates associated with the partial-blocking consistency point. The transaction updates identified with the consistency point sequence number are processed to improve efficiency of the flushing of the transaction updates.

Growing community of inventors

Lake Oswego, OR, United States of America

John Frederic Miller