International Business Machines Corporation

Brian Keith Hoyt

Gregory Scott Felderman

Paula Jean Muir

Provided are techniques for indexing and archiving multiple statements using a single statement dictionary in a document containing the multiple statements. A document comprising a statement dictionary and one or more statements is indexed by extracting a statement metadata corresponding to each of the one or more statements from the statement dictionary. Each statement metadata is stored in a database. In response to a search request for a statement, the statement is retrieved using the corresponding statement metadata.

Indexing and archiving multiple statements using a single statement dictionary

According to one embodiment of the present invention, a system includes at least one processor. The system partitions a document into a plurality of data blocks, wherein each data block comprises one or more complete logical units of the document. A plurality of sub-documents is produced from the plurality of data blocks. The sub-documents are processed in parallel by a plurality of processing elements. Embodiments of the present invention further include a method and computer program product for processing a document in parallel in substantially the same manner described above.

Distributed computing on document formats

In storing data, common data within a plurality of documents is identified. A data object is created separate from the plurality of documents and the identified common data is stored in the data object. The identified common data is replaced within the plurality of documents with an identifier referencing the data object. In at least some embodiments, the identifier is a native datatype construct.

Creating data objects to separately store common data included in documents

A method, a processing device, and a computer program product are provided. At least two data elements common between multiple documents are combined into a combined group. Instances of the combined group in the multiple documents are replaced with a corresponding identifier. The combined group is stored in a data object separate from the multiple documents.

Storage efficiency

A system, method and computer program product for searching documents within a collection includes partitioning the collection into a plurality of document segments based on a range of values for a document attribute. Each document segment is associated with a different value range for the document attribute and includes documents each with a value for the document attribute within the associated value range. The system, method and computer program product also determines one or more document segments to search based on one or more search criteria within a search request pertaining to the document attribute. The system, method and computer program product further searches the determined one or more document segments for information satisfying the search request.

Segmenting documents within a full text index

Provided are techniques for retrieving a document that includes for each page an area that is ignored by applications that process the document and that includes a different internal index set associated with each subset of pages of the document, wherein each different internal index set is associated with an area and stores indexes, and wherein each of the indexes consists of a name-value pair. Then, for each page in the document, it is determined whether the page is associated with an internal index set; and, in response to determining that the page is associated with an internal index set, one or more name-value pairs from the internal index set are extracted, wherein each of the one or more name-value pairs provides specific information about the document for use in identifying the document.

Indexing documents using internal index sets

According to one embodiment of the present invention, a method for inserting a PDF shared resource back into a PDF statement is provided. The method includes storing a set of statements, wherein each statement has been extracted from a document and each statement contains indirect objects. A set of resources is then stored, wherein the resources have been extracted from the document, and the resources include a set of indirect objects. All of the indirect objects in a selected one of the stored statements are then enumerated and a determination is made of which of the indirect objects contain keys. A key value for the enumerated indirect objects containing keys is then read, and the indirect objects in the stored set of resources associated with each key are identified. Stream data is then copied from the indirect objects in the stored set of resources into the selected ones of the stored statements.

Inserting a PDF shared resource back into a PDF statement

An apparatus, system, and method are disclosed for improved Portable Document Format ('PDF') document archiving. The method includes scanning a source PDF document for a shared resource. The source PDF document includes a plurality of records. The shared resource includes a common resource referenced by way of a resource pointer associated with a record of the source PDF document. The method includes copying the shared resource to a resource group associated with the source PDF document. The method also includes short-circuiting a link between content for the shared resource and the resource pointer in each record that points to the shared resource. The method includes extracting a record from the source PDF document. The extracted record is void of content for the shared resource in response to the short-circuited link. Thus, records may be stored in a standalone format without excessive storage space requirements.

Growing community of inventors

Thornton, CO, United States of America

Brian Keith Hoyt