Fti Technology LLC

Attenex Corporation

Altenex Corporation

Dan Gallivan

Kenji Kawai

A computer-implemented system and method for generating document groupings is provided. A lexicon of terms extracted from a set of documents is generated. The lexicon includes a frequency of each extracted term within each document in the set. Concepts each having two or more of the extracted terms are generated. A subset of the documents in the set is selected based on the term frequencies. The subset of documents is grouped into clusters based on the concepts. A similarity of each document cluster is calculated with one or more documents based on a distance by summing the frequency of each term in that document and a weight of the cluster for each of the terms. The weights are updated until a rate of change for each cluster becomes constant.

Computer-implemented system and method for generating document groupings for display

A computer-implemented system and method for generating clusters for placement into a display is provided. A set of clusters is generated from a document set. A single cluster of related documents from the document set is obtained and at least one new cluster is added. One such document in the set is compared to the cluster. A difference in distance between the document and a common origin and the cluster and the common origin is determined. The document is designated as the new cluster when the difference fails to satisfy a predetermined threshold. One or more cluster spines each having two or more clusters placed along a vector are placed into a display. The clusters along each spine are identified as similar and the clusters of one such spine are also similar to further clusters located along a further spine having a small cosine rotation from that cluster spine.

Computer-implemented system and method for generating clusters for placement into a display

A computer-implemented system and method for populating clusters of documents is provided. A set of clusters is placed in a display in relation to a common origin. One of a plurality of unclustered documents in the display is selected and an angle &#x3b8; of the document from the common origin is determined. An angle &#x3c3; of the cluster relative to the common origin is computed for each cluster. A difference is determined between the document angle &#x3b8; and one such cluster angle &#x3c3;. A predetermined variance is applied to the difference. The document is placed into the cluster when the difference is less than the variance.

Computer-implemented system and method for populating clusters of documents

A computer-implemented system and method for identifying relevant documents for display are provided. Themes for a set of documents are generated. The documents are clustered based on the themes. A matrix including an inner product of document frequency occurrences and cluster concept weightings for each theme is generated for the documents. From the matrix, documents most relevant to a particular theme are identified, and the relevant documents are displayed.

Computer-implemented system and method for identifying relevant documents for display

A computer-implemented system and method for clustering similar documents is provided. Concepts are identified for a set of documents and occurrence frequencies are determined for each concept in the documents set. A distance quantifying a similarity for each of the documents in the set with one or more clusters of documents is calculated. Each document is mapped to at least one of the one or more document clusters.

Computer-implemented system and method for clustering similar documents

A computer-implemented system and method for generating a display of document clusters is described. Clusters of documents are presented in a multi-dimensional concept space. At least one document is selected from a collection of documents to be clusters. An angle &#x3b8; of the document relative to a common origin of the multi-dimensional concept space is computed. The selected document is compared with each of the clusters. An angle &#x3c3; from the common origin is determined for each cluster. A difference between the angle &#x3b8; for the document and the angle &#x3c3; for the cluster is determined. The difference is compared to the variance, and a new cluster is created when the difference exceeds the variance for all the clusters.

Computer-implemented system and method for generating a display of document clusters

A system and method for reorienting a display of clusters is provided. Clusters are maintained within a display. Each cluster includes a center located at a distance relative to a common origin for the display. A location of each cluster is compared to each other cluster. Two or more clusters that overlap are identified. At least one of the overlapping clusters is reoriented until no overlap occurs.

System and method for reorienting a display of clusters

A system and method for efficiently generating cluster groupings in a multi-dimensional concept space is described. A plurality of terms is extracted from each document in a collection of stored unstructured documents. A concept space is built over the document collection. Terms substantially correlated between a plurality of documents within the document collection are identified. Each correlated term is expressed as a vector mapped along an angle &#x3b8; originating from a common axis in the concept space. A difference between the angle &#x3b8; for each document and an angle &#x3c3; for each cluster within the concept space is determined. Each such cluster is populated with those documents having such difference between the angle &#x3b8; for each such document and the angle &#x3c3; for each such cluster falling within a predetermined variance. A new cluster is created within the concept space those documents having such difference between the angle &#x3b8; for each such document and the angle &#x3c3; for each such cluster falling outside the predetermined variance.

System and method for efficiently generating cluster groupings in a multi-dimensional concept space

A system and method for grouping similar documents is provided. Frequencies of occurrences are determined for terms and noun phrases within a set of documents. A subset of the documents is selected by removing those documents having terms and noun phrases that fall outside a bounded range of upper and lower conditions for frequency of occurrence. Each of the documents in the subset is mapped to a cluster of documents based on a similarity of the documents to the cluster documents.

System and method for grouping similar documents

A system and method for thematically grouping documents into clusters is provided. Concepts are extracted from a plurality of documents. The concepts include nouns or noun phrases. A number of occurrences for each concept are determined within each document. A bounded range is applied to the concepts and a subset of the concepts is selected by removing the concepts that fall outside the bounded range. The bounded range includes upper edge conditions and lower edge conditions. Themes are generated from the subset of concepts by identifying two or more concepts with common semantic meaning. Clusters of the documents are generated based on the themes.

System and method for thematically grouping documents into clusters

A system and method for reorienting clusters within a display is provided. Clusters are maintained within a display. Each cluster includes a center located at a distance relative to a common origin for the display and a radius measured from the center. A pair of the clusters is selected and a bounding region is determined for each cluster in the pair by forming a pair of tangent vectors about the cluster and originating at the common origin. The bounding regions of the clusters in the pair are compared. The distance from the common origin of one of the clusters in the pair is increased upon overlap of the bounding regions as a perspective-corrected distance, which is determined as a function of the distances, the radii, and an angle between tangent vectors. The one cluster is moved to reorient the cluster's center at the perspective-corrected distance in the display.

System and method for reorienting clusters within a display to provide a perspective-corrected representation

A system and method for clustering unstructured documents is provided. Documents having terms with frequencies of occurrence that satisfy upper and lower edge conditions are selected. Concepts are generated for the selected documents. The selected documents are grouped into clusters of the documents. A weight for each of the clusters is evaluated. A similarity value is determined from the frequencies of occurrence for at least one of the terms from the concepts and the cluster weights for each selected document. Each selected document is assigned into one such cluster based on the similarity value of the selected document.

System and method for clustering unstructured documents

A system and method for providing a perspective-corrected representation of a multi-dimensional cluster is presented. Clusters are displayed based on independent spatial orientations within multiple dimensions. For each such spatial orientation, the clusters are located at an independent distance from a common origin. A relationship between a pair of the clusters is picked and analyzed. A criteria for perspective correction is sought. The criteria is applied to the pair of clusters to determine whether the clusters need be reoriented. The clusters are reoriented in the display by a perspective-corrected distance based on the relationship between the pair of clusters.

System and method for providing a perspective-corrected representation of a multi-dimensional cluster

A system and method for dynamically evaluating latent concepts in unstructured documents is disclosed. A multiplicity of concepts are extracted from a set of unstructured documents into a lexicon. The lexicon uniquely identifies each concept and a frequency of occurrence. A frequency of occurrence representation is created for the documents set. The frequency representation provides an ordered corpus of the frequencies of occurrence of each concept. A subset of concepts is selected from the frequency of occurrence representation filtered against a pre-defined threshold. A group of weighted clusters of concepts selected from the concepts subset is generated. A matrix of best fit approximations is determined for each document weighted against each group of weighted clusters of concepts.

System and method for dynamically evaluating latent concepts in unstructured documents

A pair of convex clusters are selected. Each convex cluster has a center of mass located at an original fixed distance from a common origin, and is oriented along a vector formed at a fixed angle from a common polar axis. A span is measured between the centers of mass of each convex cluster. A segment is measured from the center of mass of each convex shape to a point closest to the other convex shape along the span. A new fixed distance from the common origin for the center of mass for one of the convex clusters located along the vector for that convex cluster is evaluated if the span is less than the sum of the segments of the convex clusters. The pair of convex clusters are displayed rendered using at least the new fixed distance for the center of mass of the one convex cluster.

Growing community of inventors

Bainbridge Island, WA, United States of America

Dan Gallivan