International Business Machines Corporation

Yahoo! Inc.

Daniel Norin Meredith

Daniel Gruhl

Jeffrey Alan Kusnitz

Utkarsh Srivastava

Benjamin Clay Reed

Philip Lewis Bohannon

Michael Ching

Stephen Dill

David L Blackman

Ivan Eduardo Gonzalez

Adam Marcus

Linda Anh Linh Nguyen

Andrew Stephen Tomkins

Varun Bhagwan

Nadav Eiron

Jan Hendrik Pieper

Joerg Meyer

Kevin Haas

Linda A Nguyen

A system and method of indexing a plurality of entities located in a taxonomy, the entities comprising sets of terms, comprises receiving terms in an index structure; building a posting list for an entity with respect to the locations of the set of terms defining the entity and data associated with the respective terms; and indexing a name of a group comprising the entities within this group at the location of the entities with the data of the group comprising the name of the respective entity at each location. The building of the posting list comprises storing the location of the term and data associated with the term in an entry in the posting list for the term. The method comprises indexing aliases of the name of the group comprising the term, and using an inverted list index to associate data with each occurrence of an index term.

Method and framework to support indexing and searching taxonomies in large scale full text indexes

Techniques that support trail-based exploration by a user of a repository of documents are described herein. In one embodiment, trail definition data that specifies a trail is received. The trail includes an ordered series of waypoints including a trailhead, intermediate waypoints, and one or more trailends. In some embodiments, deadends may also be defined in the trial. A particular waypoint in the ordered series of waypoints is established as a current waypoint. Search terms can be received from a user to cause a search to be performed. It is then determined whether the search satisfies matching criteria associated with a waypoint that immediately follows the current waypoint in the ordered series of waypoints. If so, the user advances to the next waypoint. Otherwise, the user remains at the current waypoint. Finally, if a trailend is reached, then an action such as rewarding the user in some way may be performed.

Trail-based exploration of a repository of documents

The embodiments of the invention provide a systems, methods, etc. for adaptive content processing and classification in a high-availability environment. More specifically, a system is provided having a plurality of processing engines and at least one server that classifies data objects on the computer system. The classification includes analyzing the data objects for the presence of a type of content. This can include assigning a score corresponding to the amount of the type of content in each of the data objects. Moreover, the server can remove a data object from the computer system based on the results of the analyzing. The results of the analyzing are stored and the computer system is updated with feedback information. This can include allowing a user to review the results of the analyzing and aggregating reviews of the user into the feedback information.

System and method for adaptive content processing and classification in a high-availability environment

A system and method for prioritizing a fetch order of web pages. The method comprises extracting by a web crawler a set of candidate web pages to be crawled. Each web page in the set of candidate web pages is associated with a website in a computer network. A determination is made to determine if a first website score for the website is in a website score database. The first website score is associated with web pages in the set of candidate web pages if the first website score exists in the website score database. The set of candidate web pages is prioritized with respect to an associated website score for each web page in the candidate set of web pages. Content is retrieved from the set of candidate web. Hyperlinks are extracted from the content. The hyperlinks are stored in a memory unit.

System and method for prioritizing websites during a webcrawling process

Systems and methods for multi-dimensional aggregation. Exemplary embodiments include a method for retrieving data from an inverted list index within a computer system, wherein the index comprises annotated postings, the method including receiving a query in a system, converting the query into a query language, scanning at least one list of postings for data from the query, aggregating the data in the list, thereby resulting in an aggregated list, wherein the aggregating includes recording the occurrence of unique values from the list, mapping the values using a user-provided definition to an alternate value, grouping the values by a user-provided mapping of values to groups, recording and mutating data associated with the unique value in the list, relating the recorded data values with other values in the index and returning the requested data from the aggregated list in a return format.

System and method for multi-dimensional aggregation over large text corpora

To respond to queries that relate to co-occurring entities on the Web, a compact sparse matrix representing entity co-occurrences is generated and then accessed to satisfy queries. The sparse matrix has groups of sub-rows, with each group corresponding to an entity in a document corpus. The groups are sorted from most occurring entity to least occurring entity. Each sub-row within a group corresponds to an entity that co-occurs in the document corpus, within a co-occurrence criterion, with the entity represented by the group, and to facilitate query response the sub-rows within a group are sorted from most occurring co-occurrence to least occurring co-occurrence.

System and method for creation, representation, and delivery of document corpus entity co-occurrence information

Growing community of inventors

Sunnyvale, CA, United States of America

Daniel Norin Meredith