Yahoo! Inc.

Amit Madaan

Rupesh R Mehta

V G Vinod Vydiswaran

Rajeev Ramnarain Rastogi

Srinivasan Hanumantha Rao Sengamedu

Charu Tiwari

S R Jeyashankher

An example of a method includes determining features of a first type for a web page of a plurality of web pages. The method also includes electronically determining a plurality of rules for an attribute of the first web page, wherein the plurality of rules are determined based on features of the first type. The method also includes electronically identifying a first rule, from the plurality of rules, which satisfies a first predefined criterion. The first predefined criteria include at least one of a first threshold for a precision parameter, a second threshold for a support parameter, a third threshold for a distance parameter and a fourth threshold for a recall parameter. The method further includes storing the first rule to enable extraction of value of the attribute from a second web page.

Method and system for processing and learning rules for extracting information from incoming web pages

Subject matter disclosed herein may relate to clustering electronic documents, such as, for example, web pages, and may also relate to template identification for electronic documents.

Structural clustering and template identification for electronic documents

Techniques are disclosed herein to automatically learn a template that describes a common structure present in documents in a training set. The structure of the template is compared to the structure of the documents (or at least a part of each document) in the training set, one-by-one, and generalized in response to differences between the template and the document to which the template is currently being compared. If the structure of any particular document is considered too dissimilar from the structure of the template, then the template is not modified. Various generalization operators are added to the template to generalize the template. One such generalization operator is an 'OR', which indicates that only one of 'n' sub-trees below the &#x201c;OR&#x201d; operator in the template is allowed at the corresponding position in a document.

Growing community of inventors

Uttar Pradesh, India

Amit Madaan