Yahoo! Inc.

Priyank Shanker Garg

Amit Kumar

Timothy M Converse

Chris Theodore Kalaboukis

Ronald Martinez

Joshua E Schachter

Vladimir Ofitserov

Amit Basu

Stephen L Hood

Ariel Faigon

Apostolos Karmirantzos

Arnabnil Bhattacharjee

Conrad Newman

Di Chang

Vivien Tong

Techniques are provided through which 'suspicious' websites may be identified automatically. A suspicious website is one that is associated with many changes or an inconsistent number of changes in web registry information over time. Registry information is received when changes to the registry information occur. The registry information is referred to as a transaction. A transaction is comprised of a plurality of values that each correspond to a characteristic. A characteristic is a property of a website, such as the website's contact information. A count associated with a particular characteristic-value pair is updated each time the particular value is identified in a transaction. A high count indicates that the website associated with the particular value is associated with a lot of changes. Therefore, a website associated with a high count is suspicious. Other factors that may be used for identifying a 'suspicious' website include how often and how much the count changes.

Identifying exceptional web documents

Disclosed herein is a technique for providing an interface that allows a user to navigate backwards through linked webpages. Initially, a request to display inlinks of linking webpages that contain a link to a particular webpage is received. In response to the request, a new page that contains a set of inlinks that correspond to a set of linking webpages that each contain a link to the particular webpage is provided. Each of the inlinks may be associated with a particular clickable item. An indication of a selection of a clickable item, associated with a particular inlink is received. In response, a second new page which contains a second set of inlinks that correspond to a second set of linking webpages that each contain a link to the webpage that corresponds to the particular inlink is provided. Some of the displayed inlinks may correspond to webpages that redirect to the particular webpage.

Providing an interface to browse links or redirects to a particular webpage

A technique is provided for providing an aggregate tag view of a website that comprises a plurality of webpages that each has a corresponding URL. A tag is a set of one or more words that have been associated with a URL and is typically created by a user to describe content of the webpage corresponding to the URL. Initially, a request is received to display information pertaining to a website. In response to the request, a plurality of tags associated with the website is displayed. A first subset of the plurality of tags is associated with a particular URL. A second subset of the plurality of tags is associated with one or more URLs that are not the particular URL. Alternatively, or in addition to an aggregate tag view tag-related information for each URL of the website is provided, in response to the initial request.

Aggregate tag views of website information

Techniques are provided through which a user is verified as authorized to modify a website. A web crawler generates a filename and content for the user, who purports to be authorized to modify a particular website. The web crawler sends the filename and content toward the user. The user stores a file with the filename on a server that hosts the website. The user places the content within the file. The web crawler determines whether the file is stored on the server and whether the content is in the file. If so, then the web crawler stores information that indicates that the user is authorized to receive information pertaining to the website, which may be confidential information. If the file is not stored on the server or if the file does not contain the content, then the web crawler does not provide any information to the user pertaining to the website.

Authenticating a site while protecting against security holes by handling common web server configurations

Techniques for identifying duplicate webpages are provided. In one technique, one or more parameters of a first unique URL are identified where each of the one or more parameters do not substantially affect the content of the corresponding webpage. The first URL and subsequent URLs may be rewritten to drop each of the one or more parameters. Each of the subsequent URLs is compared to the first URL. If a subsequent URL is the same as the first URL, then the corresponding webpage of the subsequent URL is not accessed or crawled. In another technique, the parameters of multiple URLs are sorted, for example, alphabetically. If any URLs are the same, then the webpages of the duplicate URLs are not accessed or crawled.

Handling dynamic URLs in crawl for better coverage of unique content

An infrastructure facility for interactive commerce in media objects over a network is described. Consumers are provided with searchable access to media object suppliers using standardized commercial packages. A commercial package is associated with a media object by using a commerce tag consisting of embedded metadata to identify the associated commercial package and optionally parameterize a commercial offer. The infrastructure facility provides a searchable database of available media objects with commerce tags, media object suppliers, and an accessible reference for commercial packages and associated tags.

E-commerce system using searchable tags

A method and apparatus for improving search results is provided. The method works by delineating sections of a document that are not relevant to the main content. The document content is subjected to ranking analysis in entirety. In response to a query results are recalled omitting terms included in the no-recall sections. Terms in the no-recall sections are not used in titles and abstracts of the results. The results are ordered at least in part by the rankings attributed to the identified no-recall sections.

Growing community of inventors

San Jose, CA, United States of America

Priyank Shanker Garg