Google Inc.

Lucent Technologies Inc.

Narayanan Shivakumar

Deepak Jindal

Sascha Benjamin Brawer

Ralph Michael Keller

Maximilian Ibel

Rama Ranganath

Yingwei Cui

Darrell Anderson

Jeffrey Adgate Dean

Georges R Harik

Alexander Paul Carobus

Paul Thomas Buchheit

Elad Gil

Alan C Strohm

Feng Hu

Prathima Agrawal

Brian Axe

Kevan Newton

Noam M Shazeer

Sergey Melnik

Balakrishnan Narendran

Kenneth W Bronson

Jason Liebman

Michael Noth

Giao Nguyen

Theodore Vassilakis

Vanessa Fox

Matthew B Tolton

Max Ibel

Carl Laurence Gonsalves

Cormac J Sreenan

Andrey Gubarev

Grace Kwak

Ekta H Manaktala

Paul Buchhcit

Geoffrey M Romer

Jing Jing Long

Systems and methods for scheduling documents for crawling are disclosed in which sitemap information is updated for a first website identified by a sitemap by downloading updated sitemap information for the first website and scheduling documents for crawling in accordance with the updated sitemap information for the first website. The sitemap information includes one or more sitemap indexes, where each respective sitemap index in the one or more sitemap indices includes a list of URLs corresponding to documents stored at a corresponding website in a plurality of websites, the plurality of websites including the first website, and each sitemap index in the one or more sitemap indexes includes information identifying one or more of: a last modification date of a URL in the list of URLs, a change frequency of a document specified by the URL, a document title, an authority of the document, and a priority of the document.

Web crawler scheduler that utilizes sitemaps from websites

Advertisers are permitted to put targeted ads on page on the web (or some other document of any media type). The present invention may do so by (i) obtaining content that includes available spots for ads, (ii) determining ads relevant to content, and/or (iii) combining content with ads determined to be relevant to the content.

Serving advertisements based on content

Systems and methods for scheduling documents for crawling are disclosed. In some implementations, a method includes obtaining sitemap information for a plurality of websites; and analyzing the sitemap information to identify a website, in the plurality of websites. The website has sitemap information that is at least potentially out of date. The method also includes updating the sitemap information for the identified website by downloading updated sitemap information for the identified website; and scheduling documents for crawling in accordance with the updated sitemap information for the identified website.

Ads eligible to be served with a document (for example, because they are relevant to the document) may each be scored using a price parameter associated with the ad and an indication of relevancy of the ad to the document. The indication of relevancy of the ad to the document may be based on an ordinal ranking of a relevancy criteria of the document used to select the ad, and/or a value of a relevancy criteria of the document used to select the ad. The eligible ads may be determined by obtaining relevancy criteria for the document and selecting ads using at least some of the obtained relevancy criteria. The ads may be selected, and perhaps filtered, in a distributed manner.

Selecting and/or scoring content-relevant advertisements

A method of analyzing documents or relationships between documents includes receiving a notification of an available metadata document containing information about one or more network-accessible documents, obtaining a document format indicator associated with the metadata document, selecting a document crawler using the document format indicator, and crawling at least some of the network-accessible documents using the selected document crawler.

Mobile SiteMaps

A website may have a number of owners. According to certain embodiments, site owner-information of current owners of the website is provided to a user to enable the user to re-verify the current owners of the website.

System and method for verifying and revoking ownership rights with respect to a website in a website indexing system

Methods and systems for a web crawler scheduler that utilizes sitemaps from websites are described. A web crawler scheduling system receives a notification from a website or web server. In response to the notification, the system accesses one or more sitemap(s) for documents associated with the website or web server. The system schedules crawls of the documents based on information identified from the sitemaps. The system crawls at least a subset of the documents scheduled for crawling.

A content owner partner (e.g., a Website/Web page publisher) can easily block entire broad or narrow categories of ads, and can specify objectionable ad content or targeting. Concepts may be associated with a property and ads related to those concepts may be blocked for the given property. Further, terms may be associated with a property and ads including any of the terms may be blocked for the given property.

Identifying and/or blocking ads such as document-specific competitive ads

Methods, systems and apparatus, including computer program products, for generating cookies. Multiple advertisements for multiple advertisers are stored on an ad server. Hostnames specific to each of the multiple advertisers are generated dynamically. The generated hostnames identify the ad server. A reference is generated identifying a particular advertisement of the multiple advertisements and the ad server. The ad server is identified in the reference with the generated hostname associated with the advertiser of the advertisement. The reference is provided to a client. A request is received from the client for the advertisement. The request includes the generated hostname. In response to the request, a client cookie, which includes a unique identifier, is sent to the client.

Privacy-sensitive cookies

A method and system for allowing a resource associated with a target document usable for ad rendering by a first entity to be used for rendering of content by a second entity. Depending on one or more conditions, the first entity either uses the resource to render at least one ad or allows a second entity to use at least a portion of the resource to render content.

Determining content to be provided by an entity for rendering via a resource in a target document or notifying an alternative entity of the availability of the resource

Growing community of inventors

Kirkland, WA, United States of America

Narayanan Shivakumar