Microsoft Technology Licensing, LLC

Yipeng Li

Xiao Lin Zhang

Junaid Ahmed

Walter Sun

Peter Bailey

Nikhil Dandekar

Sasi Parthasarathy

Xin Chen

Methods, systems, and computer-readable media are provided for updating a search index with new uniform resource locators (URLs) and spiking URLs with increased user interest. History data, provided from browser applications residing on users' computers that indicate URLs accessed by the users, is parsed to identify new/previously unknown URLs. The history data also indicates URLs in which there is increased interest based on a number of recent hits as compared to an average number of hits determined over time. Author postings of new URLs to social networking sites and a quality rating of the authors may also be used to identify and filter new URLs. Search indexes are updated with the new and spiking URL data. As such, lag time between posting of new URLs and spiking of URL interest and inclusion of this data in a search index is greatly decreased.

Updating a search index using reported browser history data

Methods and systems for determining an adaptive crawl rate for a Web crawler based on historical publication data from a Web source are provided. A frequency of publication of the Web source is determined over a specified period of time, and an adaptive crawl rate is calculated using the frequency of publication. The Web crawler is then deployed at the calculated adaptive crawl rate.

Adaptive crawl rates based on publication frequency

Growing community of inventors

Redmond, WA, United States of America

Yipeng Li