The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 18, 2025
Filed:
Sep. 25, 2023
Google Llc, Mountain View, CA (US);
Linhai Qiu, Palo Alto, CA (US);
Robert Istvan Busa-Fekete, Chatham, NJ (US);
Julian Ulf Zimmert, Berlin, DE;
Andras Gyorgy, London, GB;
Hao Shen, Mountain View, CA (US);
Hyomin Choi, Mountain View, CA (US);
Sharmila Vijay, Mountain View, CA (US);
Li Xiao, San Francisco, CA (US);
Google LLC, Mountain View, CA (US);
Abstract
A method for a crawl algorithm includes obtaining a plurality of web pages for a web crawler to crawl. The method also includes determining an available bandwidth for the web crawler. The method includes, for each respective web page of the plurality of web pages, determining a respective crawl value for the respective web page based on the available bandwidth and determining that the respective crawl value of the respective web page satisfies a threshold value. The method includes, in response to determining that the respective crawl value of the respective web page satisfies the threshold value, updating the respective web page in a cache memory.