The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 27, 2022
Filed:
Sep. 30, 2021
Amazon Technologies, Inc., Seattle, WA (US);
Tyler Michael Jung, Seattle, WA (US);
Slavcho Georgiev Slavchev, Seattle, WA (US);
Nishant Jain, Bothell, WA (US);
Vishwas Narendra, Evanston, IL (US);
Nikhil Shah, Redmond, WA (US);
James Zuber, Seattle, WA (US);
Sameer Choudhary, Seattle, WA (US);
Christopher A. Stephens, Fall City, WA (US);
Suchindra Yogendra Agarwal, Kirkland, WA (US);
Phillip H. Pruett, Woodinville, WA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Systems and methods are provided for using a distributed cache architecture with different methods to load balance requests depending upon whether a requested data item is a freely-requested item (e.g., a 'hot key'). The cache may be implemented as a consistent hash ring, and most keys may be assigned to particular node based on a consistent hash. For hot key requests, the requests may be distributed among a subset of nodes rather than being assigned to a specific node using consistent hashing. When a witness service is used to ensure that cached data is fresh, verification requests for data regarding hot keys may be batched to avoid overloading the witness service with hot key requests.