The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 18, 2025
Filed:
Mar. 28, 2024
Habana Labs Ltd., Caesarea, IL;
Ravi Krishnan Venkatesan, Bangalore, IN;
Bharat Kumar Daga, Fremont, CA (US);
Eitan Joshua, Ramot Menashe, IL;
Habana Labs Ltd., Caeserea, IL;
Abstract
A cache allocation module may facilitate dynamic cache allocation in an AI accelerator based on data access patterns. For instance, the cache allocation module may dynamically partition the overall cache in the AI accelerator into one or more processor-side caches and one or more memory-side caches. A cache line may start as being private and may be installed in a processor-side cache. The cache allocation module may dynamically change private cache lines to shared cache lines, e.g., by moving private cache lines from a processor-side cache to a memory-side cache. A private cache line can be read by one compute engine in the AI accelerator, versus a shared cache line may be read by multiple compute engines in the AI processor. After a cache line is moved from a processor-side cache to a memory-side cache, the cache allocation module may invalidate the cache line in the processor-side cache.