Habana Labs Ltd.

Bharat Kumar Daga

Eitan Joshua

Ravi Krishnan Venkatesan

A cache allocation module may facilitate dynamic cache allocation in an AI accelerator based on data access patterns. For instance, the cache allocation module may dynamically partition the overall cache in the AI accelerator into one or more processor-side caches and one or more memory-side caches. A cache line may start as being private and may be installed in a processor-side cache. The cache allocation module may dynamically change private cache lines to shared cache lines, e.g., by moving private cache lines from a processor-side cache to a memory-side cache. A private cache line can be read by one compute engine in the AI accelerator, versus a shared cache line may be read by multiple compute engines in the AI processor. After a cache line is moved from a processor-side cache to a memory-side cache, the cache allocation module may invalidate the cache line in the processor-side cache.

Growing community of inventors

Fremont, CA, United States of America

Bharat Kumar Daga