Huawei Technologies Co., Limited

Kishanthan Thangarajah

Boyuan Chen

Haoxiang Zhang

Shi Chang

There is provided a method and apparatus for model selection for swapping between a first memory and a second memory. The method includes sorting models in a first list, the first list including models loaded in the first memory, wherein sorting is based at least in part on a least recently used (LRU) of each model. The method further includes removing duplicate models from a second list of models, the second list including models to be loaded into the first memory. The method further includes determining an eviction score of each of the models and selecting a model from the first list having a highest eviction score compared with other models in the first list. The method additionally includes swapping the selected model from the first memory to the second memory.

Growing community of inventors

Kanata, Canada

Kishanthan Thangarajah