Samsung Electronics Co., Ltd.

Skhynix Inc.

Seoul National University

Snu Rdb Foundation

Snu R&db Foundation

Younghwan Oh

Jaewook Lee

Deog-Kyoon Jeong

Seung Wook Lee

Tae Jun Ham

Minsoo Lim

Taejun Ham

Seonghak Kim

Sungjun Jung

Yunho Jin

Sam Son

A scheduler, a method of operating the scheduler, and an electronic device including the scheduler are disclosed. The method of operating the scheduler configured to determine a model to be executed in an accelerator includes receiving one or more requests for execution of a plurality of models to be independently executed in the accelerator, and performing layer-wise scheduling on the models based on an idle time occurring when a candidate layer which is a target for the scheduling in each of the models is executed in the accelerator.

Layer-wise scheduling on models based on idle times

An accelerator includes a key matrix register configured to store a key matrix, a query vector register configured to store a query vector; and a preprocessor configured to calculate similarities between the query vector and the key matrix.

Method for candidate selection and accelerator for performing candidate selection

Growing community of inventors

Seoul, South Korea

Younghwan Oh