Samsung Electronics Co., Ltd.

Snu Rdb Foundation

Sanggyu Shin

Soojeong Kim

Byung-Gon Chun

Yeongsik Lee

Kyunggeun Lee

A method including, for each of a plurality of job nodes, corresponding to a job request of a scheduler node, distributing an application container and a sidecar container of a corresponding job node of the plurality of job nodes, and storing, by the sidecar container, information about a respective state of the application container in a memory through a communication between the sidecar container and at least one sidecar container of another job node of the plurality of job nodes.

Method and apparatus with sidecar pattern checkpointing

An accelerator resource management method and apparatus are disclosed. The accelerator resource management method includes receiving a task request for a neural network-related task and a resource scheduling policy for the neural network-related task, obtaining information on a current resource utilization status of an accelerator cluster comprising a plurality of accelerators, in response to the task request, and allocating an accelerator resource for performing the task based on a utility of a resource allocation that is based on the resource scheduling policy and the information.

Accelerator resource management method and apparatus

An operation method includes: dividing a model to be executed in an accelerator into a plurality of stages; determining, for each of the stages, a maximum batch size processible in an on-chip memory of the accelerator; determining the determined maximum batch sizes to each be a candidate batch size to be applied to the model; and determining, to be a final batch size to be applied to the model, one of the determined candidate batch sizes that minimizes a sum of a computation cost of executing the model in the accelerator and a memory access cost.

Operation method of host processor and accelerator, and electronic device including the same

Disclosed is a multi-device based inference method and apparatus, where the multi-device based inference method includes receiving information related to operation devices performing an operation included in a neural network and a graph corresponding to the neural network, obtaining a size of an output of the operation in a forward direction of the graph based on the information and the graph, dividing an input of the operation in a backward direction of the graph based on the information, the graph, and the size of the output, and performing an inference based on the divided input.

Growing community of inventors

Suwon-si, South Korea

Sanggyu Shin