Samsung Electronics Co., Ltd.

Yonsei University

Yeongsik Lee

Hanjun Kim

Sanggyu Shin

Youngsok Kim

Sungjun Cho

Seonyeong Heo

A data processing method and apparatus using a neural network, and an electronic device including the data processing apparatus. The data processing method includes identifying an operator that selects one of a plurality of execution paths for a portion of the neural network while sequentially executing layers included in the neural network, selecting a specific execution path, from among the plurality of execution paths, based on a remaining time that is left for an inference of the neural network, and obtaining a result of the inference of the neural network through the specific execution path.

Data processing method and apparatus using neural network and electronic device including the same

An operation method includes: dividing a model to be executed in an accelerator into a plurality of stages; determining, for each of the stages, a maximum batch size processible in an on-chip memory of the accelerator; determining the determined maximum batch sizes to each be a candidate batch size to be applied to the model; and determining, to be a final batch size to be applied to the model, one of the determined candidate batch sizes that minimizes a sum of a computation cost of executing the model in the accelerator and a memory access cost.

Operation method of host processor and accelerator, and electronic device including the same

Growing community of inventors

Seoul, South Korea

Yeongsik Lee