Neural network computing system and method of executing neural network model

Abstract

A neural network computing system includes a processor including heterogeneous computing devices configured to execute a neural network model; a memory configured to buffer input data and output data of the neural network model; a memory controller configured to control data input and data output of the memory; and a system bus configured to support communication between the processor and the memory controller. The processor determines a target execution time for each node included in the neural network model based on a target end-to-end execution time of the neural network model; controls operating frequencies of hardware devices including the heterogeneous computing devices, the memory controller, and the system bus based on a target computing device for execution of each node, an amount of work for each node, and the target execution time for each node, and executes the neural network model by operating at the operating frequencies.