Neural network system for performing learning, learning method thereof, and transfer learning method of neural network processor

Abstract

A neural network system includes a processor and a memory. The processor is configured to perform learning including multiple learning iterations on multiple layers, to determine at least one layer in which the learning is interrupted among the multiple layers. The determination of the at least one layer in which the learning is interrupted is based on a result of comparing for each of the multiple layers a distribution of first weight values resulting from a first learning iteration with a distribution of second weight values resulting from a second learning iteration. The processor is also configured to perform a third learning iteration in layers except the at least one layer for which interruption of the learning has been determined. The memory stores first distribution information of the first weight values and second distribution information of the second weight values and is configured to provide the first distribution information and the second distribution information to the processor when the second learning iteration is completed.