Partial inference framework for sequential dnn processing on constrained devices, and acoustic scene classification using said partial inference framework

Abstract

The present disclosure relates to a method for performing inference on input data using a neural network and a processing device employing the aforementioned method. The method comprises the steps of obtaining and storing input data, obtaining parameter data indicating the parameters of the first layer and storing the parameter data in a parameter data storage location and processing the input data using the first layer parameter data, to form first layer output data. The method further comprises storing the first layer output data, obtaining parameter data of the second layer and storing the second layer parameter data by replacing the first layer parameter data with the second layer parameter data, processing the first layer output data using the stored second layer parameter data to form second layer output data; and storing the second layer output data.