Amazon Technologies, Inc.

Ayyavu Madhavaraj

Sri Venkata Surya Siva Rama Krishna Garimella

A data processing technique uses an Artificial Neural Network (ANN) with Rectifier Linear Units (ReLU) to yield improve accuracy in a runtime task, for example, in processing audio-based data acquired by a speech-enabled device. The technique includes a first aspect that relates to initialization of the ANN weights to initially yield a high fraction of positive outputs from the ReLU. These weights are then modified using an iterative procedure in which the weights are incrementally updated. A second aspect relates to controlling the size of the incremental updates (a 'learning rate') during the iterations of training according to a variance of the weights at each layer.

Growing community of inventors

Bengaluru, India

Ayyavu Madhavaraj