Samsung Electronics Co., Ltd.

Hui Chen

Ilia Ovsiannikov

Joseph H Hassoun

Ali Shafiee Ardestani

Georgios Georgiadis

Hamzah Ahmed Ali Abdelaziz

Jun Fang

David Philip Lloyd Thorsley

In some embodiments, a method of quantizing an artificial neural network includes dividing a quantization range for a tensor of the artificial neural network into a first region and a second region, and quantizing values of the tensor in the first region separately from values of the tensor in the second region. In some embodiments, linear or nonlinear quantization are applied to values of the tensor in the first region and the second region. In some embodiments, the method includes locating a breakpoint between the first region and the second region by substantially minimizing an expected quantization error over at least a portion of the quantization range. In some embodiments, the expected quantization error is minimized by solving analytically and/or searching numerically.

Piecewise quantization for neural networks

A system and a method of quantizing a pre-trained neural network, includes determining by a layer/channel bit-width determiner for each layer or channel of the pre-trained neural network a minimum quantization noise for the layer or the channel for each master bit-width value in a predetermined set of master bit-width values; and selecting by a bit-width selector for the layer or the channel the master bit-width value having the minimum quantization noise for the layer or the channel. In one embodiment, the minimum quantization noise for the layer or the channel is based on a square of a range of weights for the layer or the channel that is multiplied by a constant to a negative power of a current master bit-width value.

Non-uniform quantization of pre-trained deep neural network

Growing community of inventors

Lake Forest, CA, United States of America

Hui Chen