Gennady Pekhimenko

Title: Gennady Pekhimenko: Innovator in Neural Network Compression

Introduction

Gennady Pekhimenko is a notable inventor based in Oakville, CA. He has made significant contributions to the field of neural networks, particularly in the area of model compression. His innovative techniques aim to enhance the efficiency of neural network models, making them more practical for various applications.

Latest Patents

Pekhimenko holds a patent for "Mixing sparsity compression." This patent describes techniques for compressing a neural network model by mixing compression ratios, or sparsity patterns. The weight tensor of a neural network model is divided into weight groups. The pruning cost of compressing the weight values according to a compression ratio is determined for each weight group. A pruning cost distribution for the compression ratio is generated from the pruning costs of the weight groups. A cost threshold can then be selected from the pruning cost distribution, and weight groups having a pruning cost below the selected cost threshold are compressed according to the compression ratio. The remaining weight groups can be compressed using one or more less aggressive compression ratios. The cost threshold can be adjusted to tune the overall sparsity and accuracy of the compressed neural network. This innovative approach allows for a more flexible and efficient compression of neural networks.

Career Highlights

Gennady Pekhimenko is currently associated with Amazon Technologies, Inc. His work at Amazon focuses on advancing the capabilities of machine learning and artificial intelligence through innovative compression techniques. His contributions have been instrumental in improving the performance and efficiency of neural networks.

Conclusion

Gennady Pekhimenko is a pioneering inventor whose work in neural network compression is shaping the future of artificial intelligence. His patent on mixing sparsity compression demonstrates his commitment to enhancing the efficiency of neural networks. Through his role at Amazon Technologies, Inc., he continues to push the boundaries of innovation in this critical field.