Nvidia Corporation

Zacky Zhou

Hao Fang Wu

Ujval J Kapasi

Yilin Zhang

Dilip Sequeira

Alex Fit-Florea

Slawomir Kierat

Szymon Migacz

Maxim Milakov

Aspects of the present invention are directed to computer-implemented techniques for performing data compression and conversion between data formats of varying degrees of precision, and more particularly for improving the inferencing (application) of artificial neural networks using a reduced precision (e.g., INT8) data format. Embodiments of the present invention generate candidate conversions of data output, then employ a relative measure of quality to identify the candidate conversion with the greatest accuracy (i.e., least divergence from the original higher precision values). The representation can be then be used during inference to perform computations on the resulting output data.

Automated methods for conversions to a lower precision data format

Growing community of inventors

Shanghai, China

Zacky Zhou