IDiyas

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 11528033 B1

PDFFull Text
Date of Patent:
Dec. 13, 2022

Filed:

Apr. 13, 2018

Neural network processor using compression and decompression of activation data to reduce memory bandwidth utilization

Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Joseph Leon Corkery, Burlingame, CA (US);

Benjamin Eliot Lundell, Seattle, WA (US);

Larry Marvin Wall, Seattle, WA (US);

Chad Balling McBride, North Bend, WA (US);

Amol Ashok Ambardekar, Redmond, WA (US);

George Petre, Redmond, WA (US);

Kent D. Cedola, Bellevue, WA (US);

Boris Bobrov, Kirkland, WA (US);

Assignee:

MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US);

Attorneys:

Newport IP, LLC

Leonard J. Hope

Primary Examiner:

Michael D Yaary

Assistant Examiner:

Carlo Waje

Int. Cl.
CPC ...
H03M 7/30 (2006.01); G06N 3/04 (2006.01); G06N 3/063 (2006.01); G06F 12/0862 (2016.01); G06F 9/46 (2006.01); G06F 1/324 (2019.01); G06F 3/06 (2006.01); G06F 9/38 (2018.01); G06F 12/08 (2016.01); G06F 12/10 (2016.01); G06F 15/80 (2006.01); G06F 17/15 (2006.01); G06N 3/06 (2006.01); G06N 3/08 (2006.01); G06N 3/10 (2006.01); H04L 45/02 (2022.01); H04L 67/02 (2022.01); G06F 9/30 (2018.01); H04L 67/1001 (2022.01); G06F 9/48 (2006.01); G06F 12/02 (2006.01); G06F 13/16 (2006.01); G06F 1/3234 (2019.01); G06F 13/28 (2006.01); H03M 7/46 (2006.01); H04L 45/50 (2022.01);
U.S. Cl.
CPC ...
H03M 7/3059 (2013.01); G06F 1/324 (2013.01); G06F 1/3275 (2013.01); G06F 3/0604 (2013.01); G06F 3/067 (2013.01); G06F 3/0631 (2013.01); G06F 9/30087 (2013.01); G06F 9/3836 (2013.01); G06F 9/3887 (2013.01); G06F 9/46 (2013.01); G06F 9/4881 (2013.01); G06F 12/0207 (2013.01); G06F 12/0238 (2013.01); G06F 12/08 (2013.01); G06F 12/0862 (2013.01); G06F 12/10 (2013.01); G06F 13/1673 (2013.01); G06F 13/1689 (2013.01); G06F 13/28 (2013.01); G06F 15/8007 (2013.01); G06F 17/15 (2013.01); G06N 3/04 (2013.01); G06N 3/049 (2013.01); G06N 3/0454 (2013.01); G06N 3/06 (2013.01); G06N 3/063 (2013.01); G06N 3/0635 (2013.01); G06N 3/08 (2013.01); G06N 3/10 (2013.01); H03M 7/6005 (2013.01); H03M 7/6011 (2013.01); H03M 7/70 (2013.01); H04L 45/04 (2013.01); H04L 67/02 (2013.01); H04L 67/1001 (2022.05); G06F 2209/484 (2013.01); G06F 2209/485 (2013.01); G06F 2212/657 (2013.01); H03M 7/46 (2013.01); H04L 45/50 (2013.01); Y02D 10/00 (2018.01);
Abstract

A deep neural network ('DNN') module compresses and decompresses neuron-generated activation data to reduce the utilization of memory bus bandwidth. The compression unit receives an uncompressed chunk of data generated by a neuron in the DNN module. The compression unit generates a mask portion and a data portion of a compressed output chunk. The mask portion encodes the presence and location of the zero and non-zero bytes in the uncompressed chunk of data. The data portion stores truncated non-zero bytes from the uncompressed chunk of data. A decompression unit receives a compressed chunk of data from memory in the DNN processor or memory of an application host. The decompression unit decompresses the compressed chunk of data using the mask portion and the data portion.

Find Patent Forward Citations

Loading…