Read-modify-write for lossless tiling in convolution networks

Abstract

A data processing system that implements an improved read-modify-write operation for lossless tiling in convolution networks is presented. The data processing system includes runtime logic that is configured to execute a graph to generate at the output of the graph, a plurality of tiles of a tensor, initialize a memory comprising all zeros for storing the plurality of tiles, determine a current memory region in the memory for storing a current tile of the plurality of tiles, wherein the current memory region comprises an overlapping memory region that stores data from write operations of previously stored neighboring tiles of the plurality of tiles and a remaining memory region, and perform a read-modify-write operation on the data from the overlapping memory region using the data from the overlapping memory region and first tile data of the current tile for storing in the overlapping memory region.