Arm Limited

Silicon Graphics International Corporation

Apical Limited

Alexander Eugene Chalfin

Andreas Due Engh-Halstvedt

Olof Henrik Uhrenholt

Ian Rudolf Bratt

Mark S Peercy

Alpana Kaulgud

Thomas Jeremy Olson

Danny Loh

Andreas Loeve Selvik

Hardik Sharma

Bradley Albert Grantham

John Wakefield Brothers

Frode Heggelund

Paul Stanley Hughes

Damian Piotr Modrzyk

Metin Gokhan Ünal

Alex Kornienko

Eric Kunze

Lingchuan Meng

Jonathan Adam Lawton

Tianmu Li

Kartikeya Bhardwaj

Srihari Pratapa

A method of processing input data for a given layer of a neural network using a data processing system comprising compute resources for performing convolutional computations is described. The input data comprises a given set of input feature maps, IFMs, and a given set of filters. The method comprises generating a set of part-IFMs including pluralities of part-IFMs which correspond to respective IFMs, of the given set of IFMs. The method further includes grouping part-IFMs in the set of part-IFMs into a set of selections of part-IFMs. The method further includes convolving, by respective compute resources of the data processing system, the set of selections with the given set of filters to compute a set of part-output feature maps. A data processing system for processing input data for a given layer of a neural network is also described.

Processing data for a layer of a neural network

The present disclosure advantageously provides a system and a method for convolving data in a quantized convolutional neural network (CNN). The method includes selecting a set of complex interpolation points, generating a set of complex transform matrices based, at least in part, on the set of complex interpolation points, receiving an input volume from a preceding layer of the quantized CNN, performing a complex Winograd convolution on the input volume and at least one filter, using the set of complex transform matrices, to generate an output volume, and sending the output volume to a subsequent layer of the quantized CNN.

Efficient convolutional neural networks

When processing graphics primitives in a graphics processing system, the render output is divided into a plurality of regions for rendering, each region comprising a respective area of the render output. It is determined for which of the plurality of regions of the render output a primitive should be rendered for. Primitive data for rendering the primitive is then stored either in a combined data structure in memory that is associated with a plurality of different regions of the render output, or is stored in a respective data structure for each region of the render output it is determined the primitive should be rendered for. Which manner the primitive data is stored is determined in dependence on a property, e.g. a coverage, of the primitive.

Graphics processing systems

When processing graphics primitives in a graphics processing system, the render output is divided into a plurality of regions for rendering, each region comprising a respective area of the render output. It is determined for which of the plurality of regions of the render output a primitive should be rendered for. For each region of the render output it is determined a primitive should be rendered for, geometry data for the primitive is stored in memory in a respective data structure for the region in a compressed form, such that the geometry data for the primitive to be rendered is stored in a compressed form, in a respective, different data structure for each different region of the render output it is determined the primitive should be rendered for.

When processing graphics primitives in a graphics processing system, the render output is divided into a plurality of regions for rendering, each region comprising a respective area of the render output. It is determined for which of the plurality of regions of the render output a primitive should be rendered for. Associated state data for rendering the primitive is stored in a 'state data' data structure in memory. For each region of the render output it is determined the primitive should be rendered for, a reference to the associated state data for rendering the primitive is stored in a respective, different data structure for each different region of the render output it is determined the primitive should be rendered for.

When processing graphics primitives in a graphics processing system, the render output is divided into a plurality of regions () for rendering, each region () comprising a respective area of the render output; and for sets of one or more primitives to be rendered, it is determined for which of the plurality of regions of the render output () the primitive(s) should be rendered; and for each region of the render output () it is determined the primitive(s) should be rendered for, geometry data for the primitive(s) is stored in memory in a respective data structure () along with an indication of state data that is to be used for rendering the primitive(s) for the region, such that the geometry data for the primitive(s) to be rendered is stored in a respective, different data structure () for each different region of the render output () it is determined the primitive(s) should be rendered for.

A display controllerin a data processing system includes a timewarp module (transformation circuitry)that is operable to perform timewarp processing of a rendered framegenerated by a graphics processor (GPU)for provision to a display panel. The timewarp module (transformation circuitry)operates to transform an input surfaceread by the display controllerbased on received view orientation data to provide an appropriately 'timewarped' transformed version of the input surface as an output transformed surface for display on the display

Data processing systems

A graphics processor that rasterises input primitives to generate graphics fragments to be processed and renders the graphics fragments to generate a first, higher resolution version of a render output. When processing of a render output is stopped before the render output is finished, the first resolution version of the render output is downsampled to a second, lower resolution and the downsampled data elements at the second resolution are written out together with a set of difference values indicative of the differences between the data elements at the first resolution and the downsampled data elements at the second resolution. Then, when processing of the render output is resumed, these values can be loaded in and used to reconstruct the array of data elements at the first resolution for use when continuing processing of the render output.

A graphics processor that performs early depth tests for primitives in respect of patches of a render output, and depth tests for sampling positions of the render output, maintains a per patch depth buffer that stores depth values for patches for use by the patch early depth test and a per sample depth buffer. When processing of a render output is stopped before the render output is finished, the per sample depth values in the per sample depth buffer are written to storage so that those values can be restored, but the per patch depth value information in the per patch depth buffer is discarded. Then, when processing of the render output is resumed, the per sample depth buffer values are loaded into a per sample depth buffer, and the loaded per sample depth buffer values are also used to restore the per patch depth buffer.

Hidden surface removal in graphics processing systems

A data processing apparatus processes a set of weight values for an artificial neural network by representing the set of weight values in the form of an array of weight values and by using an image compression scheme to provide compressed weight data for the artificial neural network. The data processing apparatus uses an image decompression scheme to derive decompressed weight values from the compressed weight data and applies the decompressed weight values when producing a result from an input to the artificial neural network. The data processing apparatus can provide for efficient storage and processing of the weight values for the artificial neural network.

Processing artificial neural network weights

A data processing apparatus implements an artificial neural network to generate a result that indicates one or more encoding options to use when encoding a set of data elements using an encoding scheme. The data processing apparatus can provide an efficient way of selecting between possible encoding options that can be used to encode a set of data elements.

Selecting encoding options

A graphics processing apparatus performs an intermediate processing pass in which region lists that indicate geometry for respective regions of an intermediate projection surface are generated and stored. A subsequent processing pass is then performed in which a region of the intermediate projection surface is selected using a vector for a fragment, and geometry data for shading the fragment is obtained with reference to the region list that was stored for the selected region in the intermediate processing pass. The fragment can then be shaded using the obtained data for the geometry. The apparatus can provide a render output that is not limited by the resolution of an intermediate render output.

Graphics processing fragment shading by plural processing passes

A graphics processing pipeline includes a vertex transformation stagehaving a vertex transformation cache. If a request to transform vertex data is received and the vertex transformation cacheindicates that the transformed vertex data for that received request has already been generated, then a pointer to that previously generated transformed vertex data is output within a result data stream in place of the transform vertex data. The transform vertex data is stored to a memorybefore being retrieved as required by a rasterization stage

Result data stream coding for repeating workloads

A system and method for remote rendering of computer graphics wherein user transactions are reliable and the transmission of rendered graphics is relatively fast. The invention is implemented in a client server context, where a computer graphics application and rendering resources are located at a server. A user controls the graphics application through a client machine connected to the server through a computer network. The user's commands are sent from the client to the server, while rendered computer graphics are transmitted from the server to a display at the client. Different transport protocols are used, depending on the requirements of a particular transmission. Data related to user interactions is transmitted using a relatively reliable transport protocol, such as TCP. Rendered subject graphics data is transmitted from the server to the client using a less reliable but faster transport protocol, such UDP.

Growing community of inventors

Mountain View, CA, United States of America

Alexander Eugene Chalfin