Nvidia Corporation

Sharan Chetlur

Stephen Jones

David Fontaine

Steven Arthur Gurfinkel

Thor Mikal Johnsen

Sally Tessa Stevenson

Jason David Gaiser

Deyu Fu

Simon Layton

Natalia Gimelshein

Parag Kulkarni

Kexin Yu

Speed of training a neural network is improved by updating the weights of the neural network in parallel. In at least one embodiment, after back propagation, gradients are distributed to a plurality of processors, each of which calculate a portion of the updated weights of the neural network.

Distributed weight update for backpropagation of a neural network

Techniques to modify executable graphs to perform different workloads. In at least one embodiment, an executable version of a first task graph is modified by applying a non-executable version of a second task graph to executable version of first task graph so that executable version of first task graph can perform a second workload of non-executable version of second task graph.

Techniques for modifying an executable graph to perform a workload associated with a new task graph

Growing community of inventors

San Jose, CA, United States of America

Sharan Chetlur