Bnn training with mini-batch particle flow

Abstract

Discussed herein are devices, systems, and methods for Bayesian neural network (BNN) training using mini-batch particle flow. A method for training a Bayesian neural network (BNN) using batched inputs and operating the trained BNN can include initializing particles such that each particle individually represents pointwise values of respective NN parameters of NNs and such that the particles collectively represent a distribution of parameters of the BNN, optimizing, using min-batch training particle flow, the particles based on batches of inputs, resulting in optimized distributions for the parameters, determining a prediction distribution using the optimized distributions for the parameters and predictions from each of the NNs, and providing a marginalized distribution representative of the prediction distribution.