Determining winning arms of a/b electronic communication testing for a metric using historical data and histogram-based bayesian inference

Abstract

Apparatuses, methods, and systems for determining winning arms of electronic testing. One method includes obtaining historical data related to the testing, creating a histogram based on the historical data, the histogram including bins and weights, creating a distribution by computing concentration parameters of the distribution from the weights of the histogram, executing the testing, receiving new data collected based on the execution of the test, allocating the new data into same bins as the bins of the histogram of the historical data yielding a new data bin count, computing a posterior distribution comprising updating the distribution using the same bins and the new data bin counts and the concentration parameters of the distribution in closed form vie conjugate prior formulae, inferring corresponding central tendencies of samplings of a metric distribution, constructing an overall utility distribution for each arms of the test, and determining a winning arm of the testing.