Systems and methods for variant testing at scale

Abstract

This application sets forth techniques for variant testing at scale. In particular, the embodiments set forth provide systems and methods for testing, on a large-scale software application store, visual aspects of one or more variants of representative data associated with an application available through the software application store. According to some embodiments, a method may include using a subset of conversion data associated with a control object and a subset of the conversion data associated with at least one variant object to compute at least one conversion metric for the control object and at least one conversion metric for the at least one variant object. The method may also include generating a performance measurement by applying at least one statistical hypothesis testing function to the at least one conversion metric for the control object and the at least one conversion metric for the at least one variant object.