Google Inc.

Ilya Mikhailovich Sherman

Tyler Odean

Steven Chi Truong

Marc-André Decoste

Vadim Berman

Jesse Doherty

Alexei Iourievich Svitkine

A computer-implemented method for comparing multiple client application variations, including, providing a copy of a client application to each of a plurality of client devices, wherein each copy of the client application comprises multiple application variations, receiving demographic information from one or more of the plurality of client devices and providing a list of available experiments to each of the plurality of client devices based on the demographic information, wherein each of the available experiments corresponds with one or more application variations. In certain implementations, the method further includes steps for receiving usage information for each copy of the client application associated with each of the plurality of client devices and comparing two or more application variations of the client application based on the usage information. Systems and computer-readable media are also provided.

Server side experimentation for client side software

Systems and methods for conducting a set of experiments on an application having a plurality of users are provided. Each experiment is identified by a respective experiment identification (ID) and is associated with a respective group of experimental variations of the application. A system includes an entropy source module that assigns a user group number to a designated user. The user group number is less than or equal to an entropy cap, which is less than an expected entropy, which represents a total number of different states of the experiments. The system includes an experiment module that determines a designated one of the experiments to be conducted on the application. The designated experiment is identified by a designated experiment ID and is associated with a designated group of experimental variations of the application. The experiment module assigns a designated variation to the designated user based on the user group number.

Systems and methods for conducting experiments on applications

Growing community of inventors

Mountain View, CA, United States of America

Ilya Mikhailovich Sherman