Cbs Interactive, Inc.

Ron H Rothman

Clifford Lyon

Various embodiments are generally directed to an automated A/B testing system using a combination of classical and alternative statistical analysis to control the performance A/B tests. An apparatus includes a processor circuit; and logic to commence collection of a specified number of samples of user responses to multiple versions of a user interface in a test, employ an alternative statistical analysis to analyze the samples as they are collected, determine whether a proposed version elicits a statistically significant improvement in user response over a control version, terminate the test before the specified number of samples are collected in response to a statistically significant improvement over the control version elicited by the proposed version, and complete collection of the specified number of samples and employ a classical statistical analysis to analyze the samples in response to the proposed version not eliciting the statistically significant improvement. Other embodiments are described and claimed.

Automated experiment scheduling

Various embodiments are generally directed to a visual configuration environment for configuring A/B tests of variations of aspects of content presentation in a user interface of a portal of a server to support remotely accessing services that it provides. A method includes identifying multiple visual areas of a visible portion of a user interface in a first data script; visually presenting on a display the multiple visual areas in at least one menu in a first table to enable selection of first and second visual areas of the multiple visual areas for inclusion in an A/B test of multiple versions of the user interface; and visually presenting a list of all possible combinations of variations in content presentation selected in response to the visual presentation of the first table for the first and second visual areas in the form of a second table. Other embodiments are described and claimed herein.

A/B test configuration environment

Disclosed herein are systems, methods, and computer-readable storage media for consistently associating a user ID with a user. In one aspect, a method may comprise receiving a data request at a transceiver accessible by a server computing device, wherein, in response to receiving the data request, the server computing device is configured to: access, by one or more processors coupled to the transceiver, a first value embedded in a first cookie associated with a first expiration time; set a second cookie embedded with a second value; and reset the first cookie responsive to receiving an indication that the first cookie is expiring, wherein to reset the first cookie comprises replacing the first cookie with a third cookie set with a value equal to the first value and a third expiration time later than the first expiration time. Other embodiments are disclosed and claimed.

Growing community of inventors

Bridgewater, NJ, United States of America

Ron H Rothman