The Nielsen Comapny (us), LLC

Netflix Inc.

Juliette Aurisset

Albert Ronald Perez

Kumar Nagaraja Rao

Paul Donato

Mainak Mazumdar

Seema Varma Srivastava

Josh Gaunt

James R Oliver

Yutao Peng

Embodiments provide techniques for testing a plurality of variations of a user experience on a subscription-based online site, where each of the plurality of variations is distinct from other variations in the plurality of variations. Each of a plurality of users is assigned to one of the plurality of variations. For each of a plurality of user requests received during a predetermined window of time, embodiments determine one of the plurality of variations for use in processing the user request, based on a user associated with the user request, and process the respective user request using the determined variation. Long-term user metric information relating to subscription services for the subscription-based online site is determined, with respect to the plurality of users. Embodiments then rate at least one of the plurality of variations, based on the determined long-term user metric information.

Techniques for applying long term metrics to multivariate testing

Examples to determine media impressions are disclosed. An example method includes determining an exposure of first media, wherein the exposure occurs after a cookie identifier is received at a computing device, wherein the cookie identifier is received from a database proprietor, determining a first panelist identifier associated with the exposure based on the cookie identifier, determining a second panelist identifier associated with the exposure based on a determination of a user identity by a panelist meter associated with the computing device, determining an adjustment factor by comparing the first panelist identifier and the second panelist identifier, determining a number of impressions of second media from data logged by the database proprietor, the data logged in response to requests transmitted to the database proprietor in response to clients accessing the second media, and applying the adjustment factor to the number of impressions to determine an adjusted number of impressions.

Methods and apparatus to determine an adjustment factor for media impressions

A set of variations of a user experience on a subscription-based online site are tested, where each of the set of variations is distinct from other variations in the set of variations. Each of a group of users is assigned to one of the set of variations. For each user request received during a predetermined window of time, one of the set of variations is determined for use in processing the user request, based on a user associated with the user request, and the respective user request is processed using the determined variation. Long-term user metric information relating to subscription services for the subscription-based online site is determined, with respect to the group of users. At least one of the set of variations is then rated based on the determined long-term user metric information.

Long term metrics applied to multivariate testing

Examples to determine media impressions are disclosed. An example method includes detecting a cookie identifier established by a database proprietor at a computing device, determining an impression of media, wherein the impression occurs after the cookie identifier is established, determining a first panelist identifier associated with the impression based on the cookie identifier, determining a second panelist identifier associated with the impression based on determination of a user identity by a panelist meter associated with the computing device, and storing an adjustment factor determined by comparing the first panelist identifier and the second panelist identifier.

Growing community of inventors

Menlo Park, CA, United States of America

Juliette Aurisset