Scalable system and methods for curating user experience test respondents

Abstract

Techniques and embodiments are described herein for detecting and mitigating fraudulent activity within user experience (UX) test applications. In some embodiments, a system applies a set of rules and/or machine learning (ML) models to each respondent of an online survey or UX test. Different ML models may be trained to learn domain-specific patterns indicative of fraudulent activity. The system may then select the ML models based on attributes of the UX test and/or respondent. The selected rules and/or ML models may generate a probabilistic score representing a likelihood that the respondent is currently engaging in or will engage in fraudulent activity with respect to a UX test. If the score exceeds a threshold, then the system may take action to mitigate the fraudulent activity, such as triggering the removal of the user from an accepted respondent pool, halting further engagement between the respondent and the UX test, and generating alerts.