Methods and systems for visual replay of predictive engine performance

Abstract

Disclosed are methods and systems for creating, evaluating, and tuning a predictive engine for machine learning, and for replaying performance of the predictive engine, including steps to deploy a variant of the predictive engine; receive a plurality of queries to the predictive engine variant from an end-user device; apply a query segment filter to the plurality of queries to generate a replay group of queries, wherein for each query in the replay group, the engine variant generates a corresponding predicted result, receives a corresponding actual result, and computes a corresponding prediction score; group queries in the replay group into one or more segments; and generate, as a replay of the performance of the engine variant, an accumulated prediction score over each of the one or more query segments of the replay group by applying an accumulation function. The present invention substantially improves on systems that utilize predictive engines.