Systems and methods for forecast alerts with programmable human-machine hybrid ensemble learning

Abstract

A method for computing a human-machine hybrid ensemble prediction includes: receiving an individual forecasting question (IFP); classifying the IFP into one of a plurality of canonical question topics; identifying machine models associated with the canonical question topic; for each of the machine models: receiving, from one of a plurality of human participants: a first task input including a selection of sets of training data; a second task input including selections of portions of the selected sets of training data; and a third task input including model parameters to configure the machine model; training the machine model in accordance with the first, second, and third task inputs; and computing a machine model forecast based on the trained machine model; computing an aggregated forecast from machine model forecasts computed by the machine models; and sending an alert in response to determining that the aggregated forecast satisfies a threshold condition.