Time series prediction with confidence estimates using sparse recurrent mixture density networks

Abstract

This disclosure relates generally to system and method for time series prediction using a sparse recurrent mixture density network (RMDN), such as sparse LSTM-MDN and a sparse ED-MDN, for accurate forecasting of a high variability time series. The disclosed sparse RMDN has the ability to handle high-dimensional input features, capture trend shifts and high variability present in the data, and provide a confidence estimate of the forecast. A high-dimensional time series data is passed through a feedforward layer, which performs dimensionality reduction in an unsupervised manner by inducing sparsity on weights of the feedforward layer. The resultant low-dimensional time series is fed through recurrent layers to capture temporal patterns. These recurrent layers also aid in learning latent representation of the input data. Thereafter, a mixture density network (MDN) is used to model the variability and trend shifts present in the input and it also estimates the confidence of the predictions.