Utilizing hidden state sharing modules to prevent catastrophic forgetting

Abstract

A computer-implemented method, system and computer program product for processing data. Data, including single data points (e.g., images) or entire sequences of data (e.g., speech, video), is received to be processed. A long short term memory structure is utilized to process the received data, where the long short term memory structure includes hidden state sharing modules for allowing information sharing in hidden states across different tasks. The hidden state sharing modules include broadcast modules which are configured to send hidden states of the current task to all previous modules and collect modules which are configured to collect all the hidden states from all the previous modules. In this manner, catastrophic forgetting is avoided by preventing the loss of previously learned information via the use of hidden state sharing modules.