Real-time monitoring of machine learning models in service orchestration plane

Abstract

A computer-implemented method, system and computer program product for performing real-time monitoring of machine learning models. Real-time model state data and metadata (e.g., operating dataset) of the machine learning models located within an orchestration plane of a network are collected by agents located within the machine learning models. The portion of the collected real-time model state data and metadata that is to be provided to the user by the service orchestrator (configured to monitor the machine learning models in the service orchestration plane via the use of agents in the machine learning models) is selected and marked. The marked collected real-time model state data and metadata are then provided to the user by the service orchestrator. In this manner, real-time monitoring of the machine learning models in the orchestration plane, such as the service orchestration plane, of a broadband cellular network (e.g., fifth generation broadband cellular network) is achieved.