Intelligent management of machine learning inferences in edge-cloud systems

Abstract

A computer-implemented system and method relate an edge device with a local machine learning model, which generates local prediction data and confidence score data, in response to sensor data. Query threshold data is received from a cloud computing system. An assessment result is assessed using the confidence score data and the query threshold data. The assessment result indicates whether or not to generate a query with the sensor data for transmission to the cloud computing system. The local predication data is assigned as a prediction result when the assessment result indicates that the query is not being generated and transmitted. The cloud prediction data is assigned as the prediction result when the assessment result indicates that the query is being generated and transmitted. The cloud prediction data is received from the cloud computing system in response to the query. The edge device is controlled using the prediction result.