Function-as-a-service platforms framework deployment with creation of pool of pre-initialized serverless function for software function services

Abstract

Provided herein are methods and systems for providing a function as a service in a predictably timed manner, for example within a deadline or in a given frequency. A specialized executor function, namely a custom runner, is called from the function service using a wrapper function on the framework controller. The process allocates some, or all of the required computing resources required to execute a function on the initialization stage, based on foresight. The custom runner function may keep the resources for expected function service requests, or terminate in accordance with prediction rules thereof. The disclosure supports different platforms, and custom scheduling algorithms, for real-time use-cases, demand prediction, custom function execution, and the like. The disclosure mitigates overhead due to startup and shutdown delays, which may be incurred by opening and closing a database connection, loading and unloading a neural network to physical memory, and the likes.