Distributing machine learning model operations across entities in a wireless communications network

Abstract

Certain aspects of the present disclosure provide techniques and apparatus for distributing machine learning model operations across entities in a wireless communications network. The method generally includes receiving, at the entity, an input prompt for processing using a machine learning model including a plurality of sub-models including a first sub-model configured to execute on a user equipment and one or more second sub-models configured to execute on network entities in the wireless communications network. Execution of one or more operations for the machine learning model based on the input prompt is coordinated via transmission of control signaling by the entity to one or more of the user equipment or network entities in the wireless communications network. Generally, the operations use a set of sub-models from the plurality of sub-models. A result responsive to the input prompt is generated based on the one or more operations, and the result is output.