Multi-stage multi-hop natural language and model execution plan generation

Abstract

Machine learning models are used to invoke a sequence of tools in response to a user request. A list of available tools is culled before a machine learning model selects from the remaining tools to generate a plan. The plan, which describes tool invocations in natural language, is then converted to code that can programmatically invoke the tools. In some configurations, the list of available tools is first culled by removing tools that do not appear in similarly described plans. The list may further be culled by removing tools that do not appear in plans generated by machine learning models. Then, a machine learning model is prompted to generate a final plan from the culled list and the user request. In some configurations, the final plan is converted to code by prompting a machine learning model to extrapolate from the code of similar plans.