Microsoft Technology Licensing, LLC

Fotios Psallidas

Subramaniam Venkatraman Krishnan

Yuan Yu

Carlo Aldo Curino

Rathijit Sen

Avrilia Floratou

Ashvin Agrawal

Raghunath Ramakrishnan

Kwanghyun Park

Konstantinos Karanasos

Matteo Interlandi

Markus Weimer

MohammadHossein Namaki

Yinghui Wu

Ivan Popivanov

Doris Suiyi Xin

Karla Jean Saur

The description relates to executing an inference query relative to a database management system, such as a relational database management system. In one example a trained machine learning model can be stored within the database management system. An inference query can be received that applies the trained machine learning model on data local to the database management system. Analysis can be performed on the inference query and the trained machine learning model to generate a unified intermediate representation of the inference query and the trained model. Cross optimization can be performed on the unified intermediate representation. Based upon the cross-optimization, a first portion of the unified intermediate representation to be executed by a database engine of the database management system can be determined, and, a second portion of the unified intermediate representation to be executed by a machine learning runtime can be determined.

Query processing with machine learning

A system enables tracking machine learning ('ML') model data provenance. In particular, a computing device is configured to accept ML model code that, when executed, instantiates and trains an ML model, to parse the ML model code into a workflow intermediate representation (WIR), to semantically annotate the WIR to provide an annotated WIR, and to identify, based on the annotated WIR and ML API corresponding to the ML model code, data from at least one data source that is relied upon by the ML model code when training the ML model. A WIR may be generated from an abstract syntax tree (AST) based on the ML model code, generating provenance relationships (PRs) based at least in part on relationships between nodes of the AST, wherein a PR comprises one or more input variables, an operation, a caller, and one or more output variables.

Tracking provenance in data science scripts

Growing community of inventors

Bellevue, WA, United States of America

Fotios Psallidas