Microsoft Technology Licensing, LLC

Databricks Inc.

Nitin Sharma

Todd R Manion

Akash Jeevan Sagar

Yannis Papakonstantinou

Aditya G Bhandarkar

Karthik Raman

Vuk Ercegovac

Ori Amiga

Farookh P Mohammed

Michael Paul Armbrust

Madan R Appiah

Nishant Gupta

Mukul Murthy

Lokesh M Dave

Joseph Torres

John Sismanis

Min Yang

Paul Lappas

Xi Liang

A system receives ETL specification for processing stream data, including a transform operation represented using a database query specification. The system generates a dataflow graph of a sequence of database queries by decomposing the database query into a first database query that generates an intermediate results table, and a second database query that receives as input the intermediate results table and outputs data used for performing the transform operation. The system executes the sequence of database queries for performing the transform operation on stream data received from the source. When receiving an incremental data set, the system determines an output change set based on the received incremental data set by traversing an execution plan and processing each operator in the execution plan, and computing a change set of a particular operator from the change sets output by the one or more other operators based on the incremental data set.

Incremental execution of extract, transform, load process using microtechniques architecture

Embodiments are directed to efficiently migrating data from one version of a service to another version and to temporarily transitioning a user to a different service for evaluation. A computer system pre-transfers user data from a first service to a second, different service before an indication is received that the user is to be transitioned from the first service to the second service. The user data includes identification information identifying users of the first service. The computer system receives an indication that a first service user is to be transitioned to the second service. The computer system transfers service data used by the first service to the second service and synchronizes any changes in the user data that occurred between the user data pre-transfer and the service data transfer, so that the second service is provided using the transferred service data and the synchronized user data.

Data migration for service upgrades

A unified data access mechanism can provide transparent access to data that is either stored locally or remotely. Application programs can direct data requests and data modifications to this singular component without foreknowledge of where the data is stored. The unified data access mechanism can work in concert with a synchronization mechanism that can maintain data synchronization between local data and remote data. Requested or modified data can be identified as stored locally or remotely based on the namespace of the data. If the data is stored remotely, the user credentials associated with the user's process space within which the application program is executing can be utilized to identify, and then provide, relevant authentication information to the remote data store, should it be required.

Transparent access mechanism for local and remote data

Growing community of inventors

Sammamish, WA, United States of America

Nitin Sharma