Microsoft Technology Licensing, LLC

Snowflake Inc.

Yi Pan

Kartik Paramasivam

Samarth Shetty

Ray Manpreet Singh Matharu

Prateek Maheshwari

Abdul Q Munir

Boyung Lee

Abhishek Shivanna

Bharath Kumarasubramanian

Joshua Klahr

Hossein Ahmandi

Srinivasulu Punuru

Jagadish Venkatraman

Jacob R Maes

Shanthoosh Pazhanjur Venkataraman

Wenye Li

Jayanta Das

A method includes parsing a query to determine a plurality of data processing operations associated with the query and including an AS OF JOIN operation between first time series data in a first table and second time series data in a second table. A query plan of the query is generated. The query plan includes a plurality of nodes corresponding to the plurality of data processing operations. At least one of the plurality of nodes corresponding to the AS OF JOIN operation is modified to generate a modified query plan of the query. The modifying is based on applying a UNION operation on at least a first portion of column data in the first table and the second table to obtain a combined table. Execution of the query by at least one of a plurality of computing nodes is scheduled based on the modified query plan.

Inexact timestamp range matching join for time series data (AS OF JOIN)

The disclosed embodiments provide a system for managing a stream-processing application. During operation, the system allocates a first host for an active instance of the stream-processing application that maintains a state during processing of one or more input streams. Next, the system allocates a second host for a first backup instance that recreates the state on the active instance by consuming changes to the state replicated from the active instance without consuming the input stream(s). During a failure on the first host, the system moves the active instance to the first host by stopping the first backup instance on the second host. Finally, the system launches the active instance on the second host to resume processing of the input stream(s) by the active instance using the recreated state from the first backup instance.

State replication, allocation and failover in stream processing

The disclosed embodiments provide a system for processing data. During operation, the system receives records of activity within a stream-processing system over a set of event streams, wherein each event stream in the set of event streams contains events related to a corresponding job in the stream-processing system. Next, the system indexes data in the records under a set of keys that include a first key related to jobs in the stream-processing system and a second key related to errors in the stream-processing system. The system then outputs the indexed data for use in analyzing the execution of the stream-processing system.

Stream processing diagnostics

Growing community of inventors

San Jose, CA, United States of America

Yi Pan