Hewlett-packard Development Company, L.p.

Hewlett Packard Enterprise Development LP

Micro Focus Lcc

Entit Software LLC

William Kevin Wilkinson

Alkiviadis Simitsis

Umeshwar Dayal

Harumi Kuno

Petar Jovanovic

Olga Poppe

Craig Peter Sayers

Bin Zhang

Maria G Castellanos

Stavros Harizopoulos

Mahashweta Das

Goetz Graefe

Bernard Burg

Dirk Manfred Beyer

Janet Lynn Wiener

Daniel Alan Muntz

Sachin Kulkarni

Vineet Singh

Stefan Krompass

Alkis Simitsis

Themistoklis Palpanas

Lyle H Ramshaw

Enrico Iori

Jorge Augusto Saldivar Galli

Processing a hybrid flow containing a continuous flow can include connecting a continuous flow to a finite flow of a hybrid flow using a continuous connector operator, and processing the data flow graph of the hybrid flow.

Hybrid flows containing a continous flow

Example embodiments relate to providing real-time monitoring and analysis of query execution. In example embodiments, a query plan is obtained for a database query that is scheduled for execution in a database. A query tree is then generated based on the query plan, where the query tree includes operator nodes that are associated corresponding operators in the query plan. At this stage, performance metrics are collected from the database during the execution of the database query. Next, the query tree is displayed with the performance metrics, where a related portion of the performance metrics are displayed in each of the operator nodes.

Real-time monitoring and analysis of query execution

Example implementations relate to a database and a data stream query. For example, a computing device may include a processor. The processor may receive a query associated with at least one of a database and a buffer storing streamed data from a data stream, where the database stores database data previously stored in the buffer. The processor may identify at least one postponed command relevant to the query, the at least one postponed command being associated with at least one of the database data and the streamed data. The processor may generate a modified query based on the query and the at least one postponed command, the modified query being a modification of the query to account for the at least one postponed command. The processor may process the modified query and provide a query result of the query based on the modified query being processed.

Database and data stream query

Examples for mapping a relational database to a graph database include a mapping engine to execute an arbitrary query on a relational database, identify a result column tag based on a tag of an underlying base table, process the result column into a typed, directed property graph based on the result column tag, and output the typed, directed property graph to a graph database. Examples for mapping a graph database to a relational database include processing a graph transaction by updating a mapping layer with a surrogate describing a change to a database object, determining, for an object in the mapping layer, if a database constraint defined on the object is satisfied, collecting database changes defined by the surrogate into a database change request, submitting the change request to a relational database as a transaction, and deleting the surrogate for the object in the mapping layer.

Graph database and relational database mapping

Examples for graph database query classification include receiving a graph query and determining if the graph query matches benchmark data. In the event that the graph query does not match benchmark data, the query may be parsed, a canonical internal representation of the query may be determined, the representation may be mapped to a rule, and the query may be classified based on the rule. In the event that the confidence score for the query classification does not exceed a threshold, the query may be sent to a synthetic graph or synopsis for simulation. In some examples, the simulation may include selecting computationally expensive graph operators in the query for simulation.

Graph database query classification based on previous queries stored in repository

Described herein are techniques for identifying a path in a workload that may be associated with a deviation. A workload may be associated with multiple measurements of a plurality of metrics generated during execution of the workload. The multiple measurements may be aggregated at multiple levels of execution. One or more measurements may be compared to one or more other measurements or estimates to determine whether there is a deviation from an expected correlation. If determined that there is a deviation, a path can be identified in the workload that may be associated with the deviation.

Multiple measurements aggregated at multiple levels of execution of a workload

Example implementations relate to processing a query of a database and a data stream. For example, a computing device may include a processor. The processor may receive a query associated with at least one of a database and a buffer storing streamed data from a data stream. The database may store database data previously stored in the buffer. The processor may identify a range associated with the query and generate a set of sub-queries including at least one of a buffer sub-query if the range is associated with the streamed data in the buffer and a database sub-query if the range is associated with the database data in the database. The processor may process the set of sub-queries and provide a query result of the query, where the query result is a combination of sub-query results of the set of sub-queries.

Processing query of database and data stream

Example implementations relate to automatic generation of sub-queries. For example, a computing device may include a processor. The processor may receive a query defining a particular set of data stored in at least one database. The processor may access metadata associated with the particular set of data and may select a data attribute associated with the particular set of data based on the metadata. The processor may automatically generate sub-queries of the query using the data attribute selected based on the metadata. The processor may process the sub-queries and provide a query result of the query that is a combination of sub-query results of the sub-queries.

Automatic generation of sub-queries

Processing a data flow graph of a hybrid flow can include a data structure to store metadata for each of a plurality of nodes of a data flow graph of a hybrid flow, processing the data flow graph of the hybrid flow, and defining metadata in the data structure for a particular node affected during processing of the data flow graph of the hybrid flow.

Processing a data flow graph of a hybrid flow

Described herein are techniques for generating a visualization relating to execution of a workload. Multiple measurements of a plurality of metrics relating to execution of the workload may be aggregated at multiple levels of execution. A visualization may be generated that comprises a representation of the measurements of a metric at one of the levels of execution.

Generating a visualization of a metric at one or multiple levels of execution of a database workload

Disclosed herein are techniques for optimizing and managing the execution of hybrid flows. An execution plan is generated for each hybrid flow based at least partially on attributes associated therewith. The execution of each hybrid flow is managed in accordance with the execution plan.

Optimizing and managing execution of hybrid flows

Converting a hybrid flow can include combining each of a plurality of task nodes with a plurality of corresponding operators of the hybrid flow and converting the combined plurality of task nodes and the plurality of corresponding operators of the hybrid flow to a data flow graph using a code template.

Converting a hybrid flow

A flow of operations is to be executed in a plurality of execution environments according to a distribution. In response to determining that the distribution is unable to achieve at least one criterion, the distribution is modified according to at least one policy that specifies at least one action to apply to the flow of operations in response to a corresponding at least one condition relating to a characteristic of the flow of operations.

Modifying a flow of operations to be executed in a plurality of execution environments

A method and apparatus apply a transition to an initial information integration flow graph to form a modified information integration flow graph which is visually depicted in a modified design canvas. The initial information integration flow graph has nodes, each node having initial location coordinates for visual depiction in an initial design canvas, wherein nodes of the modified information integration flow graph having location coordinates based upon the initial location coordinates.

Growing community of inventors

San Mateo, CA, United States of America

William Kevin Wilkinson