Business Objects Software Limited

Sap Se

Lucent Technologies Inc.

Eric Simon

Francois Llirbat

Francoise Fabret

Adrian Dragusanu

Richard Baxter Hull

Nicolas Dieu

Bharat Kumar

Gang Zhou

Guozhu Dong

Jianwen Su

Steve Kopp

Francoise Llirbat

Françoise Fabret

François Llirbat

Dinial Bensalah

Ioan-Lucian Precup

Cesar Salgado Vieira De Souza

Some embodiments provide a system and method to receive, as an input, configuration properties of a group of operators of a data pipeline, the data pipeline including a specified multiplicity greater than one (1); generate, as an output, a configuration for two new operators, including a first new operator and a second new operator; and automatically insert the first new operator and the second new operator into a deployment of the data pipeline, the first new operator being inserted before a number of replicas of the group of operators of the data pipeline corresponding to the specified multiplicity and the second new operator being inserted after the number of replicas of the group of operators of the data pipeline corresponding to the specified multiplicity.

Parallel execution of stateful black box operators

Computer-readable media, methods, and systems are disclosed for performing rollback recovery with data lineage capture for data pipelines. A middle operator receives ingested input events from a source operator reading data from an external input data source. The middle operator then logs information regarding middle input events to a middle operator input log, designating the logged middle input event information as incomplete. The middle operator then processes data associated with the middle input events and updates the middle input log entries setting them to a completed logging status designation for middle input events that were consumed to produce the one or more middle output events. The middle operator then transmits the middle output events to subsequent operators. Garbage collection is performed to remove completed entries from the middle operator output log. Finally, based on receiving a recovering message from a subsequent operator, corresponding middle output events are re-sent.

Rollback recovery with data lineage capture for data pipelines

Lineage graphs corresponding to data objects are generated. A data object of the data objects is associated with a source dataset table stored at a data lineage server (DLS). The source dataset table includes data of the data object received from a dataset stored at a data source system (DSS). A lineage graph corresponding to the dataset is determined from the lineage graphs. Based on the lineage graph, one or more data lineage structures are provided. The one or more data lineage structures include data from the dataset and from one or more datasets related to the dataset, and define lineage relationships between the data object and one or more data objects corresponding to the one or more datasets.

Computing data lineage across a network of heterogeneous systems

Apparatus, systems, and methods may operate to receive an original query plan, to transform the original query plan into an equivalent executable compact query plan, and to store the compact query plan on a machine readable device. Further activities may include computing maximal source sub-queries associated with the compact query plan, and computing semi-join reductions of the maximal source sub-queries to provide an executable derivative query plan, which may also be stored on a machine readable device. Additional apparatus, systems, and methods are disclosed.

Query plan reformulation

A method for determining access to a data table store includes determining static properties of data sources during query design, loading the static properties into an unavailability table, at query execution evaluating dynamic properties of the data sources and updating the unavailability table, evaluating a preference expression by a table dispatcher component using session context information from the availability table, determining if a preferred table is available at query execution, and if available indicating to access the preferred table, else applying unavailability rules to obtain repair actions. The preference expression including a user-defined preference between an original table and its replica and user-defined repair actions, where a selection is made at query execution between an original data table and a replicated data table based on the unavailability rules. A non-transitory computer readable medium and a system for implementing the method are also disclosed.

Systems and methods for robust data source access

Apparatus, systems, and methods may operate to receive an original query plan, to transform the original query plan into an equivalent executable compact query plan, and to store the compact query plan on a machine readable device. Further activities may include computing maximal source sub-queries associated with the compact query plan, and computing semi-join reductions of the maximal source sub-queries to provide an executable derivative query plan, which may also be stored on a machine readable device. Additional apparatus, systems, and methods are described.

A computer readable medium includes executable instructions to define an individual publication schema for each heterogeneous source of a set of heterogeneous sources. Each individual publication schema specifies mapping rules between data from a heterogeneous source and a non-permanent structured instance of data. A non-permanent structured instance of data as defined by an individual publication schema is generated. An integration schema defining a set of integration rules for combining data from each non-permanent structured instance of data as defined by individual publication schema is established. A target non-permanent structured instance of data to include data from the plurality of heterogeneous sources based on at least one integration schema is formed.

Producing a virtual database from data sources exhibiting heterogeneous schemas

Apparatus and method for producing a virtual database from data sources exhibiting heterogeneous schemas

A computer readable storage medium includes executable instructions to receive a selection of two or more data source tables from one or more data sources, determine a data source table that defines keys, and receive mapping information that defines one or more column relationships between the data source table and a second data source table. Relationship structures between the data source tables are analyzed. The data source tables and the relationship structures are graphically represented in a sequential order where the order in which the data source tables are depicted is based on a depth of a relationship between the data source table that defines keys and a second data source table.

Apparatus and method for relating graphical representations of data tables

A graphical user interface (GUI) is provided for use in conjunction with attribute evaluation utilizing computation rules and a combining policy. The graphical user interface displays a visual representation of the evaluation of attributes. The GUI displays a representation of the evaluation status of attributes and their associated computation rules during execution. The display may be updated dynamically to provide a user with a visual representation of the progression of attribute evaluation. The representation of evaluation status may include representations of the values assigned to, as well as the state of, data items and associated computation rules. States may be visually represented in the display in various ways, such as using various colors or labels associated with the data items and associated computation rules. Further, the particular data items and computation rules for which evaluation status is represented may be user selectable.

Dynamic display of data item evaluation

An object-focused workflow system for processing a received object in accordance with a declarative workflow specification. The specification includes modules and attributes, where module execution results in the evaluation of attributes, and may include the initiation of a side-effect action performed by an external component. Whether modules are to be executed for a particular received object is determined by associated enabling conditions. Attributes may be evaluated in accordance with computation rules and a combining policy, where the computation rules specify how values are to be contributed to an attribute, and the combining policy indicates how those contributed values are combined in order to assign a value to the attribute. Tasks in the workflow system may be executed eagerly in order to improve the performance of the workflow system. The eager evaluation of tasks includes the determination of whether such tasks are eligible for eager evaluation, and whether the tasks are unneeded or necessary for the processing of the received event. Workflows which satisfy described design properties allow for improved algorithms for the determination of the whether tasks are eligible, eager, and/or necessary. A graphical user interface is provided for displaying a representation of the evaluation status of the modules and attributes during workflow execution.

Growing community of inventors

Juvisy, France

Eric Simon