International Business Machines Corporation

John Sidney Davis, Ii

Daby Mousse Sow

Maria Rene Ebling

Min Wang

Archan Misra

Marion Lee Blount

Chitra Venkatramani

John Alan Bivens

Norman Howard Cohen

Gelonia L Dent

David Frederick Bantz

Chatschik Bisdikian

Paul Christesten Castro

Rafah A Hosn

Lisa Amini

Joel W Branch

Wim De Pauw

Nicholas Matthew Mitchell

Apratim Purakayastha

Jeremy Brand Sussman

Wolfgang Segmuller

Barry Leiba

Veronique Perret

A system and method for managing provenance data are disclosed. In accordance with one method, input data elements assessed by a processing element are evaluated. The method further includes determining whether an input window comprising the input data elements includes a sufficient amount of relevant input data. If the input window does not include a sufficient amount of relevant input data, then the input data elements are designated for reference in response to a provenance query.

System and method for provenance function window optimization

Techniques are disclosed for determining and validating provenance data in such data stream processing systems. For example, a method for processing data associated with a data stream received by a data stream processing system, wherein the system comprises a plurality of processing elements, comprises the following steps. Input data elements and output data elements associated with at least one processing element of the plurality of processing elements are obtained. One or more intervals are computed for the processing element using data representing observations of associations between inputs elements and output elements of the processing element, wherein, for a given one of the intervals, one or more particular input elements contained within the given interval are determined to have contributed to a particular output element. In another method, intervals are specified, and then validated by comparing the specified intervals against intervals computed based on observations.

Determining and validating provenance data in data stream processing system

A system and method for selection of a provenance dependency function in a stream-based data processing infrastructure to optimize backtracing performance in response to a provenance query includes determining performance of a set of dependency functions associated with an analysis component for determining relevancy of each input event received by the analysis component. The relevancy of each input event is determined according to each dependency function and storing a record of relevant events according to a recording method. Relevancy results of the dependency functions are aggregated, and the dependency functions are ordered according to a criterion. Data provenance is provided for a given output event using the input event recording method associated with a best dependency function according to the criterion.

Techniques are disclosed for maintaining and processing provenance data in such data stream processing systems. For example, a method for processing data associated with a data stream received by a data stream processing system, wherein the system comprises a plurality of processing elements, comprising the following steps. A portion of data associated with the data stream is maintained. The maintained data comprises inputs to each processing element that contributed to an output of each processing element. In response to an alert generated by one of the processing elements, a scheduler is triggered to determine when a pre-calculation of a prospective query related to the alert should be executed. In response to the scheduler, at least a portion of the maintained data is used to determine a set of data that contributed to the alert such that the alert-contributing set of data can be used to respond to the prospective query upon arrival thereof.

Method and apparatus for maintaining and processing provenance data in data stream processing system

The invention provides methods and apparatus for establishing a connection between a mobile client and an external computer network such that the client computer network connection provides the illusion of seamless connectivity. In one aspect of the invention data is processed in a wireless communication network and is received from a access point at a gateway to an external computer network. Access points are disposed in the vicinity of the path of the mobile client. In another aspect of the invention data is processed in a wireless communication network and is received at an onboard proxy from an access point. The data is then transmitted to a mobile client.

Methods and apparatus for continuous connectivity between mobile device and network using dynamic connection spreading

The invention addresses the disadvantage of automated vehicle traffic management systems by providing a solution for predicting and avoiding traffic congestion before the congestion is experienced. The invention includes a decentralized mechanism for predicting congestion. An exemplary embodiment of the invention uses a system of sensors to determine current traffic flow; the sensors communicate their state to a network of servers and then an algorithm is applied to the collected data to predict traffic congestion; upon detection of congestion, signals are communicated to the system controllers to prevent the traffic congestion.

Proactive mechanism for supporting the global management of vehicle traffic flow

Techniques for deriving a provenance of one or more of a plurality of output data elements generated from a given output port of a PC are provided. At least one dependency function is created that relates the one or more output data elements to a set of one or more input ports of the PC and a corresponding plurality of input data elements. The dependency function comprises an encoding of at least one of one or more temporal filters and one or more sequence filters relating to the plurality of input data elements. The at least one dependency function is stored. A history of stream-level bindings of one or more input streams to one or more input ports of the processing component and one or more output streams from one or more output ports of the processing component is stored. The plurality of input data elements belonging to the one or more input streams and the plurality of output data elements belonging to the one or more output streams are stored. The set of one or more input data elements from the plurality of input data elements are determined that relate to the one or more output data elements in accordance with at least one dependency function and the history of stream-level bindings.

Methods and apparatus for functional model-based data provenance in stream processing environments

Improved discovery techniques are provided. For example, in one aspect of the invention, a technique for making providers of a particular kind of data available to an application program includes the following steps/operations. The technique discovers whether one or more data providers are capable of providing the particular kind of data, wherein a discovered data provider is either a connected data provider or a virtual data provider. When a data provider capable of providing the particular kind of data is discovered and the discovered data provider is a virtual data provider, the technique instantiates the virtual data provider. When a data provider capable of providing the particular kind of data is discovered, the technique makes a data-provider handle for the discovered data provider available to the application program, with a common interface.

Methods and apparatus for discovering data providers satisfying provider queries

This invention provides methods, systems and apparatus for performing fast computation of metric queries. To achieve this, in an example embodiment, the present invention segments metric regions into disjoint primitive atomic shapes. It then represents these primitive atomic shapes and then performs off-line computation of their relevant properties. As a result of the off-line computation, the execution of a query requires a minimal number of on-line calculations resulting in a very fast query. Further optimization occurs via storage of query histories and prioritization of queries with respect to the access frequency of a metric space's primitive atomic shapes.

Fast computation of spatial queries in location-based services

A method, apparatus and computer product that enables a processor associated with a node in a computer system having various nodes, the nodes having sensors which provide data, and the nodes being connected by a communications facility acquiring local data from the sensor and remote data from other nodes via the data transfer facility. The nodes process data from a local sensor at the node and from remote sensors at other nodes; and analyze the local data, data from other nodes and local decisions made at and received from other nodes to make a local decision for action at the node. A local decision made at a node is in turn communicated to other nodes.

Growing community of inventors

New York, NY, United States of America

John Sidney Davis, Ii