International Business Machines Corporation

Sap Ag

Philip Shi-lung Yu

Charu Chandra Aggarwal

Kun-Lung Wu

Joel Leonard Wolf

Peter Kenneth Malkin

Paul Andrew Moskowitz

Stephen Joy Boies

Haixun Wang

Shyh-Kwei Chen

David Perry Greene

Edith H Stern

Ming-Syan Chen

Gang Luo

Samuel Dinkin

Barry Edward Willner

Robert J Schloss

Wei Wang

Jiong Yang

Brent Tzion Hailpern

Wei Fan

Michail Vlachos

Asit Dan

Chang-Shing Perng

Kirsten Weale Hildrum

Dinkar Sitaram

Yun-Wu Huang

Marc Hubert Willebeek-LeMair

Xiaohui Gu

Vittorio R Castelli

Chung-Sheng Li

Rong Yan

Frederick Douglis

Christopher Ward

Bugra Gedik

Rong Nickle Chang

Chunqiang Tang

Martin G Kienzle

John Davis Palmer

William H Tetzlaff

Melissa J Buco

Laura Zaihua Luan

Nikhil Bansal

Elizabeth Suzanne Richards

Spyridon Papadimitriou

David Tao

Sam Dinkin

Lisa Karen Fleischer

Gee-Gwo Mei

Mark Gee-Gwo Mei

Gunars Ziedins

William Gregg Rubin

John Benjamin Beurket

Akshay Kumar Reddy Katta

Dinesh C Verma

Daniel Manuel Dias

Sheng Ma

Yoelle Smadja Maarek

Steve Richard White

Anthony Tom Levas

Raymond Byars Jennings, Iii

Paul Michael Dantzig

Mark Steven Squillante

Edward Charles Snible

Dilip Dinkar Kandlur

John Joseph Turek

Jian Yin

Stephen Carl Gates

Shu-Ping Chang

William Grey

Wendy Anne Kellogg

Charles Campbell Palmer

Daniel Manual Dias

Nelson R Manohar

Ming-Ling Lo

Xifeng Yan

Jonathan P Brezin

Mark Richard Laff

Arun Kwangil Ivengar

Robert E Chapman

Harish Ragavan

James P Crosskey

Marina Aleksandrovna Epelman

Chung Sheng Li

Kevin Michael Jordan

Methods and systems for maintaining a materialized view defined on a relation of a relational database include providing a materialized view maintenance system implemented in a computing device having at least a processor and a memory device. It is determined whether an update to a base relation is irrelevant with respect to the materialized view by performing content-based filtering on the base relation using the materialized view maintenance system. An estimate of at least one of an importance and an effect of the update to the base relation is generated. One or both of performing a load shedding operation on the relational database based upon the estimate and quantifying the effect of the update being omitted from the materialized view based on the estimate is performed. The maintained materialized view is displayed so as to exclude determined irrelevant updates.

System and method for real-time materialized view maintenance

There are provided a method, a computer program product, and a system for maintaining a materialized view defined on a relation of a relational database. The method includes the step of performing content-based filtering on the relation to identify an update to the relation as being irrelevant with respect to the materialized view.

There are provided a system and method for resource adaptive, real-time new event detection. The method includes capturing, from among documents in a document streaming environment that includes a plurality of remote streaming document sources, first-story documents. The method further includes storing any of the documents determined to be the first-story documents in a memory. The method also includes classifying the documents as important or non-important based on pre-specified criteria. The method additionally includes storing, in the memory, only information of the documents classified as important, when the memory overflows. The method further includes discarding the documents that are classified as non-important when a document consumption rate from the memory is less than a document insertion rate into the memory. The method additionally includes removing the information of the documents classified as important from the memory subsequent to one of consumption and processing by a consumer.

System and method for resource-adaptive, real-time new event detection

Range query techniques are disclosed for use in accordance with data stream processing systems. A technique is provided for incrementally processing continual range queries against moving objects. This technique is applicable for location-aware services and applications. A technique for evaluating one or more continual range queries over one or more moving objects comprises maintaining a query index with one or more containment-encoded virtual constructs associated with the one or more continual range queries over the one or more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Range query methods and apparatus

Techniques are disclosed for detecting new events in a video stream that yield improved detection efficiency in real time. For example, a method determines whether a given event is a new event in a video stream. The video stream includes a plurality of events. A first step extracts a first set of features (e.g., text features) from the given event. The first set of features is computationally less expensive to process as compared to a second set of features (e.g., image features) associated with the given event. A second step computes one or more first dissimilarity values between the given event and one or more previous events in the video stream using only the first set of features when one or more first dissimilarity criteria exist. A third step determines whether the given event is a new event based on the one or more computed first dissimilarity values.

System and method for real-time new event detection on video streams

Techniques are disclosed for adaptive source filtering and load shedding in such data stream processing systems. For example, in one aspect of the invention, a method for use in filtering data in a distributed data stream processing system, wherein a server receives and processes one or more data streams from one or more data sources, comprises the steps of the server periodically re-configuring one or more filters and sending the one or more periodically re-configured filters to the one or more data sources, and the one or more data sources performing data filtering based on the one or more periodically re-configured filters received from the server.

Methods and apparatus for adaptive source filtering and load shedding for data stream processing

There are provided a system and method for resource adaptive, real-time new event detection. The method includes capturing, from among documents in a document streaming environment, first-story documents that mention previously unmentioned events. The method further includes dynamically adjusting a thoroughness of the capturing step by controlling a number of keywords and documents considered according to a real-time system load.

The present invention provides an index structure for managing weighted-sequences in large databases. A weighted-sequence is defined as a two-dimensional structure in which each element in the sequence is associated with a weight. A series of network events, for instance, is a weighted-sequence because each event is associated with a timestamp. Querying a large sequence database by events' occurrence patterns is a first step towards understanding the temporal causal relationships among the events. The index structure proposed herein enables the efficient retrieval from the database of all subsequences (contiguous and non-contiguous) that match a given query sequence both by events and by weights. The index structure also takes into consideration the nonuniform frequency distribution of events in the sequence data.

System and method for indexing weighted-sequences in large databases

A method (and structure) for monitoring continual range queries against events includes decomposing each range query with one or more predefined virtual constructs, building a query index, and using the query index to match an event with the range queries.

System and method for monitoring events against continual range queries

A system and method for rights protection of a dataset that includes multiple trajectory objects includes determining an intensity power for embedding a watermarking key in a data trajectory. The data trajectory is modified to embed a watermarking key at the intensity power such that the intensity power guarantees an original pair-wise relationship between distance-based neighboring objects before and after embedding of the key such that a modified trajectory provides a watermarked version of the data trajectory.

Systems and methods for rights protection of datasets with dataset structure preservation

A storage system includes a plurality of data vats, and a processor including an optimizing unit that optimizes a value of data stored in the storage system. The optimizing unit optimizes the value by computing and implementing an optimal decision for allocating new data to a first data vat of the plurality of data vats, moving existing data from at least a second data vat of the plurality of data vats to the first data vat, and deleting existing data from the first data vat, based on an amount of data in each of the plurality of data vats.

System and method for optimizing data in value-based storage system

Distributed privacy preserving data mining techniques are provided. A first entity of a plurality of entities in a distributed computing environment exchanges summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity. The first entity may then mine data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol. The first entity may obtain, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular itemset occurs and/or information relating to the number of transactions in which a particular rule is satisfied.

System and method for distributed privacy preserving data mining

Improved privacy preservation techniques are disclosed for use in accordance with data mining. By way of example, a technique for preserving privacy of data records for use in a data mining application comprises the following steps/operations. Different privacy levels are assigned to the data records. Condensed groups are constructed from the data records based on the privacy levels, wherein summary statistics are maintained for each condensed group. Pseudo-data is generated from the summary statistics, wherein the pseudo-data is available for use in the data mining application. Principles of the invention are capable of handling both static and dynamic data sets.

Method and apparatus for variable privacy preservation in data mining

Range query techniques are disclosed for use in accordance with data stream processing systems. In one aspect of the invention, a technique is provided for indexing continual range queries for use in data stream processing. For example, a technique for use in processing a data stream comprises obtaining at least one range query to be associated with the data stream, and building a range query index based on the at least one range query using one or more virtual constructs such that the query index is adaptive to one or more changes in a distribution of range query sizes. The step/operation of building the range query index may further comprise building the range query index such that the range query index accommodates one or more changes in query positions outside a monitoring area of the at least one range query. In another aspect of the invention, a technique is provided for incrementally processing continual range queries against moving objects. For example, a technique for evaluating one and more continual range queries over one and more moving objects comprises maintaining a query index with one and more containment-encoded virtual constructs associated with the one and more continual range queries over the one and more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Growing community of inventors

Chappaqua, NY, United States of America

Philip Shi-lung Yu