Virage, Incorporated

University of California

General Atomics, Inc.

Amarnath Gupta

Ramesh Jain

Bradley Horowitz

Arun Hampapur

Jeffrey R Bach

Chiao-Fe Shu

Mojgan Monika Gorkani

Richard D Humphrey

Charles Fuller

Michael J Portuesi

Charles E Fuller

Chiao-fe Shu

Bertram Ludaescher

Reagan W Moore

Arcot Rajasekar

Chaitanya K Baru

Richard J Marciano

Subhasis Dasgupta

Margaret Roberts

Maryann E Martone

A method may include generating, based at least on an analysis plan, a logical plan, the analysis plan specifying one or more operations performed on data stored in a polystore that includes a first database management system and a second database management system. The logical plan may include a sequence of logical operators corresponding to the operators specified by the analysis plan. The generating of the logical plan may include rewriting the sequence of logical operators by at least reordering, replacing, and/or combining one or more logical operators in the sequence of logical operators. Candidate physical plans may be generated based on the logical plan. The analysis plan may be executed based on a physical plan selected from the candidate physical plans. Related systems and articles of manufacture are also provided.

Query processing in a polystore

A method may include determining, based on a data analysis plan that includes analytical operations performed on at least a portion of the dataset being ingested into and/or stored in the polystore, an optimization for the ingestion of the dataset into the polystore. The ingestion of the dataset includes storing, in a first database management system and/or a second database management system in the polystore, the portion of the dataset. The analysis plan may be modified, based on the optimization, by adding, removing, and/or reordering one or more analytical operations included in the data analysis plan. During the ingestion of the dataset, the optimization may be applied by routing, based on the optimization, the portion of the dataset for storage at the first database management system and/or the second database management system. Related systems and articles of manufacture are also provided.

Data ingestion into a polystore

A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.

System and method for detecting scene changes in a digital video stream

A system and method that processes video to extract a keyframe-based adequate visual representation. The method utilizes a hierarchical processing technique. The first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds are user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.

Key frame selection

A persistent archive of a collection of data objects comprises a self-describing, infrastructure-independent representation of a logical structure for the collection and a self-describing, infrastructure-independent representation of the data objects. The archive is persistent in that it may be instantiated at an indefinite point in time in the future regardless of the state of technology at that time. A knowledge-based persistent archive of a collection of data objects comprises the foregoing two elements but also a self-describing, infrastructure-independent representation of knowledge relevant to the collection. Another embodiment of a knowledge-based persistent archive comprises at least one representation of a collection or the data objects, at least one self-describing, infrastructure-independent, or executable specification of one or more transformations relevant to the collection, and at least one self-describing, infrastructure-independent, or executable specification of one or more rules relevant to the collection.

Persistent archives

A method and program product for integrating different data sources has steps of obtaining semantic information from each of the different data sources (), creating a conceptual model of () the data source using the semantic information, and accessing one or more secondary knowledge sources. The secondary information sources contain information regarding the relations of data from different of the databases, so that an integrated semantic model of all of the databases () may be created. Queries can then be processed using the integrated semantic model.

Data source integration system and method

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video.

Video cataloger system with audio track extraction

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. In one embodiment, the video is cataloged concurrently with encoding of the video.

Video cataloger system with synchronized encoders

Method for detecting scene changes in a digital video stream

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. In another aspect of the invention, video metadata track processors convert metadata tracks of the video information to produce displayable frames containing hyperlinking between displayable data. Another aspect of the invention is directed to a method of browsing stored video information, including displaying hyperlinked frames of metadata track representations, and selecting and displaying links between displayable frames.

Video cataloger system with hyperlinked output

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. Video feature extractors produce metadata tracks from the video information, and each metadata track indexes the stored video information. A feature extractor registration interface registers the video feature extractors, providing for registration with the video engine of new video feature extractors with new metadata tracks.

Video cataloger system with extensibility

A system and method for improving the retrieval performance of a query engine in a visual information retrieval (VIR) system by encoding domain-specific knowledge into the VIR system through a visual dictionary or 'victionary'. The victionary is a dictionary-like information-mapping module that is used to retrieve visual information at a 'semantic' level. A VIR system that performs generic image processing is enhanced by adding a query transformation unit and a query expansion unit, i.e., the victionary. With these additional components, a user may present a query either as a text term (such as a keyword or phrase), or as an image (with weights) and execute a 'semantic query'. During semantic query processing, the victionary-enhanced system transforms the user's original term (or image query) to a set of equivalent queries, and internally executes all the equivalent queries before presenting the results to the user. The victionary unit is responsible for taking the term (or image query) and finding the equivalent feature vectors (and weights). A result processor accumulates the score sheets of each equivalent query and presents a composite ranking that reflects a faithful representation of each equivalent query to the user. The architecture of the victionary-enhanced system is open and extensible, so that one or more domain-specific victionary modules can be plugged into the system. The plug-in architecture of the victionary module is effected through an application programming interface (API).

Visual dictionary

A system and method for content-based search and retrieval of visual objects. A base visual information retrieval (VIR) engine utilizes a set of universal primitives to operate on the visual objects. An extensible VIR engine allows custom, modular primitives to be defined and registered. A custom primitive addresses domain specific problems and can utilize any image understanding technique. Object attributes can be extracted over the entire image or over only a portion of the object. A schema is defined as a specific collection of primitives. A specific schema implies a specific set of visual features to be processed and a corresponding feature vector to be used for content-based similarity scoring. A primitive registration interface registers custom primitives and facilitates storing of an analysis function and a comparison function to a schema table. A heterogeneous comparison allows objects analyzed by different schemas to be compared if at least one primitive is in common between the schemas. A threshold-based comparison is utilized to improve performance of the VIR engine. A distance between two feature vectors is computed in any of the comparison processes so as to generate a similarity score.

Growing community of inventors

San Diego, CA, United States of America

Amarnath Gupta