International Business Machines Corporation

Bortik Bandyopadhyay

Rajesh Ramkrishna Bordawekar

Tin Kam Ho

A system, apparatus, and a method for training with multi-modal data in a relational database, including generating a first database including a multi-view of the multi-modal data, retrieving a second set of data from an external source via a network, and training a first model according the first database and the second set of data. The first model outputs relationships of the first database with the multi-view and the second set of data.

Method and system for supporting inductive reasoning queries over multi-modal data from relational databases

A computer-implemented method, cognitive intelligence system and computer program product adapt a relational database containing multiple data types. Non-text tokens in the relational database are converted to a textual form. Text is produced based on relations of tokens in the relational database. A set of word vectors is produced for the tokens based on the text. A cognitive intelligence query expressed as a structured query language (SQL) query may be applied to the relational database using the set of word vectors. The form of non-text tokens is one of a numeric value, an SQL type, an image, a video, a time series, latitude and longitude, or chemical structures. A single word embedding model may be applied over one or more tokens in the text. A plurality of sets of preliminary word vectors are computed by applying more than one embedding model over all tokens in the text. The preliminary word vector sets are merged to form the set of word vectors.

Search queries of multi-datatype databases

A computer-implemented method, cognitive intelligence server and computer program product adapt a relational database containing numeric data types. At least one numeric token in the relational database is converted to a textual form. Text is produced based on relations of tokens in the relational database. A set of word vectors is produced based on the text. A cognitive intelligence query, expressed as a structured query language (SQL) query, may be applied to the relational database using the set of word vectors. At least one numeric token in the relational database may be converted to a typed string comprising a heading for a column in the relational database for which the token appears and the numeric value. Converting at least one numeric token in the relational database may comprise clustering tokens in a column of the relational database using a clustering algorithm and replacing each token in the column by a cluster identifier.

Numeric data type support for cognitive intelligence queries

A computer-implemented method, a cognitive intelligence system and computer program product adapt a relational database containing image data types. At least one image token in the relational database is converted to a textual form. Text is produced based on relations of tokens in the relational database. A set of word vectors is produced based on the text. A cognitive intelligence query expressed as a structured query language (SQL) query may be applied to the relational database using the set of word vectors. An image token may be converted to textual form by converting the image to a tag, by using a neural network classification model and replacing the image token with a corresponding cluster identifier, by binary comparison or by a user-specified similarity function. An image token may be converted to a plurality of textual forms using more than one conversion method.

Image support for cognitive intelligence queries

A system and a method for performing queries, including generating text representations of features of various types of data, building a multi-modal word embedding model to capture relationships between the various types of data, and based on the multi-modal word embedding model, performing an inductive reasoning query.

Growing community of inventors

Yorktown Heights, NY, United States of America

Bortik Bandyopadhyay