International Business Machines Corporation

Rajesh Ramkrishna Bordawekar

Ruchir Puri

Oded Shmueli

Minsik Cho

Daniel Brand

Tin Kam Ho

Ulrich Alfons Finkler

Bortik Bandyopadhyay

Luis Alfonso Lastras-Montano

Michele M Franceschini

Emrah Acar

Livio B Soares

Haifeng Qian

Manish Satyapal Gupta

Brian R Konigsburg

Jose Luis Neves

Vincent Kulandaisamy

Donald W Schmidt

Ashish Kundu

Charu Chandra Aggarwal

Sriram Kolinjivadi Padmanabhan

Thomas William Conti

Yefim Shuf

Mukund Raghavachari

Michael George Burke

Stephen C Warren

Christopher Harding

Apoorva Nitsure

Michael Wayne Brown

Philip Shilung Yu

Bugra Gedik

Mauricio J Serrano

Robert Francis Berry

Yi Chen

David Francis Bacon

Anastasios Kementsietsidis

Prabhakar Nandavar Kudva

George Andrei Mihaila

Ravishankar Rao

Lipyeow Lim

Hayato Uenohara

David B Emmes

Jeffrey David Aman

Alan Michael Webb

Martin John Trotter

Susan Patricia Paice

Vladimir Mordvinov

Mark Alvin Sehorne

Samuel Pratt Midkiff

Ravi Shah

Nobuhiro Asai

Elizabeth Anne Hutchison

Edmund James Whittaker West

Alexander C Lang

Dina Thomas

Bryant Wei Lun Kok

Donna Ngar Ting Dillenberger

Matthew L Boyle

Jonathan W Dale

Donna Ngar-Ting Dillenberger

Systems, computer-implemented methods, and computer program products to facilitate capturing relative importance of relational entities for building database embedding models are provided. According to an embodiment, a system can comprise a processor that executes computer-executable components stored in a computer-readable storage medium. The computer executable components can comprise a user input component that can receive user-specified schema information for weight-based model training. The computer executable components can comprise a relational component that can identify one or more importance levels for one or more entities of a relational table based on the user-specified schema information. The computer executable components can comprise a training component that generates a training document having entity occurrences corresponding with the one or more importance levels.

Capturing relative importance of relational entities for embedding

System and method herein interpret results of a semantic clustering Structured Query Language (SQL) Cognitive Intelligence (CI) query by identifying dominant traits of a query input to determine a ranking of query results by identifying influential tokens of the query input based on data statistics and observing the dominant traits in influential tokens of a query output, wherein the identifying the dominant traits of the query input comprises incorporating co-occurrence measurements.

Interpretability of results from cognitive semantic clustering queries over relational datbases

A computer-implemented method accelerates cognitive intelligence queries to a database using semantic keys. A computing device receives a database. The computing device inserts one or more key-value pairs into the database, where the key is a semantic key that is generated from a binary codeword built from a locality sensitive hashing of one or more vectors in a database embedding model of the database, and where the value is a tuple in the database that identifies entries in the database that share predefined features. The computing device uses the one or more key-value pairs for accelerating cognitive intelligence queries to the database.

Semantic indices for accelerating semantic queries on databases

Methods, systems and computer program products for determining recommended parameters for use in generating a word embedding model are provided. Aspects include storing a plurality of meaningful test cases. Each meaningful test case includes a test data profile and one or more test model parameters used to create a word embedding model that has been classified as yielding meaningful results. Aspects include receiving a production data set to be used in generating a new word embedding model. The production data set includes data stored in a relational database having a plurality of columns and a plurality of rows. Aspects include generating a data profile associated with the production data set. Aspects include generating a recommendation for one or more production model parameters for use in building a word embedding model based on the data profile associated with the production data set and the plurality of meaningful test cases.

Word embedding model parameter advisor

Data-parallel ensemble training using gradient boosted trees includes training an ensemble of trees. The training includes splitting a training dataset into several data portions. Each data portion is assigned to each thread group from a set of thread groups. The training further includes executing a stage, in which each thread group, in parallel, trains a respective ensemble of decision trees. Executing the stage includes performing, by each thread group, in parallel, machine learning operations for the respective ensemble of decision trees using the data portion assigned to each thread group. Further, each thread group validates, in parallel, the respective ensemble of decision trees using a data portion assigned to another thread group. Execution of the stage is repeated until a predetermined threshold is satisfied. Further, a prediction is inferenced using the ensemble of decision trees that is formed using the respective ensemble of trees from each of the thread groups.

Communication-efficient data parallel ensemble boosting

Systems, computer-implemented methods or computer program products to facilitate receiving results of a semantic structured query language (SQL) query and employing sparse hash-table based sketches to interpret a semantic structured query language (SQL) query result. A computing component stores a first space-efficient structure sketch in a compressed serialize form. The computing component can load a second space-efficient data structure sketch along with the first space-efficient data structure sketch and can compute one or more interpretability scores by extracting co-occurrence information from the first space-efficient data structure sketch. The second space-efficient data structure sketch can include a sketch for containment check.

Scalable count based interpretability for database artificial intelligence (AI)

A system, apparatus, and a method for training with multi-modal data in a relational database, including generating a first database including a multi-view of the multi-modal data, retrieving a second set of data from an external source via a network, and training a first model according the first database and the second set of data. The first model outputs relationships of the first database with the multi-view and the second set of data.

Method and system for supporting inductive reasoning queries over multi-modal data from relational databases

A computer-implemented method of performing queries using Artificial Intelligence (AI) database embeddings includes the operations of generating a plurality of vector embeddings describing a training data from a database for training a machine learning model. A test vector embedding is generated from the plurality of vector embeddings based on training data for unseen data from one or more rows of the database. One or more vectors from the plurality of vector embeddings describing the training data that are a closest match to the test vector embedding are identified. A task is determined based upon the unseen data. The determined task is performed using the trained machine learning model.

Supporting database queries using unsupervised vector embedding approaches over unseen data

From a first attribute-value pair in a record, new data is created including a first token. Using a first model and using a processor and a memory, each token is vectorized into new data including a corresponding vector. From the record, a target row is selected, wherein a target attribute-value pair in the target row includes a value for which a semantic similarity computation is to be performed. Using a similarity measure, a set of most similar rows to the target row is determined, wherein each row in the set of most similar rows to the target row has a corresponding similarity measure above a threshold similarity measure and wherein each row in the set of most similar rows includes the target attribute. The set of most similar rows is used to compute a response to a database query.

Query response using semantically similar database records

A computer-implemented method according to one embodiment includes identifying a relational database; determining columns of interest within the relational database; creating an unordered group of string tokens for each row of the relational database, utilizing the determined columns of interest; assigning weights for one or more columns within the relational database to one or more string tokens within each unordered group of string tokens to create a plurality of weighted unordered groups of string tokens; and determining a meaning vector for an identifier of each row of the relational database, utilizing the plurality of weighted unordered groups of string tokens.

Building a word embedding model to capture relational data semantics

Methods, systems and computer program products for updating a word embedding model are provided. Aspects include receiving a first data set comprising a relational database having a plurality of words. Aspects also include generating a word embedding model comprising a plurality of word vectors by training a neural network using unsupervised machine learning based on the first data set. Each word vector of the plurality of word vector corresponds to a unique word of the plurality of words. Aspects also include storing the plurality of word vectors and a representation of a hidden layer of the neural network. Aspects also include receiving a second data set comprising data that has been added to the relational database. Aspects also include updating the word embedding model based on the second data set and the stored representation of the hidden layer of the neural network.

Dynamic updating of a word embedding model

A first observation window in a first time series is identified. The first observation window is preceded by a first portion of the first time series. A neural network is trained using the first portion of the first time series and the first observation window, and weights are extracted from the middle layers of the neural network. A first feature vector is generated based on the weights. A second observation window in a second time series is identified, where the second observation window is preceded by a first portion of the second time series. A second feature vector associated with the second observation window is determined. The second feature vector is based at least in part on the first set of weights. A similarity between the first and second observation windows is determined based on comparing the first feature vector and the second feature vector.

Comparing time series data using context-based similarity

A database system, computer program product, and a method for evaluating aggregates in database systems includes hashing of aggregation keys on a per bucket basis, and depending on a number of hashed tuples per bucket, sorting said tuples. Additionally, depending on the number of hashed tuples per bucket, the bucket is kept without change. Moreover, depending on the number of hashed tuples per bucket, maintaining a secondary hash table for a particular bucket, map tuples to it, aggregate as you map.

Method and system for hybrid sort and hash-based query execution

A computer-implemented method, cognitive intelligence system and computer program product adapt a relational database containing multiple data types. Non-text tokens in the relational database are converted to a textual form. Text is produced based on relations of tokens in the relational database. A set of word vectors is produced for the tokens based on the text. A cognitive intelligence query expressed as a structured query language (SQL) query may be applied to the relational database using the set of word vectors. The form of non-text tokens is one of a numeric value, an SQL type, an image, a video, a time series, latitude and longitude, or chemical structures. A single word embedding model may be applied over one or more tokens in the text. A plurality of sets of preliminary word vectors are computed by applying more than one embedding model over all tokens in the text. The preliminary word vector sets are merged to form the set of word vectors.

Search queries of multi-datatype databases

From a first attribute-value pair in a record, new data comprising a first token is created. From each token using a processor and a memory, new data including a corresponding vector is computed. From the record, a target row is selected, wherein a target attribute-value pair in the target row includes a value requiring correction. Using a similarity measure, a set of most similar rows to the target row is determined, wherein each row in the set of most similar rows to the target row has a corresponding similarity measure above a threshold similarity measure and wherein each row in the set of most similar rows includes the target attribute. From values corresponding to the target attribute in the set of most similar rows, a replacement value is determined. The value requiring correction in the target row is replaced with the replacement value.

Record correction and completion using data sourced from contextually similar records

Growing community of inventors

Yorktown Heights, NY, United States of America

Rajesh Ramkrishna Bordawekar