International Business Machines Corporation

Richard Earl Harken

Gandhi Sivakumar

Abhishek Jain

Praduemn K Goyal

A method, computer program product, and computer system for using agents at a data lake to assist training, testing, and deploying a model for predicting one or more outputs from specified input to the model, using agents at the data lake. The agents identify at the data lake: hardware resources, a first portion of model input data for training and testing the model, a training language, and a first software resource. A first execution of the first software resource is triggered to split the first portion of the model input data into training input data and testing input data. A first portion of the hardware resources is identified for training and testing the model. A second software resource stored at the data lake is identified for optimizing the model in accordance with an optimization algorithm. Training the model at the data lake is triggered.

Agent assisted model development

Methods and systems are provided for migrating a data integration facility, such as an ETL job, from a source data integration platform to a target data integration platform. Certain embodiments involve automatically interpreting at least one operation of a first data integration function adapted to operate on a first data integration platform; translating the at least one interpreted operation into an intermediate format; and regenerating the at least one operation of the first data integration function from the intermediate format to form a regenerated data integration function operation.

Growing community of inventors

Oxford, MI, United States of America

Richard Earl Harken