International Business Machines Corporation

Julian J Vizor

Arron J Harden

Leonard D Greenwood

Xiaoyan Pu

Alex Swain

Joseph Bangs

Ajay Kumar Sood

Brian K Caufield

Martin J Sanders

A method for extract transform load (ETL) input suggestions for an ETL system in which a current job is being created. A method includes: determining when a new input is made in the current job in the ETL system and dynamically receiving the new input which includes a connection between stages input or a property of a stage input; updating stored information relating to the current job with the new input; accessing rules which apply to the current job; analyzing and applying the rules based on the new input and the current job stored information to generate one or more suggested next inputs in the current job; providing a weighting for the one or more suggested next inputs based on the analysis and application of the rules; and providing a prompt in the current job in the ETL system with the suggested one or more next inputs and their weightings.

Extract transform load input suggestion

Embodiments relate to integrating data transform test with a data transform tool. A method and system are described for creating a data transform test for a data transform job having a data transform script, the method includes determining all data transform units available in the data transform job, determining a subset of the available data transform units for a new test, and generating a subset test execution script for the subset of data transform units from the data transform script. The method further includes determining boundary test data at each boundary of the subset of data transform units, defining a data transform test, and saving the data transform test for later testing. The data transform test includes the subset of data transform units with subset test execution script and with boundary test data.

Integrating data transform test with data transform tool

Methods and systems are provided for extract transform load (ETL) input suggestion for an ETL system in which a current job is being created. A method includes: determining when a new input is made in the current job in the ETL system and dynamically receiving the new input; updating stored information relating to the current job with the new input; accessing rules which apply to the current job; analyzing and applying the rules based on the new input and the current job stored information to generate one or more suggested next inputs in the current job; providing a weighting for the one or more suggested next inputs based on the analysis and application of the rules; and providing a prompt in the current job in the ETL system with the suggested one or more next inputs and their weightings.

According to one embodiment of the present invention, a system tests jobs in a computing environment. The system creates a test case for one or more existing executable jobs without modifying the job design or recompiling the executable itself, wherein the test case includes one or more capture points in a job flow of the executable jobs and corresponding rules for capturing data, identification of data for testing the one or more executable jobs, and rules for comparing the captured data to expected results. The system captures the data at the one or more capture points in the job flow in accordance with the test case and generates a baseline of expected results. The system executes the test case to test the one or more executable jobs by capturing data at the one or more capture points generated from execution of the one or more executable jobs and compares result data from the one or more capture points to the baseline of expected results in accordance with the comparison rules to determine a result of the test. Embodiments of the present invention further include a method and computer program product for testing jobs in a computing environment in substantially the same manners described above.

Test framework for computing jobs

A controller is coupled to an Extract-Transform-Load (ETL) processor, which is connected to data storage devices. The controller comprises: a hardware storage device; a storage control component for storing, on said hardware storage device, a set of criteria for preferredness of ETL stage placements; an I/O input device detecting component for recognizing a proposed placement of a stage on a GUI canvas on the display device; an analytical component for analyzing an eventual result of the proposed placement in an ETL activity represented on the GUI canvas; a comparator for comparing the eventual result of the proposed placement in the ETL activity with the set of criteria; and an indicator control component for, responsive to an outcome of an operation of the comparator, providing to the user an indicator of a degree of preferredness of said proposed placement according to the set of criteria.

Extract-transform-load processor controller

Provided are a computer implemented method, computer program product, and system for presenting information about multiple data series. The multiple data series are obtained. A main graphing area with a graph showing one or more of the obtained data series, an active process execution metrics area with information about the one or more obtained data series shown in the graph, and an available process execution metrics area with one or more thumbnail views of one or more of the obtained data series available for selection to be shown in the graph are displayed.

Growing community of inventors

Milton Keynes, United Kingdom

Julian J Vizor