International Business Machines Corporation

Kyle R Moser

Thomas William Conti

Thomas R Brown

Michael E Gildein, Ii

Venkat Venkatsubra

Andrew P Wack

Maria Rose Ward

Pedro V Torres

Srikanth Subramanian

Aspects of the present invention include a method, system and computer program product determining, scoring and reporting the complexity of customer and test environments and workloads. The method includes a processor performing an accounting of factors related to complexity of a plurality of environments and workloads; determining one or more formulas to use for determining an overall score and ranking for each one of the plurality of environments and workloads; collecting relative environment and workload data; determining a complexity score for each one of the plurality of environments and workloads; and determining a complexity ranking for each one of the plurality of environments and workloads.

Using workload profiling and analytics to understand and score complexity of test environments and workloads

Aspects of the present invention include a method, system and computer program product for comparing customer test environments and workloads to customer production environments and workloads and for using any differences to make changes to the customer test resources to better match customer production goals. The method includes a processor setting one or more characteristics related to customer production; collecting customer production data; modeling a customer test workload in relation to a corresponding customer production workload; collecting customer test data; comparing the customer test data to the customer production data; determining that at least one difference exists between the customer test data and the customer production data; and determining from the at least one difference between the customer test data and the customer production data, one or more ineffective customer test resources and updating the one or more ineffective customer test resources.

Using run time and historical customer profiling and analytics to determine customer test vs. production differences, and to enhance customer test effectiveness

Aspects of the present invention include a method, system and computer program product. The method includes a processor determining one or more functional areas of focus for a profiling effort for the specific customer; determining one or more general functional areas of interest to the business entity and to a general set of customers; determining which environments and workloads of the specific customer to focus on in the profiling effort; determining data collection components of a platform for baseline environment and workload information for use in a data collection request for the specific customer; specifying any command and configuration data for the platform; specifying a baseline environment and workload data collection duration; and generating a data collection request for the specific customer that includes the baseline environment and workload data collection duration and time frames and the command and configuration data for the platform.

Standardizing customer and test data and information collection for run time and historical profiling environments and workload comparisons

Aspects of the present invention include a method, system and computer program product for determining, scoring and reporting the portability of customer and test environments and workloads. The method includes a processor performing an accounting of factors related to portability of a plurality of environments and workloads; determining one or more formulas to use for determining an overall score and ranking for each one of the plurality of environments and workloads; collecting relative environment and workload data; determining a portability score for each one of the plurality of environments and workloads; and determining a portability ranking for each one of the plurality of environments and workloads.

Using customer and workload profiling and analytics to determine, score, and report portability of customer and test environments and workloads

Aspects of the present invention include a method, system and computer program product determining and scoring customer adoption levels of platform technologies. The method includes a processor accounting for each one of customer platform technology categories; determining one or more formulas to score and rank customer platform adoption levels; acquiring the relative platform technologies customer adoption levels data; determining a customer platform adoption score for each one of the customer platform technology categories; and determining a customer platform adoption ranking for each one of the customer platform technology categories.

Using run-time and historical customer profiling and analytics to determine and score customer adoption levels of platform technologies

Aspects of the present invention include a method, system and computer program product for more accurately porting a customer or test workload. The method includes a processor acquiring relative customer or test workload and environment data for determining portability feasibility; determining workload and environment portability scores and rankings; comparing a current workload and environment to previously ported workloads and workload port analyses; determining which workload components may be ported; determining actual workload portability feasibility; generating one or more agile workload portability data reports that indicate which workload components are candidates for agile porting; and determining to not provide for viewing a summary of the actual workload portability feasibility or the one or more agile workload portability data reports.

Using customer profiling and analytics to more accurately estimate and generate an agile bill of requirements and sprints for customer or test workload port

Aspects of the present invention include a method, system and computer program product. The method includes a processor determining one or more customer workload and environment features by one or more of geography, country or culture; determining one or more customer workload and environment features by industry; determining that at least one of the one or more customer workload and environment features by one or more of geography, country, culture or industry is beneficial to one or more other customers; and determining that at least one of the one or more customer workload and environment features by one or more of geography, country, culture or industry is beneficial to best practices.

Determining if customer characteristics by customer geography, country, culture or industry may be further applicable to a wider customer set

Aspects of the present invention include a method, system and computer program product. The method includes a processor identifying a plurality of workload characteristics by customer geography, country and/or culture; identifying one or more workload characteristics within a customer geography, country and/or culture; creating a test workload execution model; determining that a peak customer test coverage is beneficial to at least one customer in other customer geographies, countries and/or cultures; and reducing, by the processor, a number of test resources allocated to at least one customer in other customer geographies, countries and/or cultures.

Using customer profiling and analytics to understand customer workload complexity and characteristics by customer geography, country and culture

Aspects of the present invention include a method, system and computer program product for utilizing various data to determine the effectiveness of a software testing procedure. The method includes preloading, by a processor, into a database data related to workloads and workload data, data related to analysis points, and customer data. The method also includes determining, by the processor, whether to modify a workload model, to run a workload or to perform one of post processing analytics or run time analytics. The method further includes performing, by the processor, one of post processing analytics or run time analytics of the data preloaded into the database.

Using test workload run facts and problem discovery data as input for business analytics to determine test effectiveness

Aspects of the present invention include a method, system and computer program product for understanding, ranking, scoring and visualizing customer implementation of best practices. The method includes the processor performing an accounting of metrics relating to best practices implementation categories; determining one or more formulas that assign a score to each of the metrics relating to best practices implementation categories; acquiring relative customer best practices data; determining a score for each one of the best practices implementation categories; and determining a ranking for each one of the best practices implementation categories in relation to the acquired relative customer best practices data.

Using customer profiling and analytics to understand, rank, score, and visualize best practices

Aspects of the present invention include a method, system and computer program product. The method includes a processor performing an accounting of available test resources within one or more organizations; storing data relating to the accounting of available test resources; storing data relating to one or more test resource goals; determining to maintain the data relating to the accounting of available test resources; determining to analyze the data relating to the accounting of available test resources; analyzing the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals; and determining from the analyzing, by the processor, the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals that the available test resources within one or more organizations are either optimal or non-optimal.

Measuring and optimizing test resources and test coverage effectiveness through run time customer profiling and analytics

Aspects of the present invention include a method, system and computer program product for providing automated run time and historical test workload report scoring. The method includes caching, by a processor, historical data relating to a customer workload; and caching, by the processor, data relating to an active workload test. The method also includes determining, by the processor, one or more statistical measures between the historical data relating to a customer workload and the data relating to an active workload test; generating, by the processor, one or more workload report scores based on the statistical measures; and displaying, by the processor, the one or more workload report scores.

Run time and historical workload report scores for customer profiling visualization

A method obtains from a database historical data values for each of a plurality of workload data points relating to a prior workload run; determines a threshold value for each of the plurality of workload data points relating to the prior workload run; obtains current data values for each of a plurality of workload data points relating to a current workload test run and corresponding to the plurality of workload data points in the historical data values; determines one or more statistical measures relating to the historical data values and the current data values; determines whether the threshold value for at least one of the plurality of data points relating to the prior workload run is not achieved in a set amount of time by the current data value of the same data point relating to the prior workload run; and provides an alert that the threshold value has not been achieved.

Growing community of inventors

Stone Ridge, NY, United States of America

Kyle R Moser