International Business Machines Corporation

Aaron B Brown

Joseph L Hellerstein

Joseph Y Kim

Sam Sampson Lightstone

John William Sweitzer

William H Tetzlaff

Carolyn Haibt Norton

Tsz-Kin Lau

Peter K L Shum

Techniques are disclosed for combining multiple benchmarks for use in assessing characteristics of a computing system. For example, a method for configuring and running multiple benchmarks includes the following steps. A multiple benchmark specification is obtained. The multiple benchmark specification includes multiple individual benchmark specifications and a multiple benchmark workflow describing an ordering according to which the multiple individual benchmarks are to be configured and run. The multiple benchmarks are configured and run according to the ordering identified in the multiple benchmark workflow. Results of the multiple benchmark runs are recorded. One or more specifications or results associated with at least one of the multiple benchmarks are utilized as part of a benchmark specification for at least another of the multiple benchmarks so as to provide consistency between at least the one and the other of the multiple benchmarks.

Method and system for combining multiple benchmarks

Techniques are disclosed for integrating complexity analysis with procedure authoring (design and/or documentation). By way of example, a technique for authoring a procedure associated with a computing system operation based on a complexity analysis associated with the operation and the computing system implementing the operation comprises the following steps/operations. A procedure associated with a computing system operation is generated, wherein the generated procedure represents a new procedure or an edited existing procedure. A structured representation of the generated procedure is extracted from the generated procedure. The structured representation of the generated procedure is analyzed to produce complexity analysis results, wherein at least a portion of the complexity analysis results are fed back to a procedure author for use in selectively altering the generated procedure. The technique may also further comprise generating documentation relating to the generated procedure from the structured representation of the generated procedure.

System and methods for integrating authoring with complexity analysis for computing system operation procedures

A technique for quantitatively evaluating a complexity associated with a configuration of a system under evaluation comprises the following steps/operations. Configuration-related data for the system under evaluation is collected. At least a portion of the configuration-related data is quantitatively analyzed using a model of human configuration cost to estimate a configuration complexity of the system under evaluation. A quality of the configuration of the system under evaluation is assessed. The configuration complexity of the system under evaluation is reported based on the quantitative analysis and the quality assessment. The step/operation of reporting the configuration complexity of the system under evaluation further comprises producing a report via an algorithm that computes a financial impact of a specified configuration process. The technique is useable to optimize a financial cost of providing one or more hosting services by selecting one or more system configurations that minimize a configuration cost.

System and methods for quantitatively evaluating complexity of computing system configuration

The present invention is a method and an apparatus for detecting dependability vulnerabilities in production IT environments. In one embodiment, a method for detecting a dependability vulnerability in a production IT environment includes injecting a synthetic disturbance into the production IT environment and observing the response of the production IT environment to the synthetic disturbance.

Method and apparatus for detecting dependability vulnerabilities

Techniques are disclosed for configuring computing systems. Configuration-related data for the system under evaluation is collected. At least a portion of the configuration-related data is quantitatively analyzed to estimate a configuration complexity of the system under evaluation. The configuration complexity of the system under evaluation is reported based on the quantitative analysis. The technique may further assess a quality of the configuration of the system under evaluation. Then, the reporting step/operation may further report the configuration complexity of the system under evaluation based on the quantitative analysis and the quality assessment.

Growing community of inventors

Croton on Hudson, NY, United States of America

Aaron B Brown