International Business Machines Corporation

Raviv Gal

Avi Ziv

Giora Simchoni

Alexander Ivrii

Ziv Nevo

Gil Eliezer Shurek

Anatoly Koyfman

Haim Kermany

Samuel Solomon Ackerman

A computer that receives a set of names of coverage events. The computer creates, by a machine learning-based technique, groups from the set of received names of the coverage events based on the set of names of the coverage events. The computer generates a cross product coverage model from the created groups and identifies subgroups of uncovered events for each of the created groups.

Coverage analysis with event clustering

An example system includes a processor to receive a template-aware coverage data that tracks probabilities of events in a list of events being hit for a set of test-templates over a first and second predetermined period of time. The processor is to generate a hit prediction score for each combination of unhit event in the events and each test-template in the set of test-templates of the second predetermined period of time. The hit prediction score indicates a probability of an unhit event being hit by a particular test-template in a future third predetermined period of time based on the template-aware coverage data and similarities between the events and the test-templates. The processor is to generate a template score for each test-template based on the hit prediction scores for each test-template. The processor is to select a test-template from the set of test-templates based on the template score.

Selecting test-templates using template-aware coverage data

A method, apparatus and product for testing a system under development. The method comprises obtaining information including a current version of a code, and predicting that a subset of code elements from the current version of the code are bug-prone elements. The method comprises determining one or more coverage events corresponding to the bug-prone elements. The method further comprises determining a testing policy based on the one or more coverage events that correspond to the bug-prone elements, wherein the testing policy is determined based on a statistical analysis of coverage likelihood of tests generated based on a test template for each coverage event of the one or more coverage events. The method further comprises implementing the testing policy.

Risk-focused testing

A method, apparatus and product for reducing a number of test templates in a test suite. The method comprises determining, for a first test template of the test suite, a first probabilities vector comprising a first plurality of coverage probabilities with respect to a set of coverage events. The method comprises determining, for a second test template of the test suite, a second probabilities vector comprising a second plurality of coverage probabilities with respect to the set of coverage events. The method further comprises determining that the first test template is statistically dominant over the second test template based on the first probabilities vector and based on the second probabilities vector. The method further comprises providing an output based on the determination of the statistically dominant test template.

Diminution of test templates in test suites

A method, and apparatus and a computer program product for determining coverage in hardware verification based on relations between coverage events. The method comprises generating an over-approximation model of the hardware being verified to perform formal verification thereof with respect to a target coverage event being utilized in the verification process along with a set of coverage events. A score indicating an estimated conditional probability to hit the target coverage event in the verification process, given that the coverage event is hit in the verification process, may be determined for each coverage event based on the formal verification. The method further comprises selecting test suits to be executed in the verification process based on the scores and the test suits probability to hit each coverage event. The verification process may be the performed the selected test suits in order to cover the target coverage event.

Growing community of inventors

Kamon, Israel

Raviv Gal