International Business Machines Corporation

Globalfoundries Inc.

Rachel Tzoref-Brill

Itai Segall

Aviad Zlotnick

Eitan D Farchi

Orna Raz

Howard M Hess

Onn Menahem Shehory

Moshe Klausner

Tatyana Veksler

Yoram Simha Adler

Maja Vukovic

Dale E Blue

Saurabh Sinha

Avi Ziv

Alexander Ivrii

Eli Arbel

Sharon Keidar-Barner

Ariel Jonatan Birnbaum

Steven Mittermaier

Thomas North Adams

Lucas Liu

Brian Midei

Dagmawi Sraj

Tianqiong Wang

Hsu Chien-Jen

A system, computer program product, and method are presented for executing a validation test on at least a portion of a refactored application. The refactored application is resident within a partitioned computing architecture including a plurality of partitions and communication between the partitions uses one or more boundary methods. The refactored application is at least partially similar to a transformed monolithic application. The method includes automatically generating one or more test sequences for exercising one or more functional behaviors for each boundary method of the one or more boundary methods.

Validating inter-partition communication in microservice decomposition

An approach for determining similar text documents. The approach can calculate a first set of vectors for a first cluster of text documents and a first comparison vector for a text document of interest. The approach can select a subset of text documents from the cluster of text documents based on comparing the vectors from the first set of vectors to the first comparison vector and picking a predetermined number of closest comparison text documents. The approach can calculate a second set of vectors for the subset of documents and second comparison vector for the document of interest. The approach can generate similarity ratings for the subset of documents based on pairwise comparisons of the second comparison vector and the second set of vectors. The approach can generate a ranked list of the second cluster of text documents based on the similarity ratings.

Hybrid clustering and pairwise comparison document matching

A method, system and computer program product, the method comprising: receiving a user document describing at least a part of a system to be tested; computing a similarity measurement between the user document and documents in a document corpus, each describing at least part of a system and associated with a combinatorial model representing the at least part of the system, wherein the combinatorial model comprises a set of attributes, a respective domain for each attribute defining possible values for the attribute, and restrictions, wherein each restriction comprises at least one attribute, a respective value and a logical operator, based upon the similarity measurement, selecting selected documents from the document corpus; obtaining one or more combinatorial models corresponding to the selected documents; selecting elements from the combinatorial models; generating an initial combinatorial model for the user document, wherein said generating comprises adding the elements to the initial combinatorial model.

Method and apparatus for test modeling

A method, system and computer program product, the method comprising: receiving a partial description of a combinatorial model defining a test space and comprising a set of attributes, a respective domain for each attribute defining possible values for the attribute, and restrictions, each comprising an attribute, a respective value and a logical operator, the partial description comprising an attribute and a value thereof; computing a similarity measurement between the partial description and each model in a corpus, based on similarity of attributes and domains, and not on a test space defined by compared models, whereby similarity between models is indifferent to a size of the test space of the models; selecting models from the corpus according to the computed similarity measurements; determining elements from the selected models to be suggested for modifying the partial description; and outputting the suggestions to modify the partial description useful for completing the combinatorial model.

Techniques for monitoring computer program test design are described herein. The techniques include a method that specifies a subset of tuples in a combinatorial test model as supervised. At least some of the supervised tuples are confirmed using expert data. The method may include determining a metric indicating progress of the combinatorial test modeling process based on the supervised tuples and the confirmed tuples.

Progress metric for combinatorial models

A methods, apparatus and product for explaining partially illegal combinations in combinatorial models. The method comprising: obtaining a combinatorial model defining a legal test space, the combinatorial model comprising a set of attributes, a respective domain for each attribute defining possible values for the attribute, and a set of restrictions, wherein the restrictions define a combination of values of the attributes that are illegal and are excluded from the legal test case; obtaining a partially illegal combination defining value assignments to a portion of the attributes; automatically identifying an extension of the partially illegal combination, wherein the extension is excluded from the legal test space, wherein the extension can be modified to become legal by changing a portion of the value assignments defined by the partially illegal combination; and outputting the extension.

Explaining partially illegal combinations in combinatorial models

A computer-implemented method comprising: obtaining a description of a test suite which comprises a plurality of tests, wherein each test of the test suite is described by values of functional attributes, wherein at least a portion of the functional attributes are setup-related attributes, wherein a combination of values of the setup-relates attributes potentially indicate a setup activity to be performed prior to executing the test to set up a test environment for the test. Identifying, based on the description of the test suite, a setup activity that is associated with two or more tests, wherein the setup activity is configured to set up a component of the test environment, wherein the identifying is performed by a processor. Providing a first instruction to perform the setup activity prior to executing a first test of the two or more tests. And, providing a second instruction to reuse the component of the test environment when executing additional tests of the two or more tests, whereby avoiding performing duplicate setup activities.

Pretest setup planning

A method executable on one or more processors for modeling a test space is provided. The method may include defining a coverage model including a set of variables. The method may also include selecting one or more variables within at least one subset of a plurality of subsets of the set of variables. The selection may be according to an interaction level requirement defined for at least one or more of the subsets, whereby the interaction level corresponds to a coverage of the test space that covers a plurality of possible combinations of the one or more variables at multiple levels. Furthermore, respective values for the one or more selected variables within the subset of the set of variables may be assigned. The method may also include one or more definitions for value combinations for said variables with assigned values.

Modeling test space for system behavior with optional variable combinations

A method for modeling a test space is provided. The method comprises defining a coverage model including one or more attributes, wherein respective values for the attributes are assigned, one or more definitions of value properties for said attributes with assigned values, and one or more requirements that limit combination of attribute values that are legal for the model, wherein at least one of said requirements is defined using at least one value property.

Attribute value properties for test selection with cartesian product models

A method for refining a test plan is provided. The method comprises defining a coverage model including: one or more variables, wherein respective values for the variables are assigned, and one or more definitions for value combinations for said variables with assigned values, wherein zero or more of said value combinations are defined according to one or more restrictions for the purpose of generating a test plan to test a system for which the coverage model is constructed; determining zero or more uncovered value combinations in the test plan; and providing means to update the test plan.

Test planning based on dynamic coverage analysis

A method, apparatus and product for completion of partial coverage tasks. The method comprising obtaining a partial coverage task defining a test with respect to a functional coverage model of a System Under Test (SUT), wherein the functional coverage model defining functional attributes and respective domains thereof, wherein the functional coverage model further defining one or more restrictions on value combinations of the functional attributes; and enhancing the partial coverage task to include an assignment of a value to a functional attribute, wherein the functional attribute is unassigned in the partial coverage task, wherein the value is an only valid assignment to the functional attribute in view of assignments of other functional attributes and in view of the restrictions.

Completion of partial coverage tasks

An apparatus and computer-implemented method for determining relevance of assignments in combinatorial models, the method comprising: receiving an attribute collection, the attribute collection comprising one or more attributes and one or more possible values for each of attributes; receiving pone or more restrictions, each restriction indicating one or more values for one or more attributes; receiving one or more assignments comprising one or more assigned values for one or more of the attributes; and determining whether the assignment is legal, illegal or partially-legal, wherein an illegal assignment is an assignment which violates a constraint by itself; a legal assignment is an assignment which is not illegal, and for every extension thereof which is illegal, a combination of values assigned to other attributes violates a constraint by itself; and a partially-legal assignment is an assignment which is neither legal nor illegal.

Method and apparatus for determining relevance of assignments in combinatorial models

A method for modeling a test space comprising defining a coverage model including: one or more variables, wherein respective values for the variables are assigned, and restrictions based on which valid variable value combinations are determined for the purpose of testing the model, wherein at least two values that are assignable to the one or more variables are merged to reduce number of variable values in the coverage model.

Automatic designation of equivalent variable values

A method, system and product for explaining illegal combinations in combinatorial models. The method comprising obtaining a combinatorial model and an illegal combination that is excluded from the model by one or more restrictions, utilizing a Satisfiability solver on a satisfiability formula that encodes the legal test space and that assigns values to attributes as defined by the illegal combination, whereby the satisfiability solver provides an indication of unsatisfiability of the satisfiability formula and an UNSAT core comprising a subset of clauses defined by the satisfiability formula which are unsatisfiable; and identifying the one or more restrictions by mapping the clauses of the UNSAT core with clauses encoding the set of restrictions.

Explaining illegal combinations in combinatorial models

A computer-implemented method, computerized apparatus, and computer program product for test validation planning. The computer-implemented method, performed by a processor, comprising: having a test validation activity to be performed to validate results of two or more tests of a test suite; and automatically determining, by a processor, a subset of the two or more tests for which to perform the test validation activity; whereby avoiding performing duplicate validation activities. Optionally, for each test of the test suite a valuation of a set of functional attributes is available, and a subset of the functional attributes is deemed as relevant functional attributes with respect to the test validation activity. In such an embodiment, said determining is based on the valuation of the relevant functional attributes.

Growing community of inventors

Haifa, Israel

Rachel Tzoref-Brill