Microsoft Technology Licensing, LLC

James Perry Rodrigues

Suneetha Annangi

Orville Jay Potter, Iv

Curtis Dean Anderson

Peter Gerber

Donald Gordon Hardy

Jared W Wilson

Loren Merriman

Aaron R Birnbaum

Patrick Joseph Niemeyer

Micah Andrew Koffron

Ross Faulkner Smith, Jr

Alan T B Brown

Ross F Smith, Jr

Kevin Vanfladern

Software automation testing and validation are provided according to a system that runs automation tests using multiple lab machines and allows the testing to be performed before checking in the code to a version control system. Code changes in a build of the software are provided on a computing device. Automation tests are selected from a list of available tests. When indicated by a job queue, the changed code of the build is forwarded to lab machines allocated by an automation system. An image of the build from the computing device is generated on the lab machines and the automation tests are run against the build. A report is generated and forwarded back to one or more recipients that notifies of the success or failure of the automation testing.

System and method for automation testing and validation

A method, apparatus, and article of manufacture provide a mechanism for inserting performance code markers into programs to obtain and provide data regarding the run-time operation of the programs. The computing system has an init module, a performance code marker module for obtaining and storing the run-time internal state data for later retrieval, and an uninit module. The init module is executed before any run-time internal state data is collected. The performance code marker module is executed each time run-time internal state data is to be collected. The uninit module is executed after all run-time internal state data desired has been collected.

Performance markers to measure performance of features in a program

A method, apparatus, and article of manufacture provide a mechanism for inserting performance markers into programs to obtain and provide data regarding the run-time benchmark timing of the programs. The computing system has an init module for determining if the benchmark timing data is to be collected during the operation of the application program, a performance marker module for obtaining and storing the benchmark timing data for later retrieval, and an uninit module for formatting and storing the obtained benchmark timing data into memory that permits retrieval after the termination of the application program. The init module is executed before any benchmark timing data is collected. The performance marker module is executed each time benchmark timing data is to be collected. The uninit module is executed after all benchmark timing data desired has been collected. The method and computer data product relate to a computer implemented process that inserts one or more code markers into the application program at locations within the application program corresponding to the point at which benchmark timing data is desired and that determines if benchmark timing data is to be collected at each code marker by checking for the existence of processing modules identified by an identification key within a system registry.

Performance markers to measure benchmark timing of features in a program

Performance markers to measure benchmark timing of a plurality of standard features in an application program

A computer operable method for integrating and automating test procedures within a computer application program. Instantiated test operation objects of an object class defined by the present invention correspond to functions to be tested within the computer application program. The test operation objects are instantiated by calls to functions in a test operation runtime library (DLL). The test operation objects include interface method functions which execute the intended test operation and simulate any required data, file, or memory I/O. Other aspects of the methods of the present invention provide rules which permit decisions as to the applicability of each test operation given the state of the application program or the context of the test operation sequence. The various test operation objects are selected to perform a sequence of test steps. In one mode of operation, the methods of the present invention randomly select among all the instantiated test operation objects. In another mode of operation, the methods of the present invention &ldquo;playback&rdquo; a previously recorded sequence of test operation objects to permit reproduction of failures in previous test sequences. In a third mode of operation, the methods of the present invention permit a user to modify or create &ldquo;playback&rdquo; files to customize a test case for a particular focus.

Method for integrating automated software testing with software development

A computer operable method for integrating and automating test procedures within a computer application program. Instantiated test operation objects of an object class defined by the present invention correspond to functions to be tested within the computer application program. The test operation objects are instantiated by calls to functions in a test operation runtime library (DLL). The test operation objects include interface method functions which execute the intended test operation and simulate any required data, file, or memory I/O. Other aspects of the methods of the present invention provide rules which permit decisions as to the applicability of each test operation given the state of the application program or the context of the test operation sequence. The various test operation objects are selected to perform a sequence of test steps. In one mode of operation, the methods of the present invention randomly select among all the instantiated test operation objects. In another mode of operation, the methods of the present invention 'playback' a previously recorded sequence of test operation objects to permit reproduction of failures in previous test sequences. In a third mode of operation, the methods of the present invention permit a user to modify or create 'playback' files to customize a test case for a particular focus.

Method for integrating automated software testing with software

A method for identifying errors in program functions in a program interface found in a header file for the program interface and for identifying errors in program functions in a program interface found in an internal header file and a related public declaration header file for the program interface is provided. In the preferred embodiment, a header file is parsed, and parsing errors are recorded. A test application designed to call each program function in a dynamic link library is generated using information obtained through parsing. The test application is compiled, and compilation errors are recorded. The test application is executed, and errors identified through execution are recorded.

Growing community of inventors

Kirkland, WA, United States of America

James Perry Rodrigues