Educational Testing Service

Leonard C Swanson

Frank J Romano

Roger C Kershaw

William C Ward, Jr

Kathleen Marie Sheehan

Richard N Devore

Charles Lewis

Martha L Stocking

The present invention provides a system and method for computer based testing. The system of the present invention comprises a test development system for producing a computerized test, a test delivery system for delivering the computerized test to an examinee, and a workstation on which the computerized test is delivered to the examinee. The method of the present invention comprises producing a computerized test, delivering the computerized test to an examinee and recording examinee responses to questions presented to the examinee during the delivery of the computerized test. A method of producing a computerized test is also provided. This method comprises preparing a test document of items, computerizing each item, preparing scripts and other test components and packaging the items, scripts and other test components together to form the computerized test. A method of delivering a computerized test is also provided in which a standardized test is created, an electronic form of the test is then prepared, the items of the test are presented to an examinee on a workstations display and the examinee's responses are accepted and recorded. A method of administering a computerized test is further provided in which a computerized test is installed on a workstation and then the delivery of the test to an examinee is initiated. A data distribution system is further provided. The system comprises an examinee performance database and a file processing component for receiving files from the computer based testing system and updating the examinee performance database with information from these files.

System and methods for computer based testing

A method is disclosed for incorporating into the construction of adaptive tests expert test development practices. The method is an application of a weighted deviations model and an heuristic for automated item selection. Taken into account are the number and complexity of constraints on item selection found in expert test development practice. The method of the present invention incorporates content, overlap, and set constraints on the sequential selection of items as desired properties of the resultant adaptive tests, rather than as strict requirements. Aggregate failures are minimized in the same fashion as in the construction of conventional tests. The extent to which restrictions on item selection are not satisfied is then the result of deficiencies in the item pool, as it is with conventional tests.

Method and apparatus for administration of computerized adaptive tests

System and method for computer based testing

A computerized mastery testing system providing for the computerized implementation of sequential testing in order to reduce test length without sacrificing mastery classification accuracy. The mastery testing system is based on Item Response Theory and Bayesian Decision Theory which are used to qualify collections of test items, administered as a unit, and determine the decision rules regarding examinee's responses thereto. The test item units are randomly and sequentially presented to the examinee by a computer test administrator. The administrator periodically determines, based on previous responses, whether the examinee may be classified as a nonmaster or master or whether more responses are necessary. If more responses are necessary it will present as many additional test item units as required for classification. The method provides for determining the test specifications, creating an item pool, obtaining IRT statistics for each item, determining ability values, assembling items into testlets, verifying the testlets, selecting loss functions and prior probability of mastery, estimating cutscores, packaging the test for administration, randomly and sequentially administering testlets to the examinee until a pass/fail decision can be made.

Computerized mastery testing system, a computer administered variable

Growing community of inventors

Hopewell, NJ, United States of America

Leonard C Swanson