Educational Testing Service

Charles Lewis

Kathleen Marie Sheehan

Leonard C Swanson

Richard N Devore

Martha L Stocking

A method and system for item exposure control in computer based testing. A set of exposure control parameters representing the probability that an item selected from an item pool is administered to a test taker for each item in the pool is generated through computer based test simulation. The exposure control parameters can be initialized using values less than one that reflect the expected value after the test simulations are complete. The items in the item pool are ordered from most desirable to least desirable to administer based on predefined criteria. The set of exposure control parameters are used to generate operant probabilities associated with each of the items and represent the probability that the item is selected to be administered given that no more desirable item has been administered first. Items are randomly selected to be administered based on their corresponding operant probabilities. Stimuli may be included in the item list, and when randomly selected, the set of items associated with the stimulus are administered. The operant probabilities can be adjusted by item security parameters which are defined based on a desired measure of test security. A system for carrying out the steps includes an exposure control parameter generator, an item selector, and an item administrator.

Method and system for controlling item exposure in computer based testing

A computerized mastery testing system providing for the computerized implementation of sequential testing in order to reduce test length without sacrificing mastery classification accuracy. The mastery testing system is based on Item Response Theory and Bayesian Decision Theory which are used to qualify collections of test items, administered as a unit, and determine the decision rules regarding examinee's responses thereto. The test item units are randomly and sequentially presented to the examinee by a computer test administrator. The administrator periodically determines, based on previous responses, whether the examinee may be classified as a nonmaster or master or whether more responses are necessary. If more responses are necessary it will present as many additional test item units as required for classification. The method provides for determining the test specifications, creating an item pool, obtaining IRT statistics for each item, determining ability values, assembling items into testlets, verifying the testlets, selecting loss functions and prior probability of mastery, estimating cutscores, packaging the test for administration, randomly and sequentially administering testlets to the examinee until a pass/fail decision can be made.

Growing community of inventors

Montgomery County, Somerset County, NJ, United States of America

Charles Lewis