Educational Testing Service

Randy E Bennett

Paul Douglas Deane

Mo Zhang

Peter D Brittingham

Robert L Rarich

Mark Kevin Singley

Chen Li

James H Fife

Krishna Jha

Theresa Richter

Warren Sack

Irvin R Katz

Amanda Roth

Eowyn Winchester

Hongwen Guo

Mary E Morley

Mark G Zelman

Peter Van Rijn

A method comprising accessing a first data structure that is associated with a first product prepared by a student and that includes first process data associated with a process performed by the student in generating the first product, analyzing the first data structure to generate a first characterization score based on the first product and the first process data, accessing a second data structure that is associated with a second product prepared by the student and that includes second process data associated with a process performed by the student in generating the second product, analyzing the second data structure to generate a second characterization score based on the second product and the second process data, and calculating a skill level change metric based on the first characterization score and the second characterization score indicating a change in ability level of the student over a course of the scenario-based assessment.

Platform for characterizing performance on a scenario-based assessment to school differences in curriculum

A computerized method and system for creating test items by generating variants from a test item model, comprising the steps of creating a new test item model by identifying elements of an initial test item or test item model to be variabilized, variabilizing the elements thereby creating test item variables, indicating values the variables can assume, defining the variables, and generating test item variants utilizing a simultaneous constraint solver. The initial test item can be a pre-existing test item or test item model, a newly created test item or even a conceptual template in the mind of the test item creator. The generated test item variants are displayed to the test item creator. The test item creator can store and forward acceptable test item variants for later use as test items. Test item models can be stored for later use in generating new test item variants.

Computer based test item generation

Disclosed is a method and system for administering to a student a problem in computer science for testing, analysis and feedback. The student is provided with an item pool of predetermined test problems to be selected by the student. The student inputs a solution in response to the problem selected, and the solution program is converted, by lexing and parsing, into an abstract syntax tree representation. Predetermined knowledge base patterns are selected from a knowledge base and compared against portions of the abstract syntax tree. Messages and a score are provided to the student which indicate the correctness or incorrectness of the solution program, as determined by the knowledge base patterns which were matched against the portions of the abstract syntax tree. The present method and system is especially qualified to analyze free-response test items.

Method and system for interactive computer science testing, anaylsis and

Growing community of inventors

Newtown, PA, United States of America

Randy E Bennett