Although computer-based tests (CBT) have been administered for many years, improvements in the speed and power of computers coupled with reductions in their cost have made large-scale computer delivery of tests increasingly feasible. CBT is now a common form of test delivery for licensure, certification, and admissions tests. Many large-scale, high-stakes testing programs have introduced CBT either as an option or as the sole means of test delivery. Although this movement to CBT has, to a great extent, been successful, it has not been without problems. Advances in psychometrics are required to ensure that those who rely on test results can have at least the same confidence in CBTs as they have in traditional forms of assessment. This volume stems from an ETS-sponsored colloquium in which more than 200 measurement professionals from eight countries and 29 states convened to assess the current and future status of CBT. The formal agenda for the colloquium was divided into three major segments: Test Models, Test Administration, and Test Analysis and Scoring. Each segment consisted of several presentations followed by comments from noted psychometricians and a break-out session in which presenters and discussants identified important issues and established priorities for a CBT research agenda. This volume contains the papers presented at the colloquium, the discussant remarks based on those papers, and the research agenda that was generated from the break-out sessions. Computer-Based Testing: Building the Foundation for Future Assessments is must reading for professionals, scholars, and advanced students working in the testing field, as well as people in the information technology field who have an interest in testing.
Author(s): Craig N. Mills, Maria T. Potenza, John J. Fremer, William C. Ward
Year: 2002
Language: English
Pages: 344
Contents......Page 6
Preface......Page 10
1 The Work Ahead: A Psychometric Infrastructure for Computerized Adaptive Tests......Page 14
PART I: TEST MODELS......Page 50
2 Models for Delivery of CBTs......Page 54
3 Test Models for Complex CBT......Page 80
4 On Complexity in CBT......Page 102
5 Test Models for Traditional and Complex CBTs......Page 116
PART II: TEST ADMINISTRATION......Page 126
6 Item Development and Pretesting in a CBT Environment......Page 132
7 Developing, Maintaining, and Renewing the Item Inventory to Support CBT......Page 156
8 Controlling Item Exposure & Maintaining Item Security......Page 178
9 New CBT Technical Issues: Developing Items, Pretesting, Test Security, and Item Exposure......Page 206
10 Issues in CBT Administration......Page 218
PART III: TEST ANALYSIS AND SCORING......Page 224
11 Alternatives for Scoring CBTs......Page 228
12 Exploring Issues of Examinee Behavior: Insights Gained from Response-Time Analyses......Page 250
13 Alternatives for Scoring CBTs and Analyzing Examinee Behavior......Page 280
14 Examinee Behavior and Scoring of CBTs......Page 288
PART IV: RESEARCH AGENDA......Page 300
15 CBT: A Research Agenda......Page 302
C......Page 314
G......Page 315
L......Page 316
R......Page 317
T......Page 318
Z......Page 319
A......Page 320
C......Page 321
D......Page 324
F......Page 325
H......Page 326
I......Page 327
M......Page 330
N......Page 331
P......Page 332
Q......Page 333
S......Page 334
T......Page 336
U......Page 338
Z......Page 339