Deriving Comparable Scores for Computer Adaptive and Conventional Tests: An Example Using the SAT.Report as inadecuate




Deriving Comparable Scores for Computer Adaptive and Conventional Tests: An Example Using the SAT. - Download this document for free, or read online. Document in PDF available to download.





Procedures used to establish the comparability of scores derived from the College Board Admissions Testing Program (ATP) computer adaptive Scholastic Aptitude Test (SAT) prototype and the paper-and-pencil SAT are described in this report. Both the prototype, which is made up of Verbal and Mathematics computer adaptive tests (CATs), and a form of the paper-and-pencil test were administered to more than 500 examinees using a random groups counterbalanced design. Both linear and equipercentile procedures were used for equating in each of the separate testing orders (paper-and-pencil followed by CAT, or CAT, then paper-and-pencil). Data were not pooled across the orders because the groups were not randomly equivalent due to administrative problems. The linear procedure was chosen for each test (Verbal or Mathematical) for each order, and results from the two orders were averaged. The final Verbal and Mathematical CAT conversions were quite similar to the paper-and-pencil conversions, although the two conversions for Verbal and two conversions for Mathematical did differ by as much as 20 scaled score points in certain regions of the scale. Ten tables and 10 figures illustrate the analysis. (Contains 11 references.) (Author/SLD)

Descriptors: Adaptive Testing, College Entrance Examinations, Comparative Analysis, Computer Assisted Testing, Equated Scores, Mathematics Tests, Scaling, Test Items, Verbal Tests











Author: Eignor, Daniel R.

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=11878&id=ED382645







Related documents