Examining Two Strategies to Link Mixed-Format Tests Using Multiple-Choice Anchors. Research Report. ETS RR-10-18Report as inadecuate




Examining Two Strategies to Link Mixed-Format Tests Using Multiple-Choice Anchors. Research Report. ETS RR-10-18 - Download this document for free, or read online. Document in PDF available to download.



Educational Testing Service

This study examined the use of an all multiple-choice (MC) anchor for linking mixed format tests containing both MC and constructed-response (CR) items, in a nonequivalent groups design. An MC-only anchor could effectively link two such test forms if either (a) the MC and CR portions of the test measured the same construct, so that the MC anchor adequately represented the entire test, or (b) the relationship between the MC portion and the total test remained constant across the new and reference linking groups. The study also evaluated whether linking mixed-format tests through MC-only anchors would be more effective than a two-stage strategy in which MC portions were equated through MC anchors and then composite scores were scaled to the MC scores. Anchor linking and two-stage linking yielded identical (or nearly so) results for both linear and nonlinear chained linking methods. With post-stratification linking methods the two-stage strategy resulted in smaller bias. The paper discusses some advantages of both approaches. (Contains 10 figures, 5 tables and 2 notes.)

Descriptors: Equated Scores, Test Format, Multiple Choice Tests, Statistical Analysis, Statistical Inference, Sampling, Regression (Statistics)

Educational Testing Service. Rosedale Road Mailstop 19R, Princeton, NJ 08541-0001. Tel: 609-921-9000; Fax: 609-734-5410; Web site: http://www.ets.org





Author: Walker, Michael E.; Kim, Sooyeon

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=3691&id=ED523779



DOWNLOAD PDF




Related documents