Detecting Differential Rater Functioning over Time DRIFT Using a Rasch Multi-Faceted Rating Scale Model.Report as inadecuate




Detecting Differential Rater Functioning over Time DRIFT Using a Rasch Multi-Faceted Rating Scale Model. - Download this document for free, or read online. Document in PDF available to download.





This paper describes a class of rater effects that depict rater-by-time interactions. This class of rater effects is referred to as differential rater functioning over time (DRIFT). This article describes several types of DRIFT (primacy/recency, differential centrality/extremism, and practice/fatigue) and Rasch measurement procedures designed to identify these types of DRIFT in rating data. These procedures are applied to simulated data and are shown to be useful in classifying raters as being aberrant or nonaberrant about 95% of the time for primacy, recency, and differential centrality and extremism, particularly for moderate or larger effect sizes. Rates of correct classification for practice and fatigue were lower (about 89%) and statistical power exceeded 0.50 only with very large effect sizes. Type I error rates (i.e., incorrect nomination) were near expected levels in all cases. (Contains 10 tables and 32 references.) (Author/SLD)

Descriptors: Classification, Effect Size, Evaluators, Item Response Theory, Rating Scales











Author: Wolfe, Edward W.; Moulder, Bradley C.; Myford, Carol M.

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=9131&id=ED434115







Related documents