Exploring the Utility of a Virtual Performance AssessmentReport as inadecuate

Exploring the Utility of a Virtual Performance Assessment - Download this document for free, or read online. Document in PDF available to download.

Society for Research on Educational Effectiveness

With funding from the Institute of Education Sciences (IES), the Virtual Performance Assessment project at the Harvard Graduate School of Education is developing and studying the feasibility of immersive virtual performance assessments (VPAs) to assess scientific inquiry of middle school students as a standardized component of an accountability program (see http://vpa.gse.harvard.edu). The purpose is to provide states with reliable and valid technology-based performance assessments linked to state and NSES academic standards around science content and inquiry practices. In order to ensure construct validity, the authors are using the Evidence Centered Design framework (ECD; Mislevy, Steinberg, & Almond, 2003) to design their assessments. ECD formalizes the procedures generally done by expert assessment developers (Shute, Hansen, & Almond, 2007). Using the ECD approach, an evidentiary assessment argument is formed that connects claims, evidence, and supporting rationales. ECD "provides a framework for developing assessment tasks that elicit evidence (scores) that bears directly on the claims that one wants to make about what a student knows and can do" (Shute, et al., 2007, p. 6). The authors are conducting a series of studies around reliability, validity, and usability of their VPAs. Due to limited space, this paper presents research findings on usability and utility. However, the authors will also present results of their validity and reliability studies whose methods are reported in other papers (e.g Clarke-Midura, Code, Zap, Dede, in press). (Contains 3 tables.)

Descriptors: Evidence, Performance Based Assessment, Performance Tests, Construct Validity, Validity, Academic Standards, Program Effectiveness, Test Construction, Reliability, Grade 8, Likert Scales, Educational Research

Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries[at]sree.org; Web site: http://www.sree.org

Author: Clarke-Midura, Jody; Code, Jillianne; Zap, Nick; Dede, Chris

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=1970&id=ED528503

Related documents