The Hierarchy Misfit Index: Evaluating Person Fit for Cognitive Diagnostic AssessmentReport as inadecuate




The Hierarchy Misfit Index: Evaluating Person Fit for Cognitive Diagnostic Assessment - Download this document for free, or read online. Document in PDF available to download.

CDM, AHM, HCI, CDA, hierarchical misft index, cognitive diagnostic model, hierarchical consistency index, educational measurement, person fit index, attribute hierarchy method

Guo, Qi

Supervisor and department: Leighton, Jacqueline Educational Psychology

Examining committee member and department: McGarvey, Lynn Elementary Education Cui, Ying Educational Psychology

Department: Department of Educational Psychology

Specialization: Measurement, Evaluation and Cognition

Date accepted: 2012-08-08T15:05:35Z

Graduation date: 2012-11

Degree: Master of Education

Degree level: Master's

Abstract: As cognitive diagnostic models CDMs become increasingly popular in modern educational measurement, it is important to develop a person fit index that examines the appropriateness of a CDM for each individual examinee. The purpose of this study is to propose a new person fit index, the hierarchy misfit index HMI, for CDMs, and test the power and type 1 error of the HMI at detecting misfitting item response vectors using a simulation study. The results of the simulation study showed that the HMI had high powers and acceptable type 1 errors when a test consisted of highly discriminating items. But when a test consisted of low discriminating items, the HMI’s type 1 errors were too high to be acceptable. A comparison was also made with a previously developed person fit index, the hierarchical consistency index, HCI. The results showed that the HMI performed better in high item discrimination conditions.

Language: English

DOI: doi:10.7939-R3771T

Rights: Permission is hereby granted to the University of Alberta Libraries to reproduce single copies of this thesis and to lend or sell such copies for private, scholarly or scientific research purposes only. Where the thesis is converted to, or otherwise made available in digital form, the University of Alberta will advise potential users of the thesis of these terms. The author reserves all other publication and other rights in association with the copyright in the thesis and, except as herein before provided, neither the thesis nor any substantial portion thereof may be printed or otherwise reproduced in any material form whatsoever without the author's prior written permission.





Author: Guo, Qi

Source: https://era.library.ualberta.ca/


Teaser



University of Alberta The Hierarchy Misfit Index: Evaluating Person Fit for Cognitive Diagnostic Assessment by Qi Guo A thesis submitted to the Faculty of Graduate Studies and Research in partial fulfillment of the requirements for the degree of Master of Education in Measurement, Evaluation and Cognition Educational Psychology ©Qi Guo Fall, 2012 Edmonton, Alberta Permission is hereby granted to the University of Alberta Libraries to reproduce single copies of this thesis and to lend or sell such cipies for private, scholarly or scientific research purposes only. Where the thesis is converted to, or otherwise made available in digital form, the University of Alberta will advise potential users of the thesis of these terms. The author reserves all other publication and other rights in association with the copyright in the thesis and, except as herein before provided, neigher the thesis nor any substantial portion thereof may be printed or otherwise reproduced in any material form whatsoever without the author’s prior written permission. ABSTRACT As cognitive diagnostic models (CDMs) become increasingly popular in modern educational measurement, it is important to develop a person fit index that examines the appropriateness of a CDM for each individual examinee.
The purpose of this study is to propose a new person fit index, the hierarchy misfit index (HMI), for CDMs, and test the power and type 1 error of the HMI at detecting misfitting item response vectors using a simulation study.
The results of the simulation study showed that the HMI had high powers and acceptable type 1 errors when a test consisted of highly discriminating items.
But when a test consisted of low discriminating items, the HMI’s type 1 errors were too high to be acceptable.
A comparison was also made with a previously developed person fit index, the hierarchical consistency index, (HCI).
The results showed that the HMI performed better in high item discrimination conditions. ACKNO...





Related documents