Job Knowledge Test Design: A Cognitively-Oriented Approach. Institute Report No. 241.Report as inadecuate




Job Knowledge Test Design: A Cognitively-Oriented Approach. Institute Report No. 241. - Download this document for free, or read online. Document in PDF available to download.





Selected cognitive science methods were used to modify existing test development procedures so that the modified procedures could in turn be used to improve the usefulness of job knowledge tests as a proxy for hands-on performance. A plan-goal graph representation was used to capture the knowledge content and goal structure of the task of using a map, protractor, and compass for purposes of land navigation. Diagnosticity ratings were obtained from task experts to identify those content categories and procedures that would best discriminate among levels of examinee performance and specify the relative proportion of test questions to select. A probability-based inference network was used to score examinee responses and model a more complex pattern of relationships between knowledge and performance. A 100-question knowledge test was developed and used to test the land navigation skills of 358 Marines. Five hands-on proficiency tests (designed to evaluate planning, location, distance, direction, and movement skills) and a work sample performance test were also administered to the Marines. The 0.58 correlation between the job knowledge and hands-on tests and 0.42 correlation between the job knowledge and performance tests were interpreted as evidence supporting the utility of cognitive methods for improving job knowledge tests. (Contains 81 references.) (MN)

Descriptors: Adult Education, Cognitive Measurement, Cognitive Tests, Job Performance, Knowledge Level, Military Personnel, Test Construction, Vocational Education











Author: DuBois, David; And Others

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=7929&id=ED369961







Related documents