Multilevel Issues in the Application of Propensity Score Matching: Simulations and Results for Evaluation of the Advanced Placement ProgramReport as inadecuate




Multilevel Issues in the Application of Propensity Score Matching: Simulations and Results for Evaluation of the Advanced Placement Program - Download this document for free, or read online. Document in PDF available to download.



College Board, Slides presented at the Annual Meeting of the American Educational Research Association (AERA) (Vancouver, BC, Apr 17, 2012)

The main goal of this study was to illustrate and provide some direction for dealing with the complexities of propensity score matching within different multilevel contexts. Special attention is given to how procedures typically applied in a non-hierarchical setting may be modified to properly reduce the expected bias in the estimated treatment effect of a high school-level intervention on college-level outcomes. In particular, students self-selected into a high school level intervention and the outcome of interest was observed within the context of the college or university in which students subsequently enrolled. A simulation was prepared to delineate the relevant issues and to demonstrate the effects of ignoring a hierarchical nesting of subjects. An empirical example of an evaluation of a large-scale, national educational program is given.

Descriptors: Probability, Scores, Statistical Bias, High School Students, College Students, Intervention, Simulation, Program Evaluation, Advanced Placement, Advanced Placement Programs, Grades (Scholastic), Multivariate Analysis, Predictor Variables, Academic Achievement

College Board. 250 Vesey Street, New York, NY 10281. Tel: 212-713-8000; e-mail: research[at]collegeboard.org; Web site: http://research.collegeboard.org





Author: Patterson, Brian F.

Source: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=502&id=ED563416



DOWNLOAD PDF




Related documents