Using propensity scoring to estimate program-related subgroup impacts in experimental program evaluations

Evaluation Review

Volumn 31, Issue 2, 2007, Pages 95-120

  Schochet, Peter Z ^a   Burghardt, John ^a  

^a MATHEMATICA POLICY RESEARCH   (United States)

Author keywords

Experimental evaluations; Program impacts; Propensity scoring; Specification tests

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ECONOMICS; HEALTH CARE QUALITY; HUMAN; METHODOLOGY; STATISTICAL MODEL; STATISTICS; UNITED STATES; VOCATIONAL EDUCATION;

ADOLESCENT; ADULT; HUMANS; LOGISTIC MODELS; PROGRAM EVALUATION; RESEARCH DESIGN; UNITED STATES; VOCATIONAL EDUCATION;

EID: 34247619828     PISSN: 0193841X     EISSN: 15523926     Source Type: Journal    
DOI: 10.1177/0193841X06288736     Document Type: Article

References (28)

1. Agodini, Roberto, and Mark Dynarski. 2004. Are experiments the only option? A look at dropout prevention programs. Review of Economics and Statistics 86: 180-184.
2. Angrist, Joshua, Guido Imbens, and Donald Rubin. 1996. Identification of causal effects using instrumental variables. Journal of the American Statistical Association 91: 444-472.
3. Bloom, Howard. 1984. Accounting for no-shows in experimental evaluation designs. Evaluation Review 8: 225-246.
4. Burghardt, John, and Peter Schochet. 2001. National Job Corps Study: Impacts by center characteristics. Princeton, NJ: Mathematica Policy Research, Inc.
5. Cave, George, Hans Bos, Fred Doolittle, and Cyril Toussaint. 1993. Jobstart: Final report on a program for school dropouts. New York: Manpower Development Research Corporation.
6. Dehejia, Rajeev H., and Sadek Wahba. 1999. Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association 94: 1053-1062.
7. Gastwirth, Joseph, Abba Krieger, and Paul R. Rosenbaum. 2000. Asymptotic separability in sensitivity analysis. Journal of the Royal Statistical Society B 62: 545-555.
8. Gritz, Mark, and Terry Johnson. 2001. National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Seattle, WA: Battelle Human Affairs Research Centers.
9. Heckman, James, Hidehiko Ichimura, Jeffrey Smith, and Petra Todd. 1998. Characterizing selection bias using experimental data. Econometrica 66: 1017-1098.
10. Heckman, James, Hidehiko Ichimura, and Petra Todd. 1997. Matching as an econometric evaluation estimator: Evidence from evaluating a job training program. Review of Economic Studies 64: 605-654.
11. Heckman, James, Hidehiko Ichimura, and Petra Todd. 1998. Matching as an econometric evaluation estimator. Review of Economic Studies 65: 261-294.
12. Johnson, Terry, Mark Gritz, Russell Jackson, John Burghardt, Carol Boussy, Jan Leonard, and Carlyn Orians. 1999. National Job Corps Study: Report on the process analysis. Princeton, NJ: Mathematica Policy Research, Inc.
13. LaLonde, Robert. 1986. Evaluating the econometric evaluations of training programs with experimental data. American Economic Review 76: 604-620.
14. Love, John, Ellen Kisker, Christine Ross, Helen Raikes, Jeanne Brooks-Gunn, Jill Constantine, Kimberly Boller, et al. 2002. The impacts of early Head Start programs on young children and their families. Princeton, NJ: Mathematica Policy Research, Inc.
15. McConnell, Sheena, and Steven Glazerman. 2001. National Job Corps Study: The benefits and costs of Job Corps. Princeton, NJ: Mathematica Policy Research, Inc.
16. Myers, David, and Allen Schirm. 2002. The impacts of Upward Bound: Final report. Princeton, NJ: Mathematica Policy Research, Inc.
17. Orr, Larry, Howard Bloom, Stephen Bell, Fred Doolittle, W. Lin, and George Cave. 1996. Does training for the disadvantaged work? Evidence from the national JTPA study. Washington, DC: Urban Institute Press.
18. Rosenbaum, Paul. 2002. Observational studies. New York: Springer.
19. Rosenbaum, Paul, and Donald Rubin. 1983. The central role of the propensity score in observational studies for causal effects. Biometrika 70: 41-55.
20. Rubin, Donald. 1974. Estimating causal effects of treatments in randomized and non-randomized studies. Journal of Educational Psychology 66: 688-701.
21. Rubin, Donald. 1977. Assignment to a treatment group on the basis of a covariate. Journal of Educational Statistics 2: 1-26.
22. Rubin, Donald. 1978. Bayesian inference for causal effects. Annals of Statistics 6: 34-58.
23. Rubin, Donald. 2001. Use of propensity scores for tobacco litigation. Working paper, Harvard University, Cambridge, MA.
24. Schochet, Peter. 2001. National Job Corps Study: Methodological appendixes on the impact analysis. Princeton, NJ: Mathematica Policy Research, Inc.
25. Schochet, Peter, and John Burghardt. 2005. Conducting a long-term follow-up of National Job Corps Study samples: Impact findings using 1993 to 2003 summary earnings records data. Princeton, NJ: Mathematica Policy Research, Inc.
26. Schochet, Peter, John Burghardt, and Steven Glazerman. 2001. National Job Corps Study: The impacts of Job Corps on participants' employment and related outcomes. Princeton, NJ: Mathematica Policy Research, Inc.
27. Schochet, Peter, Sheena McConnell, and John Burghardt. 2003. National Job Corps Study: Findings using administrative earnings records. Princeton, NJ: Mathematica Policy Research, Inc.
28. Smith, Jeffrey, and Petra Todd. 2000. Does matching overcome LaLonde's critique of nonexperimental estimators? Working paper.