Nonexperimental versus Experimental Estimates of Earnings Impacts

Annals of the American Academy of Political and Social Science

Volumn 589, Issue , 2003, Pages 63-93

  Glazerman, Steven ^b   Levy, Dan M ^a   Myers, David ^b  

^a GEORGETOWN UNIVERSITY   (United States)

^b NONE

Author keywords

Design replication; Nonexperimental; Quasi experimental

Indexed keywords

EID: 0041416027     PISSN: 00027162     EISSN: None     Source Type: Journal    
DOI: 10.1177/0002716203254879     Document Type: Article

References (26)

1. Bell, Stephen H., Larry L. Orr, John D. Blomquist, and Glen C. Cain. 1995. Program applicants as a comparison group in evaluating training programs. Kalamazoo, MI: Upjohn Institute for Employment Research.
2. Bloom, Howard, Charles Michalopoulos, Carolyn Hill, and Ying Lei. 2002, June. Can non-experimental comparison group methods match the findings from a random assignment evaluation of mandatory welfare-to-work programs? New York: Manpower Demonstration Research Corporation.
3. Bratberg, Espen, Astrid Grasdal, and Alf Erling Risa. 2002. Evaluating social policy by experimental and NX methods. Scandinavian Journal of Economics 104 (1): 147-71.
4. Campbell, Donald, and J. C. Stanley. 1966. Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
5. Cook, Thomas, and Donald Campbell. 1979. Quasi-experimentation: Design and analysis issues for field settings. Hopewell, NJ: Houghton-Mifflin.
6. Cooper, H., K. Charlton, J. C. Valentine, and L. Muhlenbruck, 2000. Making the most of summer school: A meta-analytic and narrative review. Monographs of the Society for Research in Child Development. Malden, MA: Blackwell.
7. Dehejia, Rajeev, and Sadek Wahba. 1999. Causal effects in NX studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association 94 (448): 1053-62.
8. Fraker, Thomas, and Rebecca Maynard. 1987. The adequacy of comparison group designs for evaluations of employment-related programs. Journal of Human Resources 22 (2): 194-227.
9. Glazerman, Steven M., Dan M. Levy, and David Myers. 2002. NX replications of social experiments in education, training, and employment services revised protocol. Philadelphia: Campbell Collaboration. Available from http://www.campbellcollaboration.org/doc-pdf/qedprot.pdf.
10. Gritz, R. Mark, and Terry Johnson. 2001. National Job Corps Study: Assessing program effects on earnings for students achieving key program milestones. Washington, DC: Battelle Memorial Institute.
11. Heckman, James J., and V. Joseph Hotz. 1989. Choosing among alternative NX methods for estimating the impact of social programs: The case of manpower training. Journal of the American Statistical Association 84 (408): 862-74.
12. Heckman, James J., Hidehiko Ichimura, Jeffrey C. Smith, and Petra Todd. 1998. Characterizing selection bias. Econometrica 66 (5): 1017-98.
13. Hotz, V. Joseph, Guido W. Imbens, and Jacob Klerman. 2000. The long-term gains-from GAIN: A re-analysis of the impacts of the California GAIN Program. NBER Working Paper 8007. Cambridge, MA: National Bureau of Economic Research.
14. Hotz, V. Joseph, Guido W. Imbens, and Julie H. Mortimer. 1999. Predicting the efficacy of future training programs using past experiences. NBER Technical Working Paper 238. Cambridge, MA: National Bureau of Economic Research.
15. Lalonde, Robert. 1986. Evaluating the econometric evaluations of training with experimental data. American Economic Review 76 (4): 604-20.
16. Lipsey, MarkW., and David B. Wilson. 1993. The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist 48:1181-209.
17. McConnell, Sheena, and Steven M. Glazerman. 2001. National Job Corps Study: The benefits and costs of Job Corps. Washington, DC: Mathematica Policy Research, Inc.
18. McKay, James R., Arthur I. Alterman, Thomas McLellan, Chris R. Boardman, Frank D. Mulvaney, and Charles P. O'Brien. 1998. Random versus nonrandom assignment in the evaluation of treatment for cocaine abusers. Journal of Consulting and Clinical Psychology 66 (4): 697-701.
19. McKay, James R., Arthur I. Alterman, Thomas McLellan, Edward C. Snider, and Charles P. O'Brien. 1995, Effect of random versus nonrandom assignment in a comparison of inpatient and day hospital rehabilitation for male alcoholics. Journal of Consulting and Clinical Psychology 63 (1): 70-78.
20. National Reading Panel. 2000. Teaching children to read: An evidence based assessment of the scientific research literature on reading and its implications for reading instruction. Reports of the subgroups. NIH Pub. no. 00-4754, December. Bethesda, MD: National Institute of Child Health and Human Development.
21. Newman, John, Menno Pradhan, Laura Rawlings, Geert Ridder, Ramiro Coa, and Jose Luis Evia. 2001. An impact evaluation of education, health and water supply investments of the Bolivian Social Investment Fund. World Bank Economic Review, June. Washington, DC: World Bank.
22. Olsen, Robert, and Paul Decker. 2001. Testing different methods of estimating the impacts of worker profiling and reemployment services systems. Washington, DC: Mathematica Policy Research, Inc.
23. Reynolds, Arthur J., and Judy A. Temple. 1995. Quasi-experimental estimates of the effects of a preschool intervention: Psychometric and econometric comparisons. Evaluation Review 19 (4): 347-73.
24. Shadish, William R. 2000. The empirical program of quasi-experimentation. In Research design: Donald Campbell's legacy, edited by L. Bickman. Thousand Oaks, CA: Sage.
25. Shadish, William R., and Kevin Ragsdale. 1996. Random versus nonrandom assignment in psychotherapy experiments: Do you get the same answer? Journal of Consulting and Clinical Psychology 64:1290-305.
26. Smith, Jeffrey C., and Petra Todd. Forthcoming. Does matching overcome Lalonde's critique of NX estimators? Journal of Econometrics.