Econometric methods for causal evaluation of education policies and practices: A non-technical guide

Education Economics

Volumn 19, Issue 2, 2011, Pages 109-137

  Schlotter, Martin ^a   Schwerdt, Guido ^a   Woessmann, Ludger ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Causal effects; Education; Non technical guide; Policy evaluation

Indexed keywords

ECONOMETRICS; EDUCATION POLICY; EMPIRICAL ANALYSIS; EXPERIMENTAL DESIGN; POLICY ANALYSIS; REGRESSION ANALYSIS;

EID: 79956102674     PISSN: 09645292     EISSN: 14695782     Source Type: Journal    
DOI: 10.1080/09645292.2010.511821     Document Type: Article

References (90)

1. Ammermüller, A., and P. Dolton. 2006. Pupil-teacher gender interaction effects on scholastic outcomes in England and the USA. ZEW Discussion Paper 06-060. Mannheim, Germany: Centre for European Economic Research.
2. Angrist, J.D. 2004. American education research changes tack. Oxford Review of Economic Policy 20, no. 2: 198-212.
3. Angrist, J.D., E. Bettinger, and M. Kremer. 2006. Long-term educational consequences of secondary school vouchers: Evidence from administrative records in Colombia. American Economic Review 96, no. 3: 847-862.
4. Angrist, J.D., G.W. Imbens, and D.B. Rubin. 1996. Identification of causal effects using instrumental variables. Journal of the American Statistical Association 91, no. 434: 444-455.
5. Angrist, J.D., and A.B. Krueger. 1999. Empirical strategies in labor economics. In Handbook of labor economics, ed. O. Ashenfelter and D. Card, vol. 3A, 1277-1366. Amsterdam: North-Holland.
6. Angrist, J.D., and V. Lavy. 1999. Using maimonides' rule to estimate the effect of class size on scholastic achievement. Quarterly Journal of Economics 114, no. 2: 533-575.
7. Angrist, J.D., and V. Lavy. 2009. The effects of high stakes high school achievement awards: Evidence from a randomized trial. American Economic Review 99, no. 4: 1384-1414.
8. Angrist, J.D., and J.-S. Pischke. 2009. Mostly harmless econometrics: An empiricist's companion. Princeton, NJ: Princeton University Press.
9. Ashenfelter, O., and A. Krueger. 1994. Estimates of the economic return to schooling from a new sample of twins. American Economic Review 84, no. 5: 1157-1173.
10. Barnett, S. 1985. Benefit-cost analysis of the Perry Preschool Program and its policy implications. Educational Evaluation and Policy Analysis 7, no. 4: 333-342.
11. Bauer, T. 2002. Educational mismatch and wages: A panel analysis. Economics of Education Review 21, no. 3: 221-229.
12. Becker, S.O., and A. Ichino. 2002. Estimation of average treatment effects based on propensity scores. Stata Journal 2, no. 4: 358-377.
13. Bedard, K., and E. Dhuey. 2006. The persistence of early childhood maturity: International evidence of long-run age effects. Quarterly Journal of Economics 121, no. 4: 1437-1472.
14. Behrman, J.R., and M.R. Rosenzweig. 2002. Does increasing women's schooling raise the schooling of the next generation? American Economic Review 92, no. 1: 323-334.
15. Belfield, C.R., M. Nores, S. Barnett, and L. Schweinhart. 2006. The High/Scope Perry Preschool Program. Journal of Human Resources 41, no. 1: 162-190.
16. Bénabou, R., F. Kramarz, and C. Prost. 2009. The French zones d'education prioritaire: Much ado about nothing? Economics of Education Review 28, no. 3: 345-346.
17. Bettinger, E. 2008. Paying to learn: The effect of financial incentives on elementary school test scores. Paper presented at the CESifo/PEPG Conference 'Economic Incentives: Do They Work in Education?', May 16-17, in Munich, Germany.
18. Bettinger, E., and R. Slonim. 2006. Using experimental economics to measure the effects of a natural educational experiment on altruism. Journal of Public Economics 90, nos. 8-9: 1625-1648.
19. Black, S.E., P.J. Devereux, and K.G. Salvanes. 2005. Why the apple doesn't fall far: Understanding intergenerational transmission of human capital. American Economic Review 95, no. 1: 437-449.
20. Black, S.E., P.J. Devereux, and K.G. Salvanes. 2007. From the cradle to the labor market? The effect of birth weight on adult outcomes. Quarterly Journal of Economics 122, no. 1: 409-439.
21. Black, S.E., P.J. Devereux, and K.G. Salvanes. 2008. Staying in the classroom and out of the maternity ward? The effect of compulsory schooling laws on teenage births. Economic Journal 118, no. 530: 1025-1054.
22. Böhlmark, A., and M. Lindahl. 2008. Does school privatization improve educational achievement? Evidence from Sweden's Voucher Reform. IZA Discussion Paper 3691. Bonn: Institute for the Study of Labor.
23. Bonesrønning, H., T. Falch, and B. Strøm. 2005. Teacher sorting, teacher quality, and student composition. European Economic Review 49, no. 2: 457-483.
24. Brunello, G., M. Fort, and G. Weber. 2009. Changes in compulsory schooling, education and the distribution of wages in Europe. Economic Journal 119, no. 536: 516-539.
25. Card, D. 1999. The causal effect of education on earnings. In Handbook of labor economics, ed. O. Ashenfelter and D. Card, vol. 3A, 1801-1863. Amsterdam: North-Holland.
26. Clotfelter, C.T., H.F. Ladd, and J.L. Vigdor. 2007. Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review 26, no. 6: 673-682.
27. Commission of the European Communities. 2007. Towards more knowledge-based policy and practice in education and training. Commission Staff Working Document SEC 1098. Brussels: Commission of the European Communities. http://ec.europa.eu/education/poli-cies/2010/doc/sec1098_en.pdf
28. Cullen, J.B., B.A. Jacob, and S. Levitt. 2006. The effect of school choice on participants: Evidence from randomized lotteries. Econometrica 74, no. 5: 1191-1230.
29. Currie, J., and E. Moretti. 2003. Mother's education and the intergenerational transmission of human capital: Evidence from college openings. Quarterly Journal of Economics 118, no. 4: 1495-1532.
30. Dee, T.S. 2005. A teacher like me: Does race, ethnicity, or gender matter? American Economic Review 95, no. 2: 158-165.
31. Dee, T.S. 2007. Teachers and the gender gaps in student achievement. Journal of Human Resources 42, no. 3: 528-554.
32. Dynarski, S.M. 2003. Does aid matter? Measuring the effect of student aid on college attendance and completion. American Economic Review 93, no. 1: 279-288.
33. Falch, T. 2008. The elasticity of labor supply at the establishment level. Industrial Relations Section Working Paper 536. Princeton, NJ: Princeton University.
34. Finn, J.D., and C.M. Achilles. 1990. Answers and questions about class size: A statewide experiment. American Educational Research Journal 27, no. 3: 557-577.
35. Galindo-Rueda, F., and A. Vignoles. 2007. The heterogeneous effect of selection in UK secondary schools. In Schools and the equal opportunity problem, ed. L. Woessmann and P.E. Peterson, 103-28. Cambridge, MA: MIT Press.
36. Garces, E., D. Thomas, and J. Currie. 2002. Longer-term effects of head start. American Economic Review 92, no. 4: 999-1012.
37. Garibaldi, P., F. Giavazzi, A. Ichino, and E. Rettore. 2007. College cost and time to complete a degree: Evidence from tuition discontinuities. NBER Working Paper 12863. Cambridge, MA: National Bureau of Economic Research.
38. Gibbons, S., and S. Machin. 2006. Paying for primary schools: Admission constraints, school popularity or congestion? Economic Journal 116, no. 510: C77-C92.
39. Gibbons, S., S. Machin, and O. Silva. 2008. Choice, competition, and pupil achievement. Journal of the European Economic Association 6, no. 4: 912-947.
40. Griliches, Z. 1979. Siblings models and data in economics: Beginnings of a survey. Journal of Political Economy 87, no. 5: 37-64.
41. Haegeland, T., O. Raaum, and K.G. Salvanes. 2008. Pennies from heaven? Using exogeneous tax variation to identify effects of school resources on pupil achievements. IZA Discussion Paper 3561. Bonn: Institute for the Study of Labor.
42. Hanushek, E.A. 1999. Some findings from an independent investigation of the Tennessee STAR experiment and from other investigations of class size effects. Educational Evaluation and Policy Analysis 21, no. 2: 143-163.
43. Hanushek, E.A., J.F. Kain, J.M. Markman, and S.G. Rivkin. 2003. Does peer ability affect student achievement? Journal of Applied Econometrics 18, no. 5: 527-544.
44. Hanushek, E.A., J.F. Kain, S.G. Rivkin, and G.F. Branch. 2007. Charter school quality and parental decision making with school choice. Journal of Public Economics 91, no. 5: 823-848.
45. Hanushek, E.A., and M.E. Raymond. 2004. The effect of school accountability systems on the level and distribution of student achievement. Journal of the European Economic Association 2, nos. 2-3: 406-415.
46. Hanushek, E.A., and L. Woessmann. 2006. Does early tracking affect educational inequality and performance? Differences-in-differences evidence across countries. Economic Journal 116, no. 510: C63-C76.
47. Harmon, C., and I. Walker. 1995. Estimates of the economic return to schooling for the United Kingdom. American Economic Review 85, no. 5: 1278-1286.
48. Heckman, J.J., S.H. Moon, R. Pinto, P.A. Savelyev, and A. Yavitz. 2010. The rate of return of the High/Scope Perry Preschool Program. Journal of Public Economics 94, nos. 1-2: 114-128.
49. Hoxby, C.M. 2000a. Does competition among public schools benefit students and taxpayers? American Economic Review 90, no. 5: 1209-1238.
50. Hoxby, C.M. 2000b. The effects of class size on student achievement: New evidence from population variation. Quarterly Journal of Economics 115, no. 4: 1239-1285.
51. Hoxby, C.M. 2007. Does competition among public schools benefit students and taxpayers? Reply. American Economic Review 97, no. 5: 2038-2055
52. Ichino, A., and R. Winter-Ebmer. 2004. The long-run educational cost of World War II. Journal of Labor Economics 22, no. 1: 57-86.
53. Jacob, B.A. 2005. Accountability, incentives and behavior: The impact of high-stakes testing in the Chicago public schools. Journal of Public Economics 89, nos. 5-6: 761-796.
54. Jürges, H., K. Schneider, and F. Büchel. 2005. The effect of central exit examinations on student achievement: Quasi-experimental evidence from TIMSS Germany. Journal of the European Economic Association 3, no. 5: 1134-1155.
55. Kremer, M. 2003. Randomized evaluations of educational programs in developing countries: Some lessons. American Economic Review 93, no. 2: 102-6.
56. Krueger, A.B. 1999. Experimental estimates of education production functions. Quarterly Journal of Economics 114, no. 2: 497-532.
57. Krueger, A.B., and P. Zhu. 2004. Another look at the New York City school voucher experiment. American Behavioral Scientist 47, no. 5: 658-698.
58. Lavy, V. 2009. Performance pay and teachers' effort, productivity, and grading ethics. American Economic Review 99, no. 5: 1979-2011.
59. Lavy, V. Forthcoming. Mechanisms and effects of free choice among public schools. Review of Economic Studies
60. Leuven, E., M. Lindahl, H. Oosterbeek, and D. Webbink. 2007. The effect of extra funding for disadvantaged students on achievement. Review of Economics and Statistics 89, no. 4: 721-736.
61. Leuven, E., H. Oosterbeek, and M. Rønning. 2008. Quasi-experimental estimates of the effect of class size on achievement in Norway. Scandinavian Journal of Economics 110, no. 4: 663-693.
62. Ludwig, J., and D.L. Miller. 2007. Does head start improve children's life chances? Evidence from a regression discontinuity design. Quarterly Journal of Economics 122, no. 1: 159-208.
63. Machin, S.J., and S. McNally. 2007. New technology in schools: Is there a payoff? Economic Journal 117, no. 522: 1145-1167.
64. Machin, S.J., and S. McNally. 2008. The literacy hour. Journal of Public Economics 92, nos. 5-6: 1441-1462.
65. Manning, A., and J.-S. Pischke. 2006. Comprehensive versus selective schooling in England and Wales: What do we know? IZA Discussion Paper 2072. Bonn: Institute for the Study of Labor.
66. Manski, C.F. 1993. Identification of endogenous social effects: The reflection problem. Review of Economics and Statistics 60, no. 3: 531-542.
67. Meghir, C., and M. Palme. 2005. Educational reform, ability and family background. American Economic Review 95, no. 1: 414-424.
68. Messer, D., and S.C. Wolter. 2009. Money matters: Evidence from a large-scale randomized field experiment with vouchers for adult training. CESifo Working Paper 2548. Munich: CESifo.
69. Metzler, J., and L. Woessmann. 2009. The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation. Mimeo, University of Munich.
70. Muralidharan, K., and V. Sundararaman. 2009. Teacher performance pay: Experimental evidence from India. NBER Working Paper 15323. Cambridge, MA: National Bureau of Economic Research.
71. Oreopoulos, P. 2006. Estimating average and local average treatment effects when compulsory schooling laws really matter. American Economic Review 96, no. 1: 152-175.
72. Pekkarinen, T., R. Uusitalo, and S. Kerr. 2009. School tracking and intergenerational income mobility: Evidence from the Finnish comprehensive school reform. Journal of Public Economics 93, nos. 7-8: 965-973.
73. Peterson, P.E., and W.G. Howell. 2004. Efficiency, bias, and classification schemes: A response to Alan B. Krueger and Pei Zhu. American Behavioral Scientist 47, no. 5: 699-717.
74. Peterson, P.E., W.G. Howell, P.J. Wolf, and D.E. Campbell. 2003. School vouchers: Results from randomized experiments. In The economics of school choice, ed. C.M. Hoxby, 107-144. Chicago, IL: University of Chicago Press.
75. Puhani, P.A., and A.M. Weber. 2007. Does the early bird catch the worm? Instrumental variable estimates of early educational effects of age of school entry in Germany. Empirical Economics 32: 359-386.
76. Rivkin, S.G., E.A. Hanushek, and J.F. Kain. 2005. Teachers, schools, and academic achievement. Econometrica 73, no. 2: 417-458.
77. Rockoff, J.E. 2004. The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review 94, no. 2: 247-252.
78. Rothstein, J. 2007. Does competition among public schools benefit students and taxpayers? Comment. American Economic Review 97, no. 5: 2026-2037.
79. Sacerdote, B. 2001. Peer effects with random assignment: Results for Dartmouth roommates. Quarterly Journal of Economics 116, no. 2: 681-704.
80. Schneider, B., M. Carnoy, J. Kilpatrick, W.H. Schmidt, and R.J. Shavelson. 2007. Estimating causal effects using experimental and observational designs: A think tank white paper. Washington, DC: American Educational Research Association.
81. Schwerdt, G., and A.C. Wuppermann. 2009. Is traditional teaching really all that bad? A within-student between-subject approach. CESifo Working Paper 2634. Munich: CESifo.
82. Stock, J.H., and M.W. Watson. 2006. Introduction to econometrics. 2nd ed. Boston, MA: Addison-Wesley.
83. Todd, P.E., and K.I. Wolpin. 2003. On the specification and estimation of the production function for cognitive achievement. Economic Journal 113, no. 485: F3-F33.
84. Vigdor, J., and T. Nechyba. 2007. Peer effects in North Carolina public schools. In Schools and the equal opportunity problem, ed. L. Woessmann and P.E. Peterson, 73-101. Cambridge, MA: MIT Press.
85. Webbink, D. 2005. Causal effects in education. Journal of Economic Surveys 19, no. 4: 535-560.
86. West, M.R., and P.E. Peterson. 2006. The efficacy of choice threats within school accountability systems: Results from legislatively-induced experiments. Economic Journal 116, no. 510: C46-C62.
87. West, M.R., and L. Woessmann. 2010. 'Every Catholic child in a Catholic school': Historical resistance to state schooling, contemporary school competition, and student achievement across countries. Economic Journal 120, no. 546: F229-F255.
88. Woessmann, L. 2005. Educational production in Europe. Economic Policy 20, no. 43: 445-504.
89. Woessmann, L., and M.R. West. 2006. Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS. European Economic Review 50, no. 3: 695-736.
90. Zimmerman, D.J. 2003. Peer effects in academic outcomes: Evidence from a natural experiment. Review of Economics and Statistics 85, no. 1: 9-23.