Modern Regression Discontinuity Analysis

Journal of Research on Educational Effectiveness

Volumn 5, Issue 1, 2012, Pages 43-82

  Bloom, Howard S ^a  

^a MDRC   (United States)

Author keywords

program impacts; regression discontinuity designs; sample design

Indexed keywords

EID: 84855516249     PISSN: 19345747     EISSN: 19345739     Source Type: Journal    
DOI: 10.1080/19345747.2011.578707     Document Type: Article

References (66)

1. Aiken, L. S., West, S. G., Schwalm, D. E., Carroll, J. and Hsuing, S. 1998. Comparison of a randomized and two quasi-experimental designs in a single outcome evaluation: Efficacy of a university-level remedial writing program. Evaluation Review, 22: 207-244.
2. Angrist, J. D., Imbens, G. W. and Rubin, D. B. 1996. Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91: 444-472.
3. Angrist, J. D. and Lavy, V. 1999. Using Maimonides' rule to estimate the effect of class size on scholastic achievement. The Quarterly Journal of Economics, 114: 533-575.
4. Battistin, E. and Retorre, E. 2008. Ineligibles and eligible non-participants as a double comparison group in regression discontinuity designs. Journal of Econometrics, 142: 715-730.
5. Berk, R. A. and Rauma, D. 1983. Capitalizing on nonrandom assignment to treatments: A regression-discontinuity evaluation of a crime-control program. Journal of the American Statistical Association, 78: 21-27.
6. Bjorklund, A. and & Moffit, R. 1987. Estimation of wage gains and welfare gains in self-selection models. Review of Economics and Statistics, 69: 42-49.
7. Black, D., Galdo, J. and Smith, J. 2005. Estimating the selection bias of the regression discontinuity design using a tie-breaking experiment, (Working Paper). Syracuse, NY: Department of Economics and Center for Policy Research, Syracuse University.
8. Black, S. 1999, May. Do better schools matter? Parental valuation of elementary education. The Quarterly Journal of Economics,: 577-599.
9. Bloom, H. S. 1984. Accounting for no-shows in experimental evaluation designs. Evaluation Review, 8: 225-246.
10. Bloom, H. S. 1995. Minimum detectable effects: A simple way to report the statistical power of experimental designs. Evaluation Review, 19: 547-556.
11. Bloom, H. S. 2005. "Randomizing groups to evaluate place-based programs". In Learning more from social experiments: Evolving analytic approaches, Edited by: Bloom, H. S. 115-172. New York, NY: Russell Sage Foundation.
12. Bloom, H. S., Hill, C. J., Black, A. R. and Lipsey, M. W. 2008. Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. Journal of Research on Educational Effectiveness, 1: 289-328.
13. Bloom, H. S., Kemple, J., Gamse, B. and Jacob, R. Paper presented at the annual American Educational Research Association research conference. Montreal, Canada. Using regression discontinuity analysis to measure the impacts of Reading First,
14. Bloom, H. S., Orr, L. L., Cave, G., Bell, S. H., Doolittle, F. and Lin, W. 1997. The benefits and costs of JTPA programs: Key findings from the national JTPA study. The Journal of Human Resources, 32: 549-576.
15. Bloom, H. S., Richburg-Hayes, L. and Black, A. R. 2007. Using covariates to improve precision for studies that randomize schools to evaluate educational interventions. Educational Evaluation and Policy Analysis, 29: 30-59. doi:10.3102/0162373707299550
16. Brennan, R. L. 2001. Generalizability theory, New York, NY: Springer.
17. Buddelmeyer, H. and Skoufias, E. 2002, January. Can social programs be reliably evaluated with non-experimental methods? Evidence on the performance of a regression discontinuity design using PROGRESA data, (Working Paper). New York, NY: Inter-American Development Bank.
18. Card, D. and Shore-Sheppard, L. D. 2004. Using discontinuous eligibility rules to identify the effects of the federal Medicaid expansions on low-income children. The Review of Economics and Statistics, 86: 752-766.
19. Chen, M. K. and Shapiro, J. M. 2005. Does prison harden inmates? A discontinuity-based approach, (Working Paper). New Haven, CT: Yale School of Management.
20. Cohen, J. 1988. Statistical power analysis for the behavioral sciences, 2nd ed., Hillsdale, NJ: Erlbaum.
21. Cook, T. D. 2008. Waiting for life to arrive: A history of the regression-discontinuity design in psychology, statistics and economics. Journal of Econometrics, 142: 636-654.
22. Cook, T. D., Shadish, W. R. and Wong, V. C. 2008. Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management, 27: 724-750.
23. Cook, T., Wong, V., Steiner, P., Taylor, J., Gandhi, A., Kendziora, K. and Choi, K. 2009, January. Impacts of school improvement status on students with disabilities: Feasibility report, Washington, DC: American Institutes for Research.
24. DiNardo, J. and Lee, D. 2002, June. The impact of unionization on establishment closure: A regression-discontinuity analysis of representation elections, (Working Paper No. 8993). Cambridge, MA: National Bureau of Economic Research.
25. Fan, J. 1992. Design-adaptive nonparametric regression. Journal of the American Statistical Association, 87: 998-1004.
26. Fisher, R. A. 1935. The design of experiments, London, UK: Oliver and Boyd.
27. Gamse, B. C., Bloom, H. S., Kemple, J. J., Jacob, R. T. and Zhu, P. 2008. Reading First impact study: Interim report, (NCES 2008-4016). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Educational Sciences, U.S. Department of Education.
28. Gill, B., Lockwood, J. R., Martorell, F., Setodji, C. M. and Booker, K. 2008. State and local implementation of the No Child Left Behind Act, Washington, DC: U.S. Department of Education, Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service.
29. Gleason, P., Resch, A. and Berk, J. 2009, March 6. Replicating experimental impact estimates using a regression discontinuity design, Washington, DC: Mathematica Policy research presentation to the Institute of Education Sciences, U.S. Department of Education.
30. Goldberger, A. S. 1972. Selection bias in evaluating treatment effects: Some formal illustrations, (Discussion Paper No. 129-72). Madison: University of Wisconsin, Institute for Research on Poverty.
31. Grissom, R. J. and Kim, J. J. 2005. Effect sizes for research: A broad practical perspective, Mahwah, NJ: Erlbaum.
32. Hahn, J., Todd, P. and van der Klaauw, W. 1999, May. Evaluating the effect of an antidiscrimination law using a regression-discontinuity design, (Working Paper No. 7131). Cambridge, MA: National Bureau of Economic Research.
33. Hahn, J., Todd, P. and van der Klaauw, W. 2001. Identification and estimation of treatment effects with a regression discontinuity design. Econometrica, 69: 201-209.
34. Hardle, W. and Linton, O. 1994. "Applied nonparametric methods". In Handbook of econometrics 4, Edited by: Ingle, R. F. and MacFadden, D. F. 2295-2339. Amsterdam, the Netherlands: North Holland.
35. Heckman, J. 1997. Instrumental variables: A study of implicit behavioral assumptions used in making program evaluations. The Journal of Human Resources, 32: 441-462.
36. Hill, C. J., Bloom, H. S., Black, A. R. and Lipsey, M. 2008. Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2: 172-177.
37. Holland, P. W. 1986. Statistics and causal inference. Journal of the American Statistical Association, 81: 945-970.
38. Imbens, G. and Kalyanaraman, K. 2009, February. Optimal bandwidth choice for the regression discontinuity estimator, Working Paper No. 14, 726 Cambridge, MA: National Bureau of Economic Research.
39. Imbens, G. W. and Lemieux, T. 2008a. The regression discontinuity design: Theory and applications [Special issue]. Journal of Econometrics, 142(2)
40. Imbens, G. W. and Lemieux, T. 2008b. Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142: 615-635.
41. Jacob, B. A. and Lefgren, L. 2004, February. Remedial education and student achievement: A regression-discontinuity analysis. Review of Economics and Statistics, 86: 226-244.
42. Lalive, R. 2008. How do extended benefits affect unemployment duration? A regression-discontinuity approach. Journal of Econometrics, 142: 785-806.
43. Lee, D. S. 2001. The electoral advantage to incumbency and voters' valuation of politicians' experience: A regression-discontinuity analysis of close elections, (Working Paper No. 8441). Cambridge, MA: National Bureau of Economic Research.
44. Lee, D. S. 2008. Randomized experiments from non-random selection in U.S. House elections. Journal of Econometrics, 142: 675-697.
45. Lee, D. S. and Card, D. 2008. Regression discontinuity inference with specification error. Journal of Econometrics, 142: 655-674.
46. Lee, D. S. and Lemieux, T. 2009. "Regression Discontinuity Designs in Economics". Working Paper 14723, National Bureau of Economic Research (February). Cambridge: MA
47. Ludwig, J. and Miller, D. L. 2007. Does Head Start improve children's life chances? Evidence from a regression discontinuity design. The Quarterly Journal of Economics, 122: 159-208.
48. Matsudaira, J. D. 2008. Mandatory summer school and student achievement. Journal of Econometrics, 142: 829-850.
49. McCrary, J. 2008. Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics, 142: 698-714.
50. Neyman, J. 1923. Statistical problems in agricultural experiments. Journal of the Royal Statistical Association, 2: 107-180.
51. Nunnally, J. C. 1967. Psychometric theory, New York, NY: McGraw-Hill.
52. Quandt, R. 1972. Methods of estimating switching regressions-Unexplored reservoirs of scientific knowledge?. Journal of the American Statistical Association, 67: 306-310.
53. Robinson, J. P. and Reardon, S. F. Paper presented to the annual research conference of the Society for Research on Educational Effectiveness. Multiple regression discontinuity design: Implementation issues and empirical examples from education,
54. Rosenthal, R., Rosnow, R. L. and Rubin, D. B. 2000. Contrasts and effect sizes in behavioral research: A correlational approach, Cambridge, UK: Cambridge University Press.
55. Roy, A. D. 1951. Some thoughts on the distribution of earnings. Oxford Economic Papers, 3: 135-146.
56. Rubin, D. B. 1974. Estimating the causal effects of treatments in randomized and non-randomized studies. Journal of Educational Psychology, 66: 688-710.
57. Shadish, W. R., Cook, T. D. and Campbell, D. T. 2002. Experimental and quasi-experimental designs for generalized causal inference, Boston, MA: Houghton Mifflin.
58. Schochet, P. Z. 2008, July. Statistical power for regression discontinuity designs in education evaluations, (Technical Methods Report). Washington, DC: Institute of Education Sciences, U.S. Department of Education.
59. Somers, M.-A., Zhu, P., Jacob, R. and Bloom, H. 2009. Combining regression discontinuity analysis and interrupted time-series analysis, (Grant R305D090009). Washington, DC: Institute of Education Sciences, U. S. Department of Education.
60. Thistlethwaite, D. L. and Campbell, D. T. 1960. Regression-discontinuity analysis: An alternative to the ex-post facto experiment. Journal of Educational Psychology, 51: 309-317.
61. van der Klaauw, W. 1997. A regression-discontinuity evaluation of the effect of financial aid offers on college enrollment, Working Paper No. 97-10 New York, NY: C.V. Starr Center for Applied Economics, New York University.
62. van der Klaauw, W. 2002. Estimating the effect of financial aid offers on college enrollment: A Regression-discontinuity approach. International Economic Review, 43: 1249-1287.
63. van der Klaauw, W. 2008. Breaking the link between poverty and low student achievement: An evaluation of Title I?. Journal of Econometrics, 142: 731-756.
64. Weinbaum, E. H. and Weiss, M. Paper presented to the annual Research Conference of the Society for Research on Educational Effectiveness. School response to NCLB labels, Washington, DC
65. Wong, V. C., Cook, T., Barnett, W. S. and Jung, K. 2007, June. An effectiveness-based evaluation of five state pre-kindergarten programs using regression-discontinuity, (Working Paper). Evanston, IL: Northwestern University.
66. Wooldridge, J. M. 2009. Introductory econometrics: A modern approach, Florence, KY: South-WesternCENGAGELearning.