Regression Discontinuity and Beyond: Options for Studying External Validity in an Internally Valid Design

American Journal of Evaluation

Volumn 39, Issue 1, 2018, Pages 91-108

  Wing, Coady ^a   Bello Gomez, Ricardo A ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

causal inference; external validity; extrapolation; program evaluation; quasi experiments; regression discontinuity design; research design

Indexed keywords

EID: 85042063074     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214017736155     Document Type: Article

References (31)

1. Abdulkadiroglu A., Angrist J., Pathak P., (2014). The elite illusion: Achievement effects at Boston and New York exam schools. Econometrica, 82, 137–196.
2. Angrist J. D., (2004). Treatment effect heterogeneity in theory and practice. The Economic Journal, 114, C52–C83.
3. Angrist J. D., Rokkanen M., (2015). Wanna get away? Regression discontinuity estimation of exam school effects away from the cutoff. Journal of the American Statistical Association, 110, 1331–1344.
4. Athey S., Imbens G., (2016). The state of applied econometrics - Causality and policy evaluation. Unpublished Working Paper. Retrieved from https://arxiv.org/abs/1607.00699v1.
5. Bertanha M., (2017). Regression discontinuity design with many thresholds. Unpublished Working Paper. Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2712957
6. Bertanha M., Imbens G. W., (2014). External validity in fuzzy regression discontinuity designs. Unpublished Working Paper No. w20773. Retrieved from http://www.nber.org/papers/w20773
7. Black D., Galdo J., Smith J. A., (2007). Evaluating the bias of the regression discontinuity design using experimental data. Unpublished Working Paper.
8. Campbell D., (1969). Reforms as experiments. American Psychologist, 24, 409–429.
9. Cook T. D., (2014). Generalizing causal knowledge in the policy sciences: External validity as a task of both multiattribute representation and multiattribute extrapolation. Journal of Policy Analysis and Management, 33, 527–536.
10. DiNardo J., Lee D. S., (2011). Program evaluation and research designs. Handbook of Labor Economics, 4, 463–536.
11. Dong Y., Lewbel A., (2015). Identifying the effect of changing the policy threshold in regression discontinuity models. Review of Economics and Statistics, 97, 1081–1092.
12. Goodman J., (2008). Who merits financial aid?: Massachusetts’ Adams scholarship. Journal of Public Economics, 92, 2121–2131.
13. Hahn J., Todd P., Van der Klaauw W., (2001). Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica, 69, 201–209.
14. Hausman J. A., (1978). Specification tests in econometrics. Econometrica: Journal of the Econometric Society, 46, 1251–1271.
15. Hirano K., Imbens G. W., Ridder G., (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica, 71, 1161–1189.
16. Horvitz D. G., Thompson D. J., (1952). A generalization of sampling without replacement from a finite universe. Journal of the American statistical Association, 47, 663–685.
17. Imbens G. W., Lemieux T., (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615–635.
18. Jacob B. A., Lefgren L., (2004). Remedial education and student achievement: A regression-discontinuity analysis. Review of Economics and Statistics, 86, 226–244.
19. Kline P., (2011). Oaxaca-Blinder as a reweighting estimator. The American Economic Review, 101, 532–537.
20. Kowalski A. E., (2016). Doing more when you're running LATE: Applying marginal treatment effect methods to examine treatment effect heterogeneity in experiments. Unpublished Working Paper. Retrieved from http://www.nber.org/papers/w22363
21. Lindblom C. E., (1979). Still muddling, not yet through. Public Administration Review, 39, 517–526.
22. Matsudaira J. D., (2008). Mandatory summer school and student achievement. Journal of Econometrics, 142, 829–850.
23. McCrary J., (2008). Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics, 142, 698–714.
24. Papay J. P., Willett J. B., Murnane R. J., (2011). Extending the regression-discontinuity approach to multiple assignment variables. Journal of Econometrics, 161, 203–207.
25. Robinson P. M., (1988). Root-N-consistent semiparametric regression. Econometrica: Journal of the Econometric Society, 56, 931–954.
26. Rosenbaum P. R., (1987). The role of a second control group in an observational study. Statistical Science, 2, 292–306.
27. Stuart E. A., Rubin D. B., (2008). Matching with multiple control groups with adjustment for group differences. Journal of Educational and Behavioral Statistics, 33, 279–306.
28. Wing C., Clark M. H., (2017). What can we learn from a doubly randomized preference trial?—An instrumental variables perspective. Journal of Policy Analysis and Management, 36, 418–437.
29. Wing C., Cook T. D., (2013). Strengthening the regression discontinuity design using additional design elements: A within-study comparison. Journal of Policy Analysis and Management, 32, 853–877.
30. Wong V. C., Steiner P. M., Cook T. D., (2013). Analyzing regression-discontinuity designs with multiple assignment variables: A comparative study of four estimation methods. Journal of Educational and Behavioral Statistics, 38, 107–141.
31. Wong V., Wing C., (2016). The regression discontinuity design and the social corruption of quantitative indicators. Observational Studies, 2, 183–209.