Improving causal inference: Strengths and limitations of natural experiments

Political Research Quarterly

Volumn 61, Issue 2, 2008, Pages 282-293

  Dunning, Thad ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

"As if" random; Continuum of plausibility; Exogenous variation; Matching; Natural experiment

Indexed keywords

EID: 44649131438     PISSN: 10659129     EISSN: None     Source Type: Journal    
DOI: 10.1177/1065912907306470     Document Type: Article

References (47)

1. Achen, Christopher. 1986. The statistical analysis of quasi - experiments. Berkeley: University of California Press.
2. Angrist, Joshua D. 1990. Lifetime earnings and the Vietnam era draft lottery: Evidence from Social Security administrative records. American Economic Review 80 (3): 313-36.
3. Angrist, Joshua D., and Alan B. Krueger. 1991. Does compulsory school attendance affect schooling and earnings? Quarterly Journal of Economics 106:979-1014.
4. Angrist, Joshua D., and Victor Lavy. 1999. Using Maimonides' rule to estimate the effect of class size on student achievement. Quarterly Journal of Economics 114:533-75.
5. Ansolabehere, Stephen, James M. Snyder Jr., and Charles Stewart III. 2000. Old voters, new voters, and the personal vote: Using redistricting to measure the incumbency advantage. American Journal of Political Science 44 (1): 17-34.
6. Arceneaux, Kevin, Donald Green, and Alan Gerber. 2006. Comparing experimental and matching methods using a large-scale voter mobilization experiment. Political Analysis 14:37-62.
7. Brady, Henry E. 2002. Models for causal inference: Going beyond the Neyman-Rubin-Holland theory. Paper presented at the annual meeting of the APSA Political Methodology Working Group, July 13, Seattle, WA.
8. Brady, Henry E., and David Collier. 2004. Rethinking social inquiry: Diverse tools, shared standards. Lanham, MD: Rowman & Littlefield.
9. Brady, Henry E., and John McNulty. 2004. The costs of voting: Evidence from a natural experiment. Paper presented at the annual meeting of the Society for Political Methodology, Stanford University, July 29-31, Stanford, CA, July 29-31.
10. Brickman, Philip, Ronnie Janoff-Bulman, and Dan Coates. 1978. Lottery winners and accident victims: Is happiness relative? Journal of Personality and Social Psychology 36 (8): 917-27.
11. Campbell, Donald T., and Robert F. Boruch. 1975. Making the case for randomized assignment to treatments by considering the alternatives: Six ways in which quasi-experimental evaluations in compensatory education tend to underestimate effects. In Evaluation and experiment: Some critical issues in assessing social programs, ed. Carl A. Bennett and Arthur A. Lumsdaine. New York: Academic Press.
12. Campbell, Donald T., and H. Laurence Ross. 1970. The Connecticut crackdown on speeding: Time-series data in quasi-experimental analysis. In The quantitative analysis of social problems, ed. Edward R. Tufts, 110-18. Reading, MA: Addison-Wesley.
13. Campbell, Donald T., and Julian C. Stanley. 1963. Experimental and quasi-experimental designs for research. Boston, MA: Houghton Mifflin.
14. Card, David, and Alan B. Krueger. 1994. Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania. American Economic Review 84 (4): 772-93.
15. Collier, David, Henry E. Brady, and Jason Seawright. 2004. Sources of leverage in causal inference: Toward an alternative view of methodology. In Rethinking social inquiry: Diverse tools, shared standards, chap. 13. Lanham, MD: Rowman & Littlefield.
16. Cox, Gary, Frances Rosenbluth, and Michael F. Thies. 2000. Electoral rules, career ambitions, and party structure: Conservative factions in Japan's upper and lower houses. American Journal of Political Science 44:115-22.
17. Deere, Donald, Kevin M. Murphy, and Finis Welch. 1995. Sense and nonsense on the minimum wage. Regulation: The Cato Review of Business and Government 18(1): 47-56.
18. Dehejia, Rajeev. 2005. Practical propensity score matching: A reply to Smith and Todd. Journal of Econometrics 125 (1): 355-64.
19. Dehejia, Rajeev H., and Sadek Wahba. 1999. Causal effects in nonex-perimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association 94:1053-62.
20. Doherty, Daniel, Donald Green, and Alan Gerber. 2006. Personal income and attitudes toward redistribution: A study of lottery winners. Political Psychology 27 (3): 441-58. (Earlier version circulated as a working paper, Institution for Social and Policy Studies, Yale University, New Haven, CT, 2005)
21. Dunning, Thad. 2006. No free lunch: Natural experiments and the construction of instrumental variables. Manuscript, Department of Political Science, Yale University, New Haven, CT.
22. Freedman, David. 1991. Statistical models and shoe leather. In Sociological methodology, vol. 21, ed. P. V. Marsden. Washington, DC: American Sociological Association.
23. _. 1999. From association to causation: Some remarks on the history of statistics. Statistical Science 14:243-58.
24. _. 2005. Statistical models: Theory and practice. Cambridge: Cambridge University Press.
25. Freedman, David, Robert Pisani, and Roger Purves. 1997. Statistics. 3rd ed. New York: Norton.
26. Gardner, Jonathan, and Andrew Oswald. 2001. Does money buy happiness? A longitudinal study using data on windfalls. Working paper, March, http://www2.warwick.ac.uk/fac/soc/economics/staff/faculty/oswald/ marchwindfallsgo.pdf.
27. Glazer, Amihai, and Marc Robbins. 1985. Congressional responsiveness to constituency change. American Journal of Political Science 29 (2): 259-73.
28. Goldthorpe, John. 2001. Causation, statistics, and sociology. European Sociological Review 17(1): 1-20.
29. Gould, Stephen Jay. 1996. The mismeasure of man. 2nd ed. New York: Norton.
30. Green, Donald, and Ian Shapiro. 1994. Pathologies of rational choice theory. New Haven, CT: Yale University Press.
31. Grofman, Bernard, Thomas L. Brunell, and William Koetzle. 1998. Why gain in the Senate but midterm loss in the House? Evidence from a natural experiment. Legislative Studies Quarterly 23 (February): 79-89.
32. Grofman, Bernard, Robert Griffin, and Gregory Berry. 1995. House members who become senators: Learning from a "natural experiment." Legislative Studies Quarterly 20 (4): 513-29.
33. Hyde, Susan. 2006. Can international election observers deter international fraud? Evidence from a natural experiment. Chap. 7 of Observing norms: Causes and consequences of internationally monitored elections. Ph.D. diss., Department of Political Science, University of California, San Diego.
34. Imbens, Guido, Donald Rubin, and Bruce Sacerdote. 2001. Estimating the effect of unearned income on labor supply, earnings, savings and consumption: Evidence from a survey of lottery players. American Economic Review 91 (4): 778-94.
35. Krasno, Jonathan S., and Donald P. Green. 2005. Do televised presidential ads increase voter turnout? Evidence from a natural experiment. Manuscript, Department of Political Science, Yale University, New Haven, CT.
36. Laitin, David. 1986. Hegemony and culture: Politics and religious change among the Yoruba. Chicago: University of Chicago Press.
37. Learner, Edward E. 1983. Let's take the con out of econometrics. American Economic Review 73 (1): 31-43.
38. Lindahl, Mikail. 2002. Estimating the effect of income on health and mortality using lottery prizes as exogenous source of variation in income. Manuscript, Swedish Institute for Social Research, Stockholm.
39. Miguel, Edward. 2004. Tribe or nation: Nation building and public goods in Kenya versus Tanzania. World Politics 56 (3): 327-62.
40. Miguel, Edward, Shanker Satyanath, and Ernest Sergenti. 2004. Economic shocks and civil conflict: An instrumental variables approach. Journal of Political Economy 122:725-53.
41. Posner, Daniel N. 2004. The political salience of cultural difference: Why Chewas and Tumbukas are allies in Zambia and adversaries in Malawi. American Political Science Review 98 (4): 529-45.
42. _. 2005. Institutions and ethnic politics in Africa. PEID Series. Cambridge: Cambridge University Press.
43. Richardson, Benjamin Ward. 1887. John Snow, M.D. The Asclepiad, vol. 4, 274-300, London: Humphrey Milford. (Reprinted in Snow on cholera, London: Humphrey Milford/Oxford University Press, 1936)
44. Rubin. Donald B. 1977. Assignment to treatment on the basis of a covariate. Journal of Educational Statistics 2:1-26.
45. Smith, Jeffrey A., and Petra E. Todd. 2005. Does matching overcome LaLonde's critique of nonexperimental estimators? Journal of Econometrics 125 (1): 305-53.
46. Snow, John. 1855. On the mode of communication of cholera. 2nd ed. London: John Churchill. (Reprinted in Snow on cholera, London: Humphrey Milford. Oxford University Press, 1936)
47. Stasavage, David. 2003. Transparency, democratic accountability, and the economic consequences of monetary institutions. American Journal of Political Science 47 (3): 389-402.