Observing the counterfactual? The search for political experiments in nature

Political Analysis

Volumn 17, Issue 4, 2009, Pages 341-357

  Robinson, Gregory ^a   McNulty, John E ^a   Krasno, Jonathan S ^a  

^a BINGHAMTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 70350062202     PISSN: 10471987     EISSN: 14764989     Source Type: Journal    
DOI: 10.1093/pan/mpp011     Document Type: Editorial

References (55)

1. Abadie, Alberto, and Guido W. Imbens. 2006. On the Failure of the Bootstrap for Matching Estimators. NBER Technical Working Papers 0325, National Bureau of Economic Research, Inc.
2. Aldrich, John H. 1995. Why parties? Chicago, IL: University of Chicago Press.
3. Ansolabehere, Stephen, James M. Snyder Jr., and Charles Stewart III. 2000. Old Voters, new voters, and the personal vote: Using redistricting to measure the incumbency advantage. American Journal of Political Science 44:17-34.
4. Arrington, Leonard J., and Davis Bitton. 1992. The Mormon Experience: A History of the Latter-Day Saints. Champaign, IL: University of Illinois Press.
5. Ashenfelter, Orley A., and David E. Card. 1985. Using the longitudinal structure of earnings to estimate the effect of training programs. Review of Economics and Statistics 67:648-60.
6. Athey, Susan, and Guido W. Imbens. 2006. Identification and inference in nonlinear difference-in-differences models. Econometrica 74:431-97.
7. Bertrand, Marianne, Esther Duflo, and Sendhil Mullainathan. 2004. How much should we trust differences-in-differences estimates? Quarterly Journal of Economics 119:249-75.
8. Black, Nick. 1996. Why we need observational studies to evaluate the effectiveness of health care. BMJ 312:1215-8.
9. Brady, Henry E. 2003. Models of causal inference: Going beyond the Neyman-Rubin-Holland theory Paper prepared for the Annual Meeting of the Midwest Political Science Association, Chicago, IL.
10. Brady, Henry E., and John E. McNulty. 2004. The costs of voting: evidence from a natural experiment. Presented at the Annual Meeting of the Society for Political Methodology, Palo Alto, CA.
11. Brown, Thomas. 1835. Inquiry into the relation of cause and effect London: H. G. Bohn.
12. Campbell, Donald T. 1969. Reforms as experiments. American Psychologist 24:409-29.
13. Campbell, Donald T., and Julian C. Stanley. 1966 [1963]. Experimental and quasi-experimental designs for research. Chicago, IL: Rand McNally.
14. Carson, Jamie L., Nathan W. Monroe, and Gregory Robinson. 2009. Unpacking agenda control in congress: Individual roll rates and the republican revolution. Political Research Quarterly. First published on August 31, 2009, 10.1177/1065912909343579.
15. Chen, Jowei. 2008a. When do government benefits influence voters' behavior? The effect of FEMA Disaster Awards on US Presidential Votes. Typescript. Stanford University.
16. Chen, Jowei. 2008b. Are poor voters easier to buy off? A natural experiment from the 2004 Florida hurricane season. Typescript. Stanford University.
17. Cook, Thomas D., and Donald T. Campbell. 1979. Quasi-experimentation: design & analysis for field settings. Chicago, IL: Rand McNally.
18. Cordray, David S. 1986. Quasi-experimental analysis: A mixture of methods and judgment. New Directions for Program Evaluation 31:9-27.
19. Doherty, Daniel, Donald Green, and Alan Gerber. 2006. Personal income and attitudes toward redistribution: A study of lottery winners. Political Psychology 27:441-58.
20. Dunning, Thad. 2008. Improving causal inference: Strengths and limitations of natural experiments. Political Research Quarterly 61:282-93.
21. Egger, Matthias, Martin Schneider, and George Davey Smith. 1998. Spurious precision? Meta-analysis of observational studies. BMJ 316:140-4.
22. von Elm, Erik, Douglas G. Altman, Matthias Egger, Stuart J. Pocock, Peter C. Gotzsche, and Jan P. Vandenbrouke. 2007. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 335:806-8.
23. Engle, Robert F., David F. Hendry, and Jean-Francois Richard. 1983. Exogeneity. Econometrica 51:277-304.
24. Frankfort-Nachmias, Chava, and David Nachmias. 2000. Research Methods in the Social Sciences. 6th ed. New York: Worth Publishers.
25. Gerber, Alan S., Donald P. Green, and Christopher W. Larimer. 2008. Social pressure and voter turnout: Evidence from a large-scale field experiment. American Political Science Review 102:33-48.
26. Glasziou, Paul, Jan Vandenbrouke, and Iain Chalmers. 2004. Assessing the quality of research. BMJ 328:39-41.
27. Goldberg, Beverly. 2008. Help, I've fallen into the doughnut hole and I can't get up: The problems with medicare. Part D. Issue Brief. New York: THe Century Fund. http://www.tcf.org/Publications/ Healthcare/Beverly_brief.pdf.
28. Green, Donald P., Terence Y. Leong, Holger L. Kern, Alan S. Gerber, and Christopher W. Larimer. 2009. Testing the accuracy of regression discontinuity analysis using experimental benchmarks. Political Analysis Advance Access published on August 3, 2009. 10.1093/pan/ mpp018.
29. Grose, Christian R., and Antoine Yoshinaka. 2003. The electoral consequences of party switching by incumbent members of congress, 1947-2000. Legislative Studies Quarterly 28(1):55-75.
30. Hansen, Christian. 2007a. Generalized least squares inference in panel and multilevel models with serial correlation and fixed effects. Journal of Econometrics 140:670-94.
31. Hansen, Christian. 2007b. Asymptotic properties of a robust variance matrix estimator for panel data when T is large. Journal of Econometrics 141:597-620.
32. Heckman, James J. 1979. Sample selection bias as a specification error. Econometrica 47:153-61.
33. Hitchcock, Christopher. 2004. Do all and only causes raise the probabilities of effects? In Causation and counter-factuals, eds. John Collins, Ned Hall, and L. A. Paul, 403-8. Cambridge, MA: MIT Press.
34. Imai, Kosuke. 2005. Do get-out-the-vote calls reduce turnout? The importance of statistical methods for field experiments. American Political Science Review 99:283-300.
35. Imbens, Guido W. 2004. Nonparametric estimation of average treatment effects under exogeneity: A review. The Review of Economics and Statistics 86:4-29.
36. Imbens, Guido W., and Thomas Lemieux. 2008. Regression discontinuity designs: A guide to practice. Journal of Econometrics 142:615-35.
37. Johnson, R. Burke 2000. It's (beyond) time to drop the terms causal-comparative and correlational research in education. Athens, GA: Instructional Technology Forum, University of Georgia. ITFORUM Paper #43. http://itech1.coe.uga.edu/itforum/paper43/paper43.html.
38. van der Klaauw, Wilbert. 2008. Regression-discontinuity analysis: A survey of recent developments in economics. Labour 22:219-45.
39. Kousser, Thad, and Megan Mullin. 2007. Does voting by mail increase participation? using matching to analyze a natural experiment. Political Analysis 115:428-45.
40. Krasno, Jonathan, and Donald Green. 2008. Do televised advertisements increase voter turnout? Evidence from a natural experiment. Journal of Politics 70:245-61.
41. Lee, David S. 2008. Randomized experiments from non-random selection in U.S. House elections. Journal of Econometrics 142:675-97.
42. McCrary, Justin. 2008. Testing for manipulation of the running variable in the regression discontinuity design. Journal of Econometrics 142:698-714.
43. Meyer, Bruce D. 1994. Natural and quasi-experiments in economics NBER Technical Working Papers No. 170. National Bureau of Economic Research, Inc.
44. Miguel, Edward, Shanker Satyanath, and Ernest Sergenti. 2004. Economic shocks and civil conflict: An instrumental approach. Journal of Political Economy 122:725-53.
45. Milgram, Stanley. 1963. Behavioural study of obedience. Journal of Abnormal and Social Psychology 67:371-78.
46. Nokken, Timothy P., and Keith T. Poole. 2004. Congressional party defection in American history. Legislative Studies Quarterly 29:545-68.
47. Popper, Karl. 1959. The logic of scientific discovery. New York: Basic Books.
48. Rosenbaum, P. R. 2002. Covariance adjustment in randomized experiments and observational studies. Statistical Science 17:286-327.
49. Rubin, Donald B. 1974. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 66:688-701.
50. Sanderson, Simon, Iain D. Tatt, and Julian P. Higgins. 2007. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology. International Journal of Epidemiology 36:666-76.
51. Solon, Gary. 1984. Estimating autocorrelations in fixed-effects models NBER Working Paper No. T0032.
52. Stein, Robert M., and Greg Vonnahme. 2008. Engaging the unengaged voter: vote centers and voter turnout. Journal of Politics 70:487-97.
53. Thistlethwaite, Donald L., and Donald T. Campbell. 1960. Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology 51:309-17.
54. Trochim, William M. K. 1982. Methodologically Based Discrepancies in Compensatory Education Evaluations. Evaluation Review 6(4):443-80.
55. Trochim, William M. K. 1984. Research design for program evaluation: the regression-discontinuity approach. Thousand Oaks, CA: Sage.