Unpacking the black box of causality: Learning about causal mechanisms from experimental and observational studies

American Political Science Review

Volumn 105, Issue 4, 2011, Pages 765-789

  Imai, Kosuke ^a   Keele, Luke ^b   Tingley, Dustin ^c   Yamamoto, Teppei ^d  

^a PRINCETON UNIVERSITY   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c HARVARD UNIVERSITY   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 80955160663     PISSN: 00030554     EISSN: 15375943     Source Type: Journal    
DOI: 10.1017/S0003055411000414     Document Type: Article

References (79)

1. Albert, J. 2008. "Mediation Analysis via Potential Outcomes Models." Statistics in Medicine 27: 1282-1304. (Pubitemid 351395455)
2. Angrist, J. D., G. W. Imbens, and D. B. Rubin. 1996. "Identification of Causal Effects Using Instrumental Variables (with Discussion)." Journal of the American Statistical Association 91 (434): 444-55. (Pubitemid 126412813)
3. Ansolabehere, S., E. C. Snowberg, and J. M. Snyder. 2006. "Television and the Incumbency Advantage in U.S. Elections." Legislative Studies Quarterly 31 (4): 469-90.
4. Ansolabehere, S., J. M. Snyder, and C. Stewart. 2000. "Old Voters, New Voters, and the Personal Vote: Using Redistricting to Measure the Incumbency Advantage." American Journal of Political Science 44 (1): 17-34.
5. Baron, R. M., and D. A. Kenny. 1986. "The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations." Journal of Personality and Social Psychology 51 (6): 1173-82.
6. Bartels, L. M. 1993. "Messages Received: The Political Impact of Media Exposure." American Political Science Review 87 (2): 267-85.
7. Bertrand, M., and S. Mullainathan. 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination." American Economic Review 94 (4): 991-1013.
8. Blattman, C. 2009. "From Violence to Voting: War and Political Participation in Uganda." American Political Science Review 103 (2): 231-47.
9. Brader, T., N. A. Valentino, and E. Suhay. 2008. "What Triggers Public Opposition to Immigration? Anxiety, Group Cues, and Immigration." American Journal of Political Science 52 (4): 959-78.
10. Brady, H. E., and D. Collier. 2004. Rethinking Social Inquiry: Diverse Tools, Shared Standards. Lanham, MD: Rowman and Littlefield.
11. Bullock, J., D. Green, and S. Ha. 2010. "Yes, But What's the Mechanism? (Don't Expect an Easy Answer)." Journal of Personality and Social Psychology 98 (4): 550-58.
12. Chong, D., and J. Druckman. 2007. "Framing Theory." Annual Review of Political Science 10: 103-26.
13. Cnudde, C. F., and D. J. McCrone. 1966. "The Linkage between Constituency Attitudes and Congressional Voting Behavior: A Causal Model." American Political Science Review 60 (1): 66-72.
14. Cole, S. R., and C. E. Frangakis. 2009. "The Consistency Statement in Causal Inference: A Definition or Assumption?" Epidemiology 20 (1): 3-5.
15. Collier, D., H. E. Brady, and J. Seawright. 2004. "Source of Leverage in Causal Inference: Toward an Alternative View of Methodology." In Rethinking Social Inquiry:Diverse Tools, Shared Standards eds. H. Brady and D. Collier, Berkeley, CA: Rowman and Little-field.
16. Cox, G. W., and J. N. Katz. 1996. "Why Did the Incumbency Advantage in U.S. House Elections Grow?" American Journal of Political Science 40 (2): 478-97.
17. Deaton, A. 2010a. "Instruments, Randomization, and Learning about Development." Journal of Economic Literature 48 (2): 424-55.
18. Deaton, A. 2010b. "Understanding the Mechanisms of Economic Development." Journal of Economic Perspectives 24 (3): 3-16.
19. Druckman, J. 2005. "Media Matter: How Newspapers and Television News Cover Campaigns and Influence Voters." American Political Science Review 22: 463-81. (Pubitemid 41799390)
20. Erikson, R. S., and T. R. Palfrey. 1998. "Campaign Spending and Incumbency: An Alternative Simultaneous Equations Approach." Journal of Politics 60 (2): 355-73.
21. Gadarian, S. K. 2010. "The Politics of Threat: How Terrorism News Shapes Foreign Policy Attitudes." Journal of Politics 72 (2): 469-83.
22. Gelman, A., and G.King. 1990. "Estimating Incumbency Advantage without Bias." American Journal of Political Science 34 (4): 1142-64.
23. Gerber, A. 1998. "Estimating the Effect of Campaign Spending on Senate Election Outcomes Using Instrumental Variables." American Political Science Review 92 (2): 401-11. (Pubitemid 128185173)
24. Glynn, A. N. 2010. "The Product and Difference Fallacies for Indirect Effects." Department of Government, Harvard University. Unpublished manuscript, Mimeo.
25. Green, D. P., S. E. Ha, and J. G. Bullock. 2010. "Enough Already about Black Box Experiments: Studying Mediation Is More Difficult Than Most Scholars Suppose." Annals of the American Academy of Political and Social Sciences 628 (1): 200-08.
26. Gross, J. J., and R. W. Levenson. 1995. "Eliciting Emotions Using Films." Cognition and Emotion 9 (1): 87-108.
27. Haavelmo, T. 1943. "The Statistical Implications of a System of Simultaneous Equations." Econometrica 11: 1-12.
28. Heckman, J. J., and J. A. Smith. 1995. "Assessing the Case for Social Experiments." Journal of Economic Perspectives 9 (2): 85-110.
29. Hetherington, M. J. 2001. "Resurgent Mass Partisanship: The Role of Elite Polarization." American Political Science Review 95 (3): 619-31. (Pubitemid 33586498)
30. Ho, D. E., K. Imai, G. King, and E. A. Stuart. 2007. "Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference." Political Analysis 15 (3): 199-236.
31. Holland, P. W. 1986. "Statistics and Causal Inference." Journal of the American Statistical Association 81: 945-60.
32. Holland, P. W. 1988. "Causal Inference, Path Analysis, and Recursive Structural Equations Models." Sociological Methodology 18: 449-84.
33. Horiuchi, Y., K. Imai, and N. Taniguchi. 2007. "Designing and Analyzing Randomized Experiments: Application to a Japanese Election Survey Experiment." American Journal of Political Science 51 (3): 669-87.
34. Imai, K., L. Keele, and D. Tingley. 2010. "A General Approach to Causal Mediation Analysis." Psychological Methods 15 (4): 309-34.
35. Imai, K., L. Keele, D. Tingley and T. Yamamoto. 2010. "Causal Mediation Analysis Using R". In Advances in Social Science Research Using R, ed. H. D. Vinod, Lecture Notes in Statistics. Springer-verlag: New York, 129-54.
36. Imai, K., L. Keele, D. Tingley, and T. Yamamoto. 2011. "Replication Data for: Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies." The Dataverse Network. hdl:1902.1/16467 (accessed September 1, 2011).
37. Imai, K.,L.Keele, andT.Yamamoto. 2010. "Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects." Statistical Science 25 (1): 51-71.
38. Imai, K., G. King, and E. A. Stuart. 2008. "Misunderstandings among Experimentalists and Observationalists about Causal Inference." Journal of the Royal Statistical Society, Series A (Statistics in Society) 171 (2): 481-502.
39. Imai, K., and D. Tingley. N.d. "A Statistical Method for Empirical Testing of Competing Theories." American Journal of Political Science. Forthcoming.
40. Imai, K., D. Tingley, and T. Yamamoto. N.d. "Experimental Designs for Identifying Causal Mechanisms." (With discussions). Journal of the Royal Statistical Society, Series A (Statistics in Society). Forthcoming.
41. Imai, K., andT.Yamamoto. 2010. "Causal Inference with Differential Measurement Error: Nonparametric Identification and Sensitivity Analysis." American Journal of Political Science 54 (2): 543-60.
42. Imai, K., and T. Yamamoto. 2011. "Sensitivity Analysis for Causal Mediation Effects under Alternative Exogeneity Assumptions." http://imai.princeton.edu/research/medsens.html. (accessed September 1, 2011).
43. Isbell, L., and V. Ottati. 2002. "The Emotional Voter." In The Social Psychology of Politics, ed. V. Ottati, New York: Kluwer, 55-74.
44. Jacobson, G. C. 1987. "The Politics of Congressional Elections. Boston: Little, Brown.
45. Jo, B. 2008. "Causal Inference in Randomized Experiments with Mediational Processes." Psychological Methods 13 (4): 314-36.
46. Jost, J. T., J. L. Napier, H. Thorisdottir, S. D. Gosling, T. P. Palfai, and B. Ostafin. 2007. "Are Needs to Manage Uncertainty and Threat Associated With Political Conservatism or Ideological Extremity?" Personality and Social Psychology Bulletin 33 (7): 989-1007.
47. Kinder, D. R. and L. Sanders. 1996. Divided by Color: Racial Politics and Democratic Ideals. Chicago: University of Chicago Press.
48. King, G., R. O. Keohane, and S. Verba. 1994. Designing Social Inquiry. Princeton, NJ: Princeton University Press.
49. King, G., M. Tomz, and J. Wittenberg. 2000. "Making the Most of Statistical Analyses: Improving Interpretation and Presentation." American Journal of Political Science 44: 341-55.
50. Levitt, S. D. and C. D. Wolfram. 1997. "Decomposing the Sources of Incumbency Advantage in the U.S. House." Legislative Studies Quarterly 22 (1): 45-60. (Pubitemid 127459073)
51. MacKinnon, D. 2008. Introduction to Statistical Mediation Analysis. New York: Routledge.
52. MacKinnon, D., C. Lockwood, C. Brown, W. Wang, and J. Hoffman. 2007. "The Intermediate Endpoint Effect in Logistic and Probit Regression." Clinical Trials 4: 499-513. (Pubitemid 350189874)
53. Manski, C. F. 2007. Identification for Prediction and Decision. Cambridge, MA: Harvard University Press.
54. Miller, J. M., and J. A. Krosnick. 2000. "News Media Impact on the Ingredients of Presidential Evaluations: Politically Knowledgeable Citizens Are Guided by a Trusted Source." American Journal of Political Science 44 (2): 301-15.
55. Miller, W. E., and D. W. Stokes. 1963. "Constituency Influence in Congress." American Political Science Review 57 (1): 45-46.
56. Nelson, T. E., R. A. Clawson, and Z. M. Oxley. 1997. "Media Framing of a Civil Liberties Conflict and Its Effect on Tolerance." American Political Science Review 91 (3): 567-83. (Pubitemid 127174511)
57. Nelson, T. E., and D. R. Kinder. 1996. "Issue Frames and Group-centrism in American Public Opinion." The Journal of Politics 58 (4): 1055-78.
58. Neyman, J. [1923] 1990. "On the Application of Probability Theory to Agricultural Experiments: Essay on Principles, Section 9." Statistical Science 5: 465-80.
59. Olsson, A., J. P. Ebert, M. R. Banaji, and E. A. Phelps. 2005. "The Role of Social Groups in the Persistence of Learned Fear." Science 309 (5735): 785-87. (Pubitemid 41077327)
60. Oxley, D. R., K. B. Smith, J. R. Alford, M. V. Hibbing, J. L. Miller, M. Scalora, P. K. Hatemi, and J. R. Hibbing. 2008. "Political Attitudes Vary with Physiological Traits." Science 321 (5896): 1667-70.
61. Pearl, J. 2001. "Direct and Indirect Effects." In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, eds. Jack S. Breese and Daphne Koller. San Francisco: Morgan Kaufmann, 411-20.
62. Pearl, J. N.d. "The Causal Mediation Formula: A Guide to the Assessment of Pathways and Mechanisms." Prevention Science. Forthcoming.
63. Petersen, M. L.,S.E. Sinisi, andM.J. van der Laan. 2006. "Estimation of Direct Causal Effects." Epidemiology 17 (3): 276-84.
64. Prior, M. 2006. "The Incumbent in the Living Room: The Rise of Television and the Incumbency Advantage in U.S. House Elections." Journal of Politics 68 (3): 657-73. (Pubitemid 44000861)
65. Robins, J. M. 2003. "Semantics of Causal DAG Models and the Identification of Direct and Indirect Effects." In Highly Structured Stochastic Systems, eds. P. J. Green, N. L. Hjort, and S. Richardson, Oxford: Oxford University Press, 70-81.
66. Robins, J. M., and S. Greenland. 1992. "Identifiability and Exchangeability for Direct and Indirect Effects." Epidemiology 3 (2): 143-55.
67. Robins, J. M., and T. Richardson. 2010. "Alternative Graphical Causal Models and the Identification of Direct Effects. In Causality and Psychopathology: Finding the Determinants of Disorders and Their Cures, eds. P. Shrout, K. Keyes, and K. Omstein, Oxford: Oxford University Press, 103-58.
68. Rosenbaum, P. R. 2002a. "Covariance Adjustment in Randomized Experiments and Observational Studies: Rejoinder." Statistical Science 17 (3): 321-27.
69. Rosenbaum, P. R. 2002b. "Covariance Adjustment in Randomized Experiments and Observational Studies (with Discussion)." Statistical Science 17 (3): 286-327.
70. Rubin, D. B. 1974. "Estimating Causal Effects of Treatments in Randomized and Non-randomized Studies." Journal of Educational Psychology 66: 688-701.
71. Shadish, W. R., T. D. Cook, and D. T. Campbell. 2001. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin.
72. Sjölander, A. 2009. "Bounds on Natural Direct Effects in the Presence of Confounded Intermediate Variables." Statistics in Medicine 28 (4): 558-71.
73. Sobel, M. E. 1982. "Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models." Sociological Methodology 13: 290-321.
74. Sobel, M. E. 2008. "Identification of Causal Parameters in Randomized Studies with Mediating Variables." Journal of Educational and Behavioral Statistics 33 (2): 230-51.
75. Spencer, S., M. Zanna, and G. Fong. 2005. "Establishing a Causal Chain: Why Experiments Are Often More Effective Than Medi-ational Analyses in Examining Psychological Processes." Journal of Personality and Social Psychology 89 (6): 845-51. (Pubitemid 43083771)
76. Tiedens, L. Z. and S. Linton. 2001. "Judgment under Emotional Certainty and Uncertainty: The Effects of Specific Emotions on Information Processing." Journal of Personality and Social Psychology 81 (6): 973-88. (Pubitemid 33594523)
77. Tomz, M. and R. P. van Houweling. 2009. "The Electoral Implications of Candidate Ambiguity." American Political Science Review 103 (1): 83-98.
78. VanderWeele, T. J. 2009. "Marginal Structural Models for the Estimation of Direct and Indirect Effects." Epidemiology 20 (1): 18-26.
79. VanderWeele, T. J. and J. M. Robins. 2009. "Minimal Sufficient Causation and Directed Acyclic Graphs." Annals of Statistics 37 (3): 1437-65.