Experimental designs for identifying causal mechanisms

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 176, Issue 1, 2013, Pages 5-51

  Imai, Kosuke ^a   Tingley, Dustin ^b   Yamamoto, Teppei ^c  

^a PRINCETON UNIVERSITY   (United States)

^b HARVARD UNIVERSITY   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Causal inference; Direct and indirect effects; Identification; Instrumental variables; Mediation

Indexed keywords

EID: 84871655325     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2012.01032.x     Document Type: Article

References (120)

1. Angrist, J. D., Imbens, G. W. and Rubin, D. B. (1996) Identification of causal effects using instrumental variables (with discussion). J. Am. Statist. Ass., 91, 444-455.
2. Balke, A. and Pearl, J. (1997) Bounds on treatment effects from studies with imperfect compliance. J. Am. Statist. Ass., 92, 1171-1176.
3. Baron, R. M. and Kenny, D. A. (1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J. Personlty Socl Psychol., 51, 1173-1182.
4. Bertrand, M. and Mullainathan, S. (2004) Are Emily and Greg more employable than Lakisha and Jamal?: a field experiment on labor market discrimination. Am. Econ. Rev., 94, 991-1013.
5. Brader, T., Valentino, N. and Suhay, E. (2008) What triggers public opposition to immigration? anxiety, group cues, and immigration threat. Am. J. Polit. Sci., 52, 959-978.
6. Bullock, J., Green, D. and Ha, S. (2010) Yes, but what's the mechanism? (don't expect an easy answer). J. Personlty Socl Psychol., 98, 550-558.
7. Camerer, C., Loewenstein, G. and Prelec, D. (2005) Neuroeconomics: how neuroscience can inform economics. J. Econ. Lit., 43, 9-64.
8. Cook, T. D. (2002) Randomized experiments in educational policy research: a critical examination of the reasons the educational evaluation community has offered for not doing them. Educ. Evaln Poly Anal., 24, 175-199.
9. Cox, D. R. (1958) Planning of Experiments. New York: Wiley.
10. Dawid, A. (2000) Causal inference without counterfactuals. J. Am. Statist. Ass., 95, 407-448.
11. Deaton, A. (2009) Instruments of development: randomization in the tropics, and the search for the elusive keys to economic development. Proc. Br. Acad., 162, 123-160.
12. Geneletti, S. (2007) Identifying direct and indirect effects in a non-counterfactual framework. J. R. Statist. Soc. B, 69, 199-215.
13. Hainmueller, J. and Hiscox, M. J. (2010) Attitudes toward highly skilled and low-skilled immigration: evidence from a survey experiment. Am. Polit. Sci. Rev., 104, 61-84.
14. Heckman, J. J. and Smith, J. A. (1995) Assessing the case for social experiments. J. Econ. Perspect., 9, 85-110.
15. Hedström, P. and Ylikoski, P. (2010) Causal mechanisms in the social sciences. A. Rev. Sociol., 36, 49-67.
16. Holland, P. W. (1986) Statistics and causal inference (with discussion). J. Am. Statist. Ass., 81, 945-960.
17. Holland, P. W. (1988) Causal inference, path analysis, and recursive structural equations models. Sociol. Methodol., 18, 449-484.
18. Imai, K., Keele, L. and Tingley, D. (2010) A general approach to causal mediation analysis. Psychol. Meth., 15, 309-334.
19. Imai, K., Keele, L., Tingley, D. and Yamamoto, T. (2011) Unpacking the black box of causality: learning about causal mechanisms from experimental and observational studies. Am. Polit. Sci. Rev., 105, to be published.
20. Imai, K., Keele, L. and Yamamoto, T. (2010) Identification, inference, and sensitivity analysis for causal mediation effects. Statist. Sci., 25, 51-71.
21. Imai, K., Tingley, D. and Yamamoto, T. (2011) Replication data for: Experimental designs for identifying causal mechanisms. hdl:1902.1/16416. Dataverse Network.
22. Imai, K. and Yamamoto, T. (2012) Identification and sensitivity analysis for multiple causal mechanisms: revisiting evidence from framing experiments. Submitted to Polit. Anal. (Available from http://imai.princeton.edu/research/medsens.html.)
23. Jo, B. (2008) Causal inference in randomized experiments with mediational processes. Psychol. Meth., 13, 314-336.
24. Jones, B. and Kenward, M. G. (2003) Design and Analysis of Cross-over Trials, 2nd edn. London: Chapman and Hall.
25. Kaufman, S., Kaufman, J. S. and MacLehose, R. F. (2009) Analytic bounds on causal risk differences in directed acyclic graphs involving three observed binary variables. J. Statist. Planng Inf., 139, 3473-3487.
26. Knoch, D., Pascual-Leone, A., Meyer, K., Treyer, V. and Fehr, E. (2006) Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science, 314, 829-832.
27. Lerner, J. S. and Keltner, D. (2001) Fear, anger, and risk. J. Personlty Socl Psychol., 81, 146-159.
28. Little, D. (1990) Varieties of Social Explanation: an Introduction to the Philosophy of Social Science. Boulder: Westview.
29. Ludwig, J., Kling, J. R. and Mullainathan, S. (2011) Mechanism experiments and policy evaluations. J. Econ. Perspect., to be published.
30. Mackie, J. (1965) Causes and conditions. Am. Philos. Q., 2, 245-264.
31. Manski, C. F. (1995) Identification Problems in the Social Sciences. Cambridge: Harvard University Press.
32. Martin, A. and Gotts, S. J. (2005) Making the causal link: frontal cortex activity and repetition priming. Nat. Neursci., 8, 1134-1135.
33. Mattei, A. and Mealli, F. (2011) Augmented designs to assess principal strata direct effects. J. R. Statist. Soc. B, 73, 729-752.
34. Neyman, J. (1990) On the application of probability theory to agricultural experiments: essay on principles, Section 9. Statist. Sci., 5, 465-480 (Engl. transl.).
35. Paus, T. (2005) Inferring causality in brain images: a perturbation approach. Philos. Trans. B, 360, 1109-1114.
36. Pearl, J. (2001) Direct and indirect effects. In Proc. 17th Conf. Uncertainty in Artificial Intelligence, pp. 411-420. San Francisco: Morgan Kaufmann.
37. Petersen, M. L., Sinisi, S. E. and van der Laan, M. J. (2006) Estimation of direct causal effects. Epidemiology, 17, 276-284.
38. Robertson, E. M., Théoret, H. and Pascual-leone, A. (2003) Studies in cognition: the problems solved and created by transcranial magnetic stimulation. J. Cogn. Neursci., 15, 948-960.
39. Robins, J. M. (2003) Semantics of causal DAG models and the identification of direct and indirect effects. In Highly Structured Stochastic Systems (eds P. J. Green, N. L. Hjort and S. Richardson ), pp. 70-81. Oxford: Oxford University Press.
40. Robins, J. M. and Greenland, S. (1992) Identifiability and exchangeability for direct and indirect effects. Epidemiology, 3, 143-155.
41. Rothman, K. J. (1976) Causes. Am. J. Epidem., 104, 587-592.
42. Rothman, K. and Greenland, S. (2005) Causation and causal inference in epidemiology. Am. J. Publ. Hlth, 95, S1, S144.
43. Rubin, D. B. (1974) Estimating causal effects of treatments in randomized and non-randomized studies. J. Educ. Psychol., 66, 688-701.
44. Rubin, D. B. (2004) Direct and indirect causal effects via potential outcomes (with discussions). Scand. J. Statist., 31, 161-170.
45. Salmon, W. (1984) Scientific Explanation and the Causal Structure of the World. Princeton: Princeton University Press.
46. Sanfey, A. G., Rilling, J. K., Aronson, J. A., Nystrom, L. E. and Cohen, J. D. (2003) The neural basis of economic decision-making in the ultimatum game. Science, 300, 1755-1758.
47. Shpitser, I. and VanderWeele, T. J. (2011) A complete graphical criterion for the adjustment formula in mediation analysis. Int. J. Biostatist., 7, article 16.
48. Sjölander, A. (2009) Bounds on natural direct effects in the presence of confounded intermediate variables. Statist. Med., 28, 558-571.
49. Sobel, M. E. (2008) Identification of causal parameters in randomized studies with mediating variables. J. Educ. Behav. Statist., 33, 230-251.
50. Spencer, S., Zanna, M. and Fong, G. (2005) Establishing a causal chain: why experiments are often more effective than mediational analyses in examining psychological processes. J. Personlty Socl Psychol., 89, 845-851.
51. VanderWeele, T. J. (2008) Simple relations between principal stratification and direct and indirect effects. Statist. Probab. Lett., 78, 2957-2962.
52. VanderWeele, T. J. (2009) Mediation and mechanism. Eur. J. Epidem., 24, 217-224.
53. VanderWeele, T. J. and Robins, J. M. (2007) The identification of synergism in the sufficient-component-cause framework. Epidemiology, 18, 329-339.
54. VanderWeele, T. J. and Robins, J. M. (2008) Empirical and counterfactual conditions for sufficient cause interactions. Biometrika, 91, 49-61.
55. VanderWeele, T. J. and Robins, J. M. (2009) Minimal sufficient causation and directed acyclic graphs. Ann. Statist., 37, 1437-1465.
56. Albert, J. M. (2008) Mediation analysis via potential outcomes models. Statist. Med., 27, 1282-1304.
57. Albert, J. M. and Nelson, S. (2011) Generalized causal mediation analysis. Biometrics, 67, 1028-1038.
58. Baron, R. M. and Kenny, D. A. (1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic and statistical considerations. J. Personlty Socl Psychol., 51, 1173-1182.
59. Bauer, P. and Kieser, M. (1999) Combining different phases in the development of medical treatments within a single trial. Statist. Med., 18, 1833-1848.
60. Cai, Z., Kuroki, M., Pearl, J. and Tian, J. (2008) Bounds on direct effects in the presence of confounded intermed iate variables. Biometrics, 64, 695-701.
61. Chen, H., Geng, Z. and Jia, J. (2007) Criteria for surrogate end points. J. R. Statist. Soc. B, 69, 919-932.
62. Clogg, C., Petkova, E. and Shihadeh, E. (1992) Statistical methods for analyzing collapsibility in regression models. J. Educ. Statist., 17, 51-74.
63. Cole, S. R. and Frangakis, C. E. (2009) The consistency statement in causal inference: a definition or an assumption?Epidemiology, 20, 3-5.
64. Cook, T. D. and Campbell, D. T. (1979) Quasi-experimentation. Chicago: Rand-McNally.
65. Dawid, A. P. (2002) Influence diagrams for causal modelling and inference. Int. Statist. Rev., 70, 161-189.
66. Dawid, A. P. (2003) Causal inference using influence diagrams: the problem of partial compliance. In Highly Structured Stochastic Systems(eds P. J. Green, N. L. Hjort and S. Richardson ). New York: Oxford University Press.
67. Didelez, V., Dawid, A. P. and Geneletti, S. (2006) Direct and indirect effects of sequential decisions. In Proc. 22nd Conf. Association for Uncertainty in Artificial Intelligence (eds R. Dechter and T. Richardson ), pp. 138-146. Corvallis: Association for Uncertainty in Artificial Intelligence Press.
68. Emsley, R. A. and VanderWeele, T. J. (2012) Mediation and sensitivity analysis using two or more trials. Technical Report .
69. Fearon, J. D. and Laitin, D. D. (2003) Ethnicity insurgency, and civil war. Am. Polit. Sci. Rev., 97, 75-90.
70. Frangakis, C. E. and Rubin, D. B. (1999) Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika, 86, 365- 379.
71. Frangakis, C. E. and Rubin, D. B. (2002) Principal stratification in causal inference. Biometrics, 58, 21-29.
72. Frumento, P., Mealli, F., Pacini, B. and Rubin, D. (2012) Evaluating the effect of training on wages in the presence of noncompliance, nonemployment, and missing outcome data. J. Am. Statist. Ass., 107, 450-466.
73. Geneletti, S. (2007) Identifying direct and indirect effects in a non-counterfactual framework. J. R. Statist. Soc. B, 69, 199-215.
74. Greiner, D. J. and Rubin, D. B. (2011) Causal effects of perceived immutable characteristics. Rev. Econ. Statist., 93, 775-785.
75. Holland, P. W. (1986) Statistics and causal inference (with discussion). J. Am. Statist. Ass., 81, 945-960.
76. Hong, G. (2010) Ratio of mediator probability weighting for estimating natural direct and indirect effects. Proc. Biometr. Sect. Am. Statist. Ass., 2401-2415.
77. Hong, G., Deutsch, J. and Hill, H. D. (2011) Parametric and non-parametric weighting methods for estimating mediation effects: an application to the National Evaluation of Welfare-to-Work Strategies. Proc. Socl Statist. Sect. Am. Statist. Ass., 3215-3229.
78. Hoyle, R. H. and Kenny, D. A. (1999) Sample size, reliability, and tests of statistical mediation. In Statistical Strategies for Small Sample Research (ed. R. H. Hoyle ), pp. 195-222. Thousand Oaks: Sage.
79. Humphreys, M. (2005) Natural resources, conflict, and conflict resolution: uncovering the mechanisms. J. Conflct Resoln, 49, 508-537.
80. Imai, K., Keele, L. and Tingley, D. (2010) A general approach to causal mediation analysis. Psychol. Meth., 15, 309-334.
81. Imai, K., Keele, L., Tingley, D. and Yamamoto, T. (2011) Unpacking the black box of causality: learning about causal mechanisms from experimental and observational studies. Am. Polit. Sci. Rev., 105, 765-789.
82. Imai, K., Keele, L. and Yamamoto, T. (2010) Identification, inference, and sensitivity analysis for causal mediation effects. Statist. Sci., 25, 51-71.
83. Imai, K. and Yamamoto, T. (2012) Identification and sensitivity analysis for multiple causal mechanisms: revisiting evidence from framing experiments. Submitted to Polit. Anal. (Available from http://imai.princeton.edu/research/medsens.html.)
84. Jin, H. L. and Rubin. D. B. (2008) Principal stratification for causal inference with extended partial compliance. J. Am. Statist. Ass., 103, 101-111.
85. Kaufman, S., Kaufman, J. S. and MacLehose, R. F. (2009) Analytic bounds on causal risk differences in directed acyclic graphs involving three observed binary variables. J. Statist. Planng Inf., 139, 3473-3487.
86. Leiva, V., Barros, M., Paula, G. A. and Galea, M. (2007) Influence diagnostics in log-Birnbaum-Saunders regression models with censored data. Comput. Statist. Data Anal., 51, 5694-5707.
87. Liu, Q., Proschan, M. A. and Pledger, G. W. (2002) A unified theory of two-stage adaptive designs. J. Am. Statist. Ass., 97, 1034-1041.
88. MacKinnon, D. P. (2008) Introduction to Statistical Mediation Analysis. New York: Erlbaum.
89. MacKinnon, D. P. and Pirlott, A. G. (2010) The unbearable lightness of b: approaches to improve causal interpretation of the M to Y relation. Society for Personality and Social Psychology Conf., Las Vegas .
90. Manski, C. F. (2007) Identification for Prediction and Decision. Cambridge: Harvard University Press.
91. Mark, M. M. (1986) Validity typologies and the logic and practice of quasi-experimentation. In Advances in Quasi-experimental Design and Analysis (ed. A. W. M. K. Trochim ), pp. 47-66. San Francisco: Jossey-Bass.
92. Mattei, A. and Mealli, F. (2011) Augmented designs to assess principal strata direct effects. J. R. Statist. Soc. B, 73, 729-752.
93. Mealli, F. and Rubin, D. B. (2003) Assumptions allowing the estimation of direct causal effects. J. Econmetr., 112, 79-87.
94. Nedelman, J. R., Rubin, D. B. and Sheiner, L. B. (2007) Diagnostics for confounding in PK/DD models for oxcarbazepine. Statist. Med., 26, 290-308.
95. Neyman, J. (1990) Sur les applications de la théorie des probabilités aux experiences agricoles: essay des principes.. Statist. Sci., 5, 465-472 (Engl. tránsl.).
96. Pearl, J. (2001) Direct and indirect effects. In Proc. 17th Conf. Uncertainty in Artificial Intelligence (eds J. S. Breese and D. Koller ), pp. 411-420. San Francisco: Morgan Kaufmann.
97. Ramsahai, R. R. (2007) Causal bounds and instruments. In Proc. 23rd A. Conf. Uncertainty in Artifical Intelligence, pp. 310-317. Corvallis: Association for Uncertainty in Artificial Intelligence Press.
98. Ramsahai, R. R. (2012) Causal bounds and observable constraints for non-deterministic models. J. Mach. Learn. Res., 13, 829-848.
99. Robins, J. (1986) A new approach to causal inference in mortality studies with sustained exposure periods-applications to control of the healthy worker survivor effect. Math. Modlng, 7, l393-1512.
100. Robins, J. M. (2003) Semantics of causal DAG models and the identification of direct and indirect effects. In Highly Structured Stochastic Systems (eds P. J. Green, N. L. Hjort and S. Richardson ), pp. 70-81. Oxford: Oxford University Press.
101. Robins, J. M. and Richardson, T. S. (2010) Alternative graphical causal models and the identification of direct effects. In Causality and Psychopathology: Finding and Determinants of Disorders and Their Cures (eds P. Shrout, K. M. Keyes and K. Ornstein ), pp. 103-158. New York: Oxford University Press.
102. Robins, J. M. and Wasserman, L. (1997) Estimation of effects of sequential treatments by reparameterizing directed acyclic graphs. In Proc. 13th Conf. Uncertainty in Artificial Intelligence (eds D. Geiger and P. Shenoy ), pp. 409-420. San Francisco: Morgan Kaufmann.
103. Rubin, D. B. (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol., 66, 688-701.
104. Rubin, D. B. (1975) Bayesian inference for causality: the importance of randomization. Proc. Socl Statist. Sect. Am. Statist. Ass., 233-239.
105. Rubin, D. B. (1977) Assignment to treatment group on the basis of a covariate. J. Educ. Statist., 2, 1-26; correction, 384.
106. Rubin, D. B. (1978) Bayesian inference for causal effects: the role of randomization. Ann. Statist., 6, 34-58.
107. Rubin, D. B. (1980) Discussion of ''Randomization analysis of experimental data in the Fisher randomization test'' by Basu. J. Am. Statist. Ass., 75, 591-593.
108. Rubin, D. B. (1986) Which ifs have causal answers?J. Am. Statist. Ass., 82, 961-962.
109. Rubin, D. B. (2005) Causal inference using potential outcomes: design, modeling, decisions. J. Am. Statist. Ass., 100, 322-331.
110. Rubin, D. B. (2010) Reflections stimulated by the comments of Shadish (2009) and West & Thoemmes (2009). Psychol. Meth., 15, 38-46.
111. Shimizu, S. and Kano, Y. (2008) Use of non-normality in structural equation modeling: application to direction of causation. J. Statist. Planng Inf., 138, 3483-3491.
112. Sjölander, A. (2009) Bounds on natural direct effects in the presence of confounded intermediate variables. Statist. Med., 28, 558-571.
113. Smith, E. R. (1982) Beliefs, attributions, and evaluations: nonhierarchical models of mediation in social cognition. J. Personlty Socl Psychol., 43, 248-259.
114. Taguchi, G. (1987) System of Experimental Design:Engineering Methods to Optimize Quality and Minimize Costs (Engl. Transl.). New York: Quality Resources.
115. Tchetgen Tchetgen, E. J. and Shpitser, I. (2011) Semiparametric theory for causal mediation analysis: efficiency bounds, multiple robustness, and sensitivity analysis. Working Paper 130. Harvard University School of Public Health, Cambridge. (Available from http://biostats.bepress.com/harvardbiostat/paper130.)
116. VanderWeele, T. J. (2008) Simple relations between principal stratification and direct and indirect effects. Statist. Probab. Lett., 78, 2957-2962.
117. VanderWeele, T. J. (2010) Bias formulas for sensitivity analysis for direct and indirect effects. Epidemiology, 21, 540-551.
118. VanderWeele, T. J. (2012) Mediation analysis with multiple versions of the mediator. Epidemiology, 23, 454-463.
119. VanderWeele, T. J. and Vansteelandt, S. (2009) Conceptual issues concerning mediation, interventions and composition. Statist. Interface-Special Issue on Mental Health and Social Behavioral Science, 2, 457-468.
120. Wright, S. (1921) Correlation and causation. J. Agric. Res., 20, 557-585.