External validity: From do-calculus to transportability across populations

Statistical Science

Volumn 29, Issue 4, 2014, Pages 579-595

  Pearl, Judea ^a   Bareinboim, Elias ^a  

^a Engineering IV   (United States)

Author keywords

Causal effects; Experimental design; External validity; Generalizability

Indexed keywords

EID: 84921464994     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-STS486     Document Type: Article

References (64)

1. ADELMAN, L. (1991). Experiments, quasi-experiments, and case studies: A review of empirical methods for evaluating decision support systems. IEEE Transactions on Systems, Man and Cybernetics 21 293-301.
2. BALKE, A. and PEARL, J. (1995). Counterfactuals and policy analysis in structural models. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence (P. Besnard and S. Hanks, eds.) 11-18. Morgan Kaufmann, San Francisco, CA. MR1615008
3. BAREINBOIM, E., BRITO, C. and PEARL, J. (2012). Local characterizations of causal Bayesian networks. In Graph Structures for Knowledge Representation and Reasoning. Lecture Notes in Artificial Intelligence 7205 1-17. Springer, Berlin.
4. BAREINBOIM, E. and PEARL, J. (2012). Transportability of causal effects: Completeness results. In Proceedings of the Twenty-Sixth National Conference on Artificial Intelligence 698-704. AAAI Press, Menlo Park, CA.
5. BAREINBOIM, E. and PEARL, J. (2013). Causal transportability with limited experiments. In Proceedings of the Twenty-Seventh National Conference on Artificial Intelligence 95-101. AAAI Press, Menlo Park, CA.
6. BAREINBOIM, E. and PEARL, J. (2013). A general algorithm for deciding transportability of experimental results. J. Causal Inference 1 107-134.
7. BAREINBOIM, E. and PEARL, J. (2013). Meta-transportability of causal effects: A formal approach. In Proceedings of the Sixteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2013). J. Mach. Learn. Res. 31 135-143.
8. BAREINBOIM, E., TIAN, J. and PEARL, J. (2014). Recovering from selection bias in causal and statistical inference. In Proceedings of The Twenty-Eighth Conference on Artificial Intelligence (C. E. Brodley and P. Stone, eds.). AAAI Press, Menlo Park, CA. To appear.
9. BERKSON, J. (1946). Limitations of the application of fourfold table analysis to hospital data. Biometrics 2 47-53.
10. BOLLEN, K. A. and PEARL, J. (2013). Eight myths about causality and structural equation models. In Handbook of Causal Analysis for Social Research (S. L. Morgan, ed.) Chapter 15. Springer, New York.
11. CAMPBELL, D. and STANLEY, J. (1963). Experimental and Quasi-Experimental Designs for Research. Wadsworth, Chicago.
12. COLE, S. R. and STUART, E. A. (2010). Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. Am. J. Epidemiol. 172 107-115.
13. DAVIS, J. A. (1984). Extending Rosenberg's technique for standardizing percentage tables. Social Forces 62 679-708.
14. DAWID, A. P. (2002). Influence diagrams for causal modelling and inference. Internat. Statist. Rev. 70 161-189.
15. ELLENBERG, S. S. and HAMILTON, J. M. (1989). Surrogate endpoints in clinical trials: Cancer. Stat. Med. 8 405-413.
16. GELMAN, A. andHILL, J. (2007). Data Analysis Using Regression and Multilevel/Hierarchical Models. Analytical Methods for Social Research. Cambridge Univ. Press, New York.
17. GLASS, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher 5 3-8.
18. GLYMOUR, M. M. andGREENLAND, S. (2008). Causal diagrams. In Modern Epidemiology, 3rd ed. (K. J. Rothman, S. Greenland and T. L. Lash, eds.) 183-209. Lippincott Williams & Wilkins, Philadelphia, PA.
19. HAAVELMO, T. (1943). The statistical implications of a system of simultaneous equations. Econometrica 11 1-12. MR0007954
20. HAYDUK, L., CUMMINGS, G., STRATKOTTER, R., NIMMO, M., GRYGORYEV, K., DOSMAN, D., GILLESPIE, M., PAZDERKAROBINSON, H. and BOADU, K. (2003). Pearl's d-separation: One more step into causal thinking. Struct. Equ. Model. 10 289-311. MR1977133
21. HECKMAN, J. J. (1979). Sample selection bias as a specification error. Econometrica 47 153-161. MR0518832
22. HEDGES, L. V. and OLKIN, I. (1985). Statistical Methods for Meta-Analysis. Academic Press, Orlando, FL. MR0798597
23. HEISE, D. R. (1975). Causal Analysis. Wiley, New York.
24. HERNÁN, M. A., HERNÁNDEZ-DÍAZ, S. and ROBINS, J. M. (2004). A structural approach to selection bias. Epidemiology 15 615-625.
25. HERNÁN, M. A. and VANDERWEELE, T. J. (2011). Compound treatments and transportability of causal inference. Epidemiology 22 368-377.
26. HÖFLER, M., GLOSTER, A. T. and HOYER, J. (2010). Causal effects in psychotherapy: Counterfactuals counteract overgeneralization. Psychotherapy Research 20 668-679. DOI:10.1080/10503307.2010.501041
27. HUANG, Y. and VALTORTA, M. (2006). Pearl's calculus of intervention is complete. In Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence (R. Dechter and T. S. Richardson, eds.) 217-224. AUAI Press, Corvallis, OR.
28. JOFFE, M. M. andGREENE, T. (2009). Related causal frameworks for surrogate outcomes. Biometrics 65 530-538. MR2751477
29. KOLLER, D. and FRIEDMAN, N. (2009). Probabilistic Graphical Models: Principles and Techniques. Adaptive Computation and Machine Learning. MIT Press, Cambridge, MA. MR2778120
30. LANE, P. W. and NELDER, J. A. (1982). Analysis of covariance and standardization as instances of prediction. Biometrics 38 613-621.
31. LEHMANN, E. L. and CASELLA, G. (1998). Theory of Point Estimation, 2nd ed. Springer, New York. MR1639875
32. MANSKI, C. (2007). Identification for Prediction and Decision. Harvard Univ. Press, Cambridge, MA.
33. NEYMAN, J. (1923). Sur les applications de la thar des probabilities aux experiences Agaricales: Essay des principle. English translation of excerpts by D. Dabrowska and T. Speed in Statist. Sci. 5 (1990) 463-472.
34. OWEN, A. B. (2009). Karl Pearson's meta-analysis revisited. Ann. Statist. 37 3867-3892. MR2572446
35. PEARL, J. (1988). Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, San Mateo, CA.
36. PEARL, J. (1993). Graphical models, causality, and intervention. Statist. Sci. 8 266-273.
37. PEARL, J. (1995). Causal diagrams for empirical research. Biometrika 82 669-710. MR1380809
38. PEARL, J. (2000). Causality: Models, Reasoning, and Inference. Cambridge Univ. Press, Cambridge. MR1744773
39. PEARL, J. (2009). Causal inference in statistics: An overview. Stat. Surv. 3 96-146. MR2545291
40. PEARL, J. (2009). Causality: Models, Reasoning, and Inference, 2nd ed. Cambridge Univ. Press, Cambridge. MR2548166
41. PEARL, J. (2011). The structural theory of causation. In Causality in the Sciences (P. McKay Illari, F. Russo and J. Williamson, eds.) 697-727. Clarendon Press, Oxford.
42. PEARL, J. (2012). The causal foundations of structural equation modeling. In Handbook of Structural Equation Modeling (R. H. Hoyle, ed.). Guilford Press, New York.
43. PEARL, J. (2012). Some thoughts concerning transfer learning, with applications to meta-analysis and data-sharing estimation. Technical Report R-387, Cognitive Systems Laboratory, Dept. Computer Science, UCLA.
44. PEARL, J. (2013). Linear models: A useful "microscope" for causal analysis. J. Causal Inference 1 155-170.
45. PEARL, J. (2014). Trygve Haavelmo and the emergence of causal calculus. Econometric Theory, Special Issue on Haavelmo Centennial. Published online: 10 June 2014. DOI:10.1017/S0266466614000231.
46. PEARL, J. and BAREINBOIM, E. (2011). Transportability across studies: A formal approach. Technical Report R-372, Cognitive Systems Laboratory, Dept. Computer Science, UCLA.
47. PETERSEN, M. L. (2011). Compound treatments, transportability, and the structural causal model: The power and simplicity of causal graphs. Epidemiology 22 378-381.
48. PRENTICE, R. L. (1989). Surrogate endpoints in clinical trials: Definition and operational criteria. Stat. Med. 8 431-440.
49. RICHARDSON, T. (2003). Markov properties for acyclic directed mixed graphs. Scand. J. Stat. 30 145-157. MR1963898
50. ROBINS, J. (1986). A new approach to causal inference in mortality studies with a sustained exposure period-Application to control of the healthy worker survivor effect. Math. Modelling 7 1393-1512. MR0877758
51. ROBINS, J., ORELLANA, L. and ROTNITZKY, A. (2008). Estimation and extrapolation of optimal treatment and testing strategies. Stat. Med. 27 4678-4721. MR2528576
52. ROSENTHAL, R. (1995). Writing meta-analytic reviews. Psychological Bulletin 118 183-192.
53. RUBIN, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educational Psychology 66 688-701.
54. SHADISH, W. R., COOK, T. D. and CAMPBELL, D. T. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference, 2nd ed. Houghton-Mifflin, Boston.
55. SHPITSER, I. and PEARL, J. (2006). Identification of conditional interventional distributions. In Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence (R. Dechter and T. S. Richardson, eds.) 437-444. AUAI Press, Corvallis, OR.
56. SPIRTES, P.,GLYMOUR, C. and SCHEINES, R. (1993). Causation, Prediction, and Search. Lecture Notes in Statistics 81. Springer, New York. MR1227558
57. SPIRTES, P.,GLYMOUR, C. and SCHEINES, R. (2000). Causation, Prediction, and Search, 2nd ed. Adaptive Computation and Machine Learning. MIT Press, Cambridge, MA. MR1815675
58. STROTZ, R. H. and WOLD, H. O. A. (1960). Recursive vs. nonrecursive systems: An attempt at synthesis. Econometrica 28 417-427. MR0120034
59. TIAN, J. and PEARL, J. (2002). A general identification condition for causal effects. In Proceedings of the Eighteenth National Conference on Artificial Intelligence 567-573. AAAI Press/The MIT Press, Menlo Park, CA.
60. VERMA, T. and PEARL, J. (1988). Causal networks: Semantics and expressiveness. In Proceedings of the Fourth Workshop on Uncertainty in Artificial Intelligence 352-359. Mountain View, CA. Also in Uncertainty in AI 4 (1990) (R. Shachter, T. S. Levitt, L. N. Kanal and J. F. Lemmer, eds.) 69-76. North-Holland, Amsterdam. MR1166827
61. WESTERGAARD, H. (1916). Scope and method of statistics. Publ. Amer. Statist. Assoc. 15 229-276.
62. WHITE, H. and CHALAK, K. (2009). Settable systems: An extension of Pearl's causal model with optimization, equilibrium, and learning. J. Mach. Learn. Res. 10 1759-1799. MR2540776
63. WRIGHT, S. (1921). Correlation and causation. J. Agricultural Research 20 557-585.
64. YULE, G. U. (1934). On some points relating to vital statistics, more especially statistics of occupational mortality. J. Roy. Statist. Soc. 97 1-84.