Campbell's and Rubin's Perspectives on Causal Inference

Psychological Methods

Volumn 15, Issue 1, 2010, Pages 18-37

  West, Stephen G ^a   Thoemmes, Felix ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

causal inference; observational study; quasi experiment; randomized experiment; research design

Indexed keywords

ARTICLE; EPIDEMIOLOGY; HUMAN; METHODOLOGY; PSYCHOLOGICAL THEORY; PSYCHOLOGY;

CAUSALITY; HUMANS; PSYCHOLOGICAL THEORY; PSYCHOLOGY; RESEARCH DESIGN;

EID: 77949620091     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015917     Document Type: Article

References (92)

1. Angrist J.D., Imbens G.W., and Rubin D.B. Identification of causal effects using instrumental variables (with discussion and rejoinder). Journal of the American Statistical Association 91 (1996) 444-472
2. Aronson E., Wilson T.D., and Brewer M.B. Experimentation in social psychology. In: Gilbert D.T., Fiske S.T., and Lindzey G. (Eds). Handbook of social psychology. 4th ed. 1 (1998), McGraw-Hill, New York 99-142
3. Baker S.G. Analysis of survival data from a randomized trial with all-or- none compliance: Estimating the cost-effectiveness of a cancer screening program. Journal of the American Statistical Association 93 (1998) 929-934
4. Barnard J., Du J., Hill J.L., and Rubin D.B. A broader template for analyzing broken randomized experiments. Sociological Methods and Research 27 (1998) 285-317
5. Barnard J., Frangakis C.E., Hill J.L., and Rubin D.B. Principal stratification approach to broken randomized experiments: A case study of school choice vouchers in New York City (with commentary). Journal of the American Statistical Association 98 (2003) 299-323
6. Barnoya J., and Glantz S.A. Cardiovascular effects of secondhand smoke: Nearly as large as smoking. Circulation 111 (2005) 2684-2698
7. Boruch R.F. Randomized experiments for planning and evaluation (1997), Sage, Thousand Oaks, CA
8. Campbell D.T. Factors relevant to the validity of experiments in social settings. Psychological Bulletin 54 (1957) 297-312
9. Campbell D.T. Relabeling internal and external validity for applied social scientists. In: Trochim W.M.K. (Ed). Advances in quasi-experimental design and analysis (1986), Jossey-Bass, San Francisco 67-77
10. Campbell D.T. Can we be scientific in applied social science?. In: Overman E.S. (Ed). Methodology and epistemiology for social science: Selected papers of Donald T. Campbell (1988), University of Chicago Press, Chicago 315-334
11. Campbell D.T., and Erlebacher A. How regression artifacts in quasi-experimental evaluations can mistakenly make compensatory education look harmful. In: Hellmuth J. (Ed). Compensatory education: A national debate. Vol. 3: Disadvantaged child (1970), Brunner/Mazel, New York 185-225
12. Campbell D.T., and Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56 (1959) 81-105
13. Campbell D.T., and Kenny D.A. A primer on regression artifacts (1999), Guilford Press, New York
14. Campbell D.T., and Stanley J.C. Experimental and quasi-experimental designs for research (1966), Rand McNally, Chicago
15. Cochran W.G. The planning of observational studies in human populations (with discussion). Journal of the Royal Statistical Society, Series A 128 (1965) 234-255
16. Cochran W.G. Planning and analysis of observational studies (1983), Wiley, New York
17. Cook T.D. A quasi-sampling theory of the generalization of causal relationships. In: Sechrest L.B., and Scott A.G. (Eds). New directions for program evaluation 57 (1993), Jossey-Bass, San Francisco 39-81
18. Cook T.D., and Campbell D.T. Quasi-experimentation: Design and analysis issues for field settings (1979), Rand McNally, Chicago
19. Cook T.D., Dintzer L., and Mark M.M. The causal analysis of concomitant time series. In: Bickman L. (Ed). Applied social psychology annual 1 (1980), Sage, Beverly Hills, CA 93-135
20. Dehejia R.H., and Wahba S. Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association 94 (1999) 1053-1062
21. Drake C. Effects of misspecification of the propensity score on estimators of treatment effects. Biometrics 69 (1993) 1321-1326
22. Draper D. Inference and hierarchical modeling in the social sciences. Journal of Educational and Behavioral Statistics 20 (1995) 115-147
23. Eid M., and Diener E. Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC
24. Embretson S.E. The continued search for nonarbitrary metrics in psychology. American Psychologist 61 (2006) 50-55
25. Frangakis C.E., and Rubin D.B. Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika 86 (1999) 366-379
26. Frangakis C., and Rubin D.B. Principal stratification in causal inference. Biometrics 58 (2002) 21-29
27. Gastwirth J.L., Krieger A.M., and Rosenbaum P.R. Dual and simultaneous sensitivity analysis for matched pairs. Biometrika 85 (1998) 907-920
28. Graham J.W., Taylor B.J., Olchowski A.E., and Cumsille P.E. Planned missing data designs in psychological research. Psychological Methods 11 (2006) 323-343
29. Haviland A., Nagin D.S., and Rosenbaum P.R. Combining propensity score matching and group-based trajectory analysis in an observational study. Psychological Methods 12 (2007) 247-267
30. Higginbotham H.N., West S.G., and Forsyth D.R. Psychotherapy and behavior change: Social, cultural, and methodological perspectives (1988), Pergamon, New York
31. Hirano K., Imbens G.W., Rubin D.B., and Zhou A. Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics 1 (2000) 69-88
32. Holland P.W. Statistics and causal inference (with discussion). Journal of the American Statistical Association 81 (1986) 945-970
33. Hume D., and Millican P. An enquiry concerning human understanding (2007), Oxford, New York (Original work published 1748)
34. Jimerson S.R. Meta-analysis of grade retention research: Implications for practice in the 21st century. School Psychology Review 30 (2001) 420-437
35. Jo B. Statistical power in randomized intervention studies with noncompliance. Psychological Methods 7 (2002) 178-193
36. Jones L.V., and Tukey J.W. A sensible formulation of the significance test. Psychological Methods 5 (2000) 411-414 [Correction: Psychological Methods, 6, 17]
37. Judd C.M., and Kenny D.A. Estimating the effects of social interventions (1981), Cambridge, New York
38. Kish L. Statistical designs for research (1987), Wiley, New York
39. Lehman D., Wortman C., and Williams A. Long-term effects of losing a spouse or a child in a motor vehicle crash. Journal of Personality and Social Psychology 52 (1987) 218-231
40. Lewis D. Causation. Journal of Philosophy 70 (1973) 556-567
41. Little R.J., An H., Johanns J., and Giordani B. A comparison of subset selection and analysis of covariance for the adjustment of confounders. Psychological Methods 5 (2000) 459-476
42. Little R.J., and Rubin D.B. Causal effects in clinical and epidemiological studies via potential outcomes: Conceptual and analytical approaches. Annual Review of Public Health 21 (2000) 121-145
43. Little R.J.A., and Rubin D.B. Statistical analysis with missing data. 2nd ed. (2002), Wiley, Hoboken, NJ
44. Little R.J., and Yau L. Statistical techniques for analyzing data from prevention trials: Treatment of no-shows using Rubin's causal model. Psychological Methods 3 (1998) 247-259
45. Mabe III P.A., and West S.G. Validity of self-evaluations of ability: A review and meta-analysis. Journal of Applied Psychology 67 (1982) 280-296
46. Manski C.F. Choice as an alternative to observational studies: Comment. Statistical Science 14 (1999) 279-281
47. Manski C.F., and Pepper J.V. Monotone instrumental variables: With an application to the returns to schooling. Econometrica 68 (2000) 997-1010
48. Marcus S. Using omitted variable bias to assess uncertainty in the estimation of an AIDS education treatment effect. Journal of Educational and Behavioral Statistics 22 (1997) 193-202
49. McCaffrey D.F., Ridgeway G., and Morral A.R. Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychological Methods 9 (2004) 403-425
50. Meehl P.E. Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science 34 (1967) 103-115
51. Ming K., and Rosenbaum P.R. Substantial gains in bias reduction from matching with a variable number of controls. Biometrics 56 (2000) 118-124
52. Neyman J. On the application of probability theory to agriculture experiments: Essay on principles (Section 9). Statistical Science 5 (1990) 465-480 (Original work published 1923)
53. Overman E.S. Methodology and epistemology for social science: Selected papers of Donald T. Campbell (1988), University of Chicago Press, Chicago
54. Raghunathan T.E., Lepkowski J.M., van Hoewyk J., and Solenberger P. A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology 27 (2001) 85-95
55. Reichardt C.S. A typology of strategies for ruling out threats to validity. In: Bickman L. (Ed). Research design: Donald Campbell's legacy (2000), Sage, Thousand Oaks, CA 89-115
56. Reichardt C.S. The principle of parallelism in the design of studies to estimate treatment effects. Psychological Methods 11 (2006) 1-18
57. Reynolds K.D., and West S.G. A multiplist strategy for strengthening nonequivalent control group designs. Evaluation Review 11 (1987) 691-714
58. Rosenbaum P.R. Choice as an alternative to control in observational studies. Statistical Science 14 (1999) 259-278
59. Rosenbaum P.R. Observational studies. 2nd ed. (2002), Springer, New York
60. Rosenbaum P.R. Interference between units in randomized experiments. Journal of the American Statistical Association 102 (2007) 191-200
61. Rosenbaum P.R., and Rubin D.B. The central role of the propensity score in observational studies for causal effects. Biometrika 70 (1983) 41-55
62. Rosenbaum P.R., and Rubin D.B. Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association 79 (1984) 516-524
63. Rubin D.B. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 66 (1974) 688-701
64. Rubin D.B. Inference and missing data (with discussion). Biometrics 29 (1976) 581-592
65. Rubin D.B. Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics 2 (1977) 1-26
66. Rubin D.B. Bayesian inference for causal effects: The role of randomization. Annals of Statistics 6 (1978) 34-58
67. Rubin D.B. Which ifs have causal answers? Discussion of Holland's "Statistics and causal inference.". Journal of the American Statistical Association 81 (1986) 961-962
68. Rubin D.B. Meta-analysis: Literature synthesis or effect-size surface estimation?. Journal of Educational Statistics 17 (1992) 363-374
69. Rubin D.B. Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association 100 (2005) 322-331
70. Rubin D.B. Matched sampling for causal effects (2006), Cambridge, New York
71. Rubin D.B. Statistical inference for causal effects, with emphasis on applications in psychometrics and education. In: Rao C.R., and Sinharay S. (Eds). Handbook of statistics: Psychometrics (2006), Elsevier, Amsterdam 769-800
72. Rubin D.B., and Thomas N. Matching using estimated propensity scores: Relating theory to practice. Biometrics 52 (1996) 249-264
73. Rubin D.B., and Thomas N. Combining propensity score matching with additional adjustments for prognostic covariates. Journal of the American Statistical Association 95 (2000) 573-585
74. Schafer J.L. Analysis of incomplete multivariate data (1997), CRC Press, New York
75. Schafer J.L., and Graham J.W. Missing data: Our view of the state of the art. Psychological Methods 7 (2002) 147-177
76. Schwarz N.B., and Hippler H.J. Subsequent questions may influence answers to preceding questions in mail surveys. Public Opinion Quarterly 59 (1995) 93-97
77. Shadish W.R., and Cook T.D. Design rules: More steps towards a complete theory of quasi-experimentation. Statistical Science 14 (1999) 294-300
78. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference (2002), Houghton Mifflin, Boston
79. Shadish W.R., Hu X., Glaser R.R., Kownacki R.J., and Wong T. A method for exploring the effects of attrition in randomized experiments with dichotomous outcomes. Psychological Methods 3 (1998) 3-22
80. Shadish W.R., Matt G.E., Navarro A.M., and Phillips G. The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin 126 (2000) 512-529
81. Sheiner L.B., and Rubin D.B. Intention-to-treat analysis and the goals of clinical trials. Clinical Pharmacology and Therapy 57 (1995) 6-10
82. Sobel M.E. What do randomized studies of housing mobility demonstrate? Causal inference in the face of interference. Journal of the American Statistical Association 101 (2006) 1398-1407
83. Steyer R. Analyzing individual and average causal effects via structural equation models. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 1 (2005) 39-54
84. Steyer R., Partchev I., Kröhne U., Nagengast B., and Fiege C. Causal effects in between-group experiments and quasi-experiments: Theory (2009) Book in preparation
85. Stuart E., and Rubin D. Best practices in quasi-experimental designs: Matching methods for causal inference. In: Osborne J.W. (Ed). Best practices in quantitative methods (2008), Sage, Thousand Oaks, CA 155-176
86. Weisz J.R., Weiss B., and Donenberg G.R. The lab versus the clinic: Effects of child and adolescent psychotherapy. American Psychologist 47 (1992) 1578-1585
87. West S.G., Biesanz J.C., and Pitts S.C. Causal inference and generalization in field settings: Experimental and quasi-experimental designs. In: Reis H.T., and Judd C.M. (Eds). Handbook of research methods in social and personality psychology (2000), Cambridge, New York 40-84
88. West S.G., Duan N., Pequegnat W., Gaist P., Des Jarlais D., Holtgrave D., et al. Alternatives to the randomized controlled trial. American Journal of Public Health 98 (2008) 1359-1366
89. West S.G., and Sagarin B.J. Subject selection and loss in randomized experiments. In: Bickman L. (Ed). Contributions to research design: Donald Campbell's legacy 2 (2000), Sage, Thousand Oaks, CA 117-154
90. Wolchik S.A., West S.G., Sandler I.N., Tein J.-Y., Coatsworth D., Lengua L., et al. An experimental evaluation of theory-based mother and mother-child programs for children of divorce. Journal of Consulting and Clinical Psychology 68 (2000) 843-856
91. Wu W., West S.G., and Hughes J.N. Effect of retention in first grade on children's achievement trajectories over four years: A piecewise growth analysis using propensity score matching. Journal of Educational Psychology 100 (2008) 727-740
92. Wu W., West S.G., and Hughes J.N. Short-term effects of grade retention on growth rate of Woodcock-Johnson III broad math and reading scores. Journal of School Psychology 46 (2008) 85-105