Estimating the causal effect of randomization versus treatment preference in a doubly randomized preference trial

Psychological Methods

Volumn 17, Issue 2, 2012, Pages 244-254

  Marcus, Sue M ^a,b   Stuart, Elizabeth A ^c   Wang, Pei ^a   Shadish, William R ^d   Steiner, Peter M ^e  

^a Howard Hughes Medical Institute   (United States)

^b NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^c JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Causal inference; Conditional independence; Generalizability; Propensity score matching; Treatment preference

Indexed keywords

ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; EDUCATION; EPIDEMIOLOGY; FEMALE; HUMAN; LINGUISTICS; MALE; MATHEMATICS; METHODOLOGY; PATIENT COMPLIANCE; PATIENT PREFERENCE; PROPENSITY SCORE; PSYCHOLOGICAL ASPECT; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESEARCH SUBJECT; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS; STUDENT; TREATMENT OUTCOME;

CAUSALITY; DATA INTERPRETATION, STATISTICAL; FEMALE; HUMANS; MALE; MATHEMATICS; MODELS, STATISTICAL; PATIENT COMPLIANCE; PATIENT PREFERENCE; PROPENSITY SCORE; RANDOM ALLOCATION; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; RESEARCH SUBJECTS; SELECTION BIAS; STUDENTS; TREATMENT OUTCOME; VOCABULARY;

EID: 84866446035     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0028031     Document Type: Article

References (54)

1. Braslow, J. T., Duan, N., Starks, S. L., Polo, A., Bromley, E., & Wells, K. B. (2005). Generalizability of studies on mental health treatment and outcomes, 1981 to 1996. Psychiatric Services, 56, 1261-1268. doi: 10.1176/appi.ps.56.10.1261
2. Brewin, C. R., & Bradley, C. (1989). Patient preferences and randomized clinical-trials. British Medical Journal, 299, 313-315.
3. Cochran, W. G. (1965). The planning of observational studies of human populations. Journal of the Royal Statistical Society: Series A. General, 128, 234-266. doi:10.2307/2344179
4. Cook, T. D., & Steiner, P. M. (2010). Case matching and the reduction of selection bias in quasi-experiments: The relative importance of the pretest as a covariate, of unreliable measurement, and of mode of data analysis. Psychological Methods, 15, 56-68. doi:10.1037/a0018536
5. Coronary Artery Surgery Study (CASS): A randomized trial of coronary artery bypass surgery. Comparability of entry characteristics and survival in randomized patients and nonrandomized patients meeting randomization criteria. (1984). Journal of the American College of Cardiology, 3, 114-128. doi:10.1016/S0735-1097(84)80437-4
6. Dawid, P. (1979). Conditional independence in statistical theory. Journal of the Royal Statistical Society: Series B. Methodological, 41, 1-3l. doi:10.2307/2984718
7. Dawid, P. (1984). Causal inference from messy data. Journal of the American Statistical Association, 79, 22-24. doi:10.2307/2288327
8. Döhler, R. (1980). On the conditional independence of random events. Theory of Probability and Its Applications, 25, 628-634. doi:10.1137/1125080
9. Dynarski, S. M. (2003). Does aid matter? Measuring the effect of student aid on college attendance and completion. American Economic Review, 93, 279-288. doi:10.1257/000282803321455287
10. Ellenberg, S. S., Finkelstein, D. M., & Schoenfeld, D. A. (1992). Statistical issues arising in AIDS clinical trials. Journal of the American Statistical Association, 87, 562-569. doi:10.2307/2290291
11. Fisher, R. A. (1935). The design of experiments. London, England: Hafner.
12. Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S.,...Ji,P.(2005). Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science, 6, 151-175.
13. Gastwirth, J. L., Krieger, A. M., & Rosenbaum, P. R. (2000). Asymptotic separability in sensitivity analysis. Journal of the Royal Statistical Society: Series B. Statistical Methodology, 62, 545-555. doi:10.1111/1467-9868.00249
14. Greenhouse, J. B., Kaizar, E. E., Kelleher, K., Seltman, H., & Gardner, W. (2008). Generalizing from clinical trial data: A case study. The risk of suicidality among pediatric antidepressant users. Statistics in Medicine, 27, 1801-1813. doi:10.1002/sim.3218
15. Hansen, B. B. (2004). Full matching in an observational study of coaching for the SAT. Journal of the American Statistical Association, 99, 609-618. doi:10.1198/016214504000000647
16. Hansen, B. B., & Klopfer, S. O. (2006). Optimal full matching and related designs via network flows. Journal of Computational and Graphical Statistics, 15, 609-627. doi:10.1198/106186006X137047
17. Haviland, A., Nagin, D. S., & Rosenbaum, P. R. (2007). Combining propensity score matching and group-based trajectory analysis in an observational study. Psychological Methods, 12, 247-267. doi:10.1037/1082-989X.12.3.247
18. Heckman, J. J. (2001). Micro data, heterogeneity, and the evaluation of public policy: Nobel Lecture. Journal of Political Economy, 109, 673-748. doi:10.1086/322086
19. Hodges, J., & Lehmann, E. (1962). Rank methods for combination of independent experiments in the analysis of variance. Annals of Mathematical Statistics, 33, 482-497.
20. Hodges, J., & Lehmann, E. (1963). Estimates of location based on rank tests. Annals of Mathematical Statistics, 34, 598-611.
21. Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945-960. doi:10.2307/2289064
22. Imai, K., King, G., & Stuart, E. A. (2008). Misunderstandings between experimentalists and observationalists about causal inference. Journal of the Royal Statistical Society: Series A. Statistics in Society, 171, 481-502. doi:10.1111/j.1467-985X.2007.00527.x
23. Janevic, M. R., Janz, N. K., Dodge. J. A., Lin, X., Pan, W., Sinco, B. R., & Clark, N. M. (2003). The role of choice in health education intervention trials: A review and case study. Social Science & Medicine, 56, 1581-1594. doi:10.1016/S0277-9536(02)00158-2
24. Levitt, S. D., & List, J. A. (2007). What do laboratory experiments measuring social preferences real about the real world? Journal of Economic Perspectives, 21, 153-174. doi:10.1257/jep.21.2.153
25. Little, R. J., Long, Q., & Lin, X. (2008). Comment [On Shadish, Clark, and Steiner (2008)]. Journal of the American Statistical Association, 103, 1344-1346. doi:10.1198/016214508000000995
26. Long, Q., Little, R. J., & Lin, X. (2008). Causal inference in hybrid intervention trials involving treatment choice. Journal of the American Statistical Association, 103, 474-484. doi:10.1198/016214507000000662
27. Macias, C., Gold, P. B., Hargreaves, W. A., Aronson, E., Bickman, L., Barreira, P. J.,... Fisher, W. H. (2009). Preference in random assignment: Implications for the interpretation of randomized trials. Administration and Policy in Mental Health and Mental Health Services Research, 36, 331-342. doi:10.1007/s10488-009-0224-0
28. Marcus, S. M. (1997). Assessing non-consent bias with parallel randomized and nonrandomized clinical trials. Journal of Clinical Epidemiology, 50, 823-828. doi:10.1016/S0895-4356(97)00068-1
29. Marcus, S. M., & Gibbons, R. D. (2002). Estimating the efficacy receiving treatment in randomized clinical trials with noncompliance. Health Services and Outcomes Research Methodology, 2, 247-258. doi: 10.1023/A:1020319328212
30. Ming, K., & Rosenbaum, P. R. (2000). Substantial gains in bias reduction from matching with a variable number of controls. Biometrics, 56, 118-124. doi:10.1111/j.0006-341X.2000.00118.x
31. Paradise, J. L., Bluestone, C. D., Bachman, R. Z., Colborn, D. K., Bernard, B. S., Taylor, F. H.,... Saez, C. A. (1984). Efficacy of tonsillectomy for recurrent throat infection in severely affected children. Results of parallel randomized and nonrandomized clinical trials. New England Journal of Medicine, 310, 674-683. doi:10.1056/NEJM198403153101102
32. Paradise, J. L., Bluestone, C. D., Rogers, K. D., Taylor, F. H., Colborn, D. K., Bachman, R. Z.,... Schwarzbach, R. H. (1990). Efficacy of adenoidectomy for recurrent otitis media in children previously treated with tympanostomy-tube placement: Results of parallel randomized and nonrandomized trials. Journal of the American Medical Association, 263, 2066-2073. doi:10.1001/jama.1990.03440150074029
33. Pearl, J. (2009). Causal inference in statistics: An overview. Statistics Surveys, 3, 96-146. doi:10.1214/09-SS057
34. Pearl, J., & Paz, A. (1987). Graphoids: A graph-based logic for reasoning about relevance relations. In B. du Boulay, D. Hogg, & L. Steels (Eds.), Advances in Artificial Intelligence, II: Seventh European Conference on Artificial Intelligence, ECAI-86, Brighton, U.K., July 20-25, 1986 (pp. 307-315). Amsterdam, the Netherlands: North-Holland.
35. R Development Core Team. (2010). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
36. Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York, NY: Springer-Verlag.
37. Rosenbaum, P. R. (2010). Design of observational studies. New York, NY: Springer.
38. Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41-55. doi:10.1093/biomet/70.1.41
39. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688-701. doi:10.1037/h0037350
40. Rubin, D. B. (1977). Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2, 1-26. doi:10.3102/10769986002001001
41. Rubin, D. B. (2008). Comment: The design and analysis of gold standard randomized experiments. Journal of the American Statistical Association, 103, 1350-1353. doi:10.1198/016214508000001011
42. Rucker, G. (1989). A two-stage trial design for testing treatment, selfselection and treatment preference effects. Statistics in Medicine, 4, 477-485.
43. Shadish, W. R., Clark, M. H., & Steiner, P. M. (2008). Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments. Journal of the American Statistical Association, 103, 1334-1344. doi:10.1198/016214508000000733
44. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimenal designs for generalized causal inference. Boston, MA: Houghton-Mifflin.
45. Solomon, R. L. (1949). An extension of control group design. Psychological Bulletin, 46, 137-150. doi:10.1037/h0062958
46. Splawa-Neyman, J. (1990). On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Statistical Science, 5, 465-480. doi:10.2307/2245382
47. Steiner, P. M., Cook, T. D., & Shadish, W. R. (2011). On the importance of reliable covariate measurement in selection bias adjustments using propensity scores. Journal of Educational and Behavioral Statistics, 36, 213-236. doi:10.3102/1076998610375835
48. Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15, 250-267. doi: 10.1037/a0018719
49. Stevens, J., Kelleher, K., Greenhouse, J., Chen, G., Xiang, H., Kaizar,... Arnold, L. E. (2007). Empirical evaluation of the generalizability of the sample from the Multimodal Treatment Study for ADHD. Administration and Policy in Mental Health and Mental Health Services Research, 34, 221-232. doi:10.1007/s10488-006-0097-4
50. Steyer, R., Gabler, S., von Davier, A. A., & Nachtigall, C. (2000). Causal regression models II: Unconfoundedness and causal unbiasedness. Methods of Psychological Research Online, 5(3), 55-86. Retrieved from http://www.dgps.de/fachgruppen/methoden/mpr-online/issue11/art4/steyerCRII.pdf
51. Steyer, R., Gabler, S., von Davier, A. A., Nachtigall, C., & Buhl, T. (2000). Causal regression models I: Individual and average causal effects. Methods of Psychological Research Online, 5(2), 39-71. Retrieved from http://www.dgps.de/fachgruppen/methoden/mpr-online/issue10/art3/steyerCRI.pdf
52. Steyer, R., Nachtigall, C., Wüthrich-Martone, & Krause, K. (2002). Causal regression models III: Covariates, conditional, and unconditional average causal effects. Methods of Psychological Research Online, 7(1), 41-68. Retrieved from http://www.dgps.de/fachgruppen/methoden/mpronline/issue16/art3/steyer.pdf
53. Stuart, E. A., & Green, K. M. (2008). Using full matching to estimate causal effects in nonexperimental studies: Examining the relationship between adolescent marijuana use and adult outcomes. Developmental Psychology, 44, 395-406. doi:10.1037/0012-1649.44.2.395
54. Zelen, M. (1990). Randomized consent designs for clinical trials: An update. Statistics in Medicine, 9, 645-656. doi:10.1002/sim.4780090611