Propensity score methods for estimating relative risks in cluster randomized trials with low-incidence binary outcomes and selection bias

Statistics in Medicine

Volumn 33, Issue 20, 2014, Pages 3556-3575

  Leyrat, Clémence ^a,b,c   Caille, Agnès ^a,b,c,d   Donner, Allan ^e   Giraudeau, Bruno ^a,b,c,d  

^a PARIS DESCARTES UNIVERSITY   (France)

^b INSERM   (France)

^c UNIVERSITY HOSPITAL OF TOURS   (France)

^d UNIVERSITÉ DE TOURS   (France)

^e UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Binary outcomes; Cluster randomized trial; Monte Carlo simulations; Propensity score; Selection bias

Indexed keywords

ARTICLE; CLUSTER ANALYSIS; COVARIANCE; HUMAN; INTERMETHOD COMPARISON; LOGISTIC REGRESSION ANALYSIS; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MONTE CARLO METHOD; POISSON DISTRIBUTION; PROCESS MODEL; PROPENSITY SCORE; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); RISK ASSESSMENT; SELECTION BIAS; ADULT; AGED; COMPUTER SIMULATION; FEMALE; INCIDENCE; KINESIOTHERAPY; MALE; MIDDLE AGED; OSTEOARTHRITIS, HIP; OSTEOARTHRITIS, KNEE; PAIN; PROCEDURES; REGRESSION ANALYSIS; RISK;

ADULT; AGED; CLUSTER ANALYSIS; COMPUTER SIMULATION; EXERCISE THERAPY; FEMALE; HUMANS; INCIDENCE; MALE; MIDDLE AGED; MONTE CARLO METHOD; OSTEOARTHRITIS, HIP; OSTEOARTHRITIS, KNEE; PAIN; PROPENSITY SCORE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGRESSION ANALYSIS; RISK; SELECTION BIAS;

EID: 84905448145     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.6185     Document Type: Article

References (63)

1. Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. Wiley: London, 2000.
2. Torgerson DJ, Torgerson C. Designing Randomised Trials in Health, Education and the Social Sciences: An Introduction. Palgrave Macmillan: Basingstoke, 2008.
3. Carter B. Cluster size variability and imbalance in cluster randomized controlled trials. Statistics in Medicine 2010; 29(29): 2984-93.
4. Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. British Medical Journal 2003; 327(7418): 785-789.
5. Hahn S, Puffer S, Torgerson DJ, Watson J. Methodological bias in cluster randomised trials. BMC Medical Research Methodology 2005; 5(1): 10, DOI:10.1186/1471-2288-5-10.
6. Eldridge S, Ashby D, Bennett C, Wakelin M, Feder G. Internal and external validity of cluster randomised trials: systematic review of recent trials. British Medical Journal 2008; 336(7649): 876-880.
7. Giraudeau B, Ravaud P. Preventing bias in cluster randomised trials. PLoS Medicine 2009; 6(5): e1000065.
8. deHoop E, Teerenstra S, van Gaal BG, Moerbeek M, Borm GF. The 'best balance' allocation led to optimal balance in cluster-controlled trials. Journal of Clinical Epidemiology 2012; 65(2): 132-137.
9. Brierley G, Brabyn S, Torgerson D, Watson J. Bias in recruitment to cluster randomized trials: a review of recent publications. Journal of Evaluation in Clinical Practice 2012; 18(4): 878-886.
10. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983; 70(1): 41-55.
11. Rubin DB. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Services and Outcomes Research Methodology 2001; 2(3-4): 169-188.
12. Schafer JL, Kang J. Average causal effects from nonrandomized studies: a practical guide and simulated example. Psychological Methods 2008; 13(4): 279-313.
13. Stürmer T, Joshi M, Glynn RJ, Avorn J, Rothman KJ, Schneeweiss S. A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. Journal of Clinical Epidemiology 2006; 59(5): 437-447.
14. Preisser JS, Young ML, Zaccaro DJ, Wolfson M. An integrated population-averaged approach to the design, analysis and sample size determination of cluster-unit trials. Statistics in Medicine 2003; 22(8): 1235-1254.
15. van Marwijk HW, Ader H, deHaan M, Beekman A. Primary care management of major depression in patients aged>=55 years:. The British Journal of General Practice 2008; 58(555): 680-687.
16. Ravaud P, Flipo R, Boutron I, Roy C, Mahmoudi A, Giraudeau B, Pham T. ARTIST (osteoarthritis intervention standardized) study of standardised consultation versus usual care for patients with osteoarthritis of the knee in primary care in france: pragmatic randomised controlled trial. BMJ (Clinical Research Ed.) 2009; 338: b421.
17. Leyrat C, Caille A, Donner A, Giraudeau B. Propensity scores used for analysis of cluster randomized trials with selection bias: a simulation study. Statistics in Medicine 2013; 32(19): 3357-3372.
18. Joffe MM, Rosenbaum PR. Invited commentary: propensity scores. American Journal of Epidemiology 1999; 150(4): 327-333.
19. Cepeda MS, Boston R, Farrar JT, Strom BL. Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. American Journal of Epidemiology 2003; 158(3): 280-287.
20. D'Agostino RB. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Statistics in Medicine 1998; 17(19): 2265-2281.
21. Williamson E, Morley R, Lucas A, Carpenter J. Propensity scores: from naive enthusiasm to intuitive understanding. Statistical Methods in Medical Research 2012; 21(3): 273-293.
22. Austin PC, Mamdani MM. A comparison of propensity score methods: a case-study estimating the effectiveness of post-AMI statin use. Statistics in Medicine 2006; 25(12): 2084-2106.
23. Lee BK, Lessler J, Stuart EA. Weight trimming and propensity score weighting. PloS One 2011; 6(3): e18174.
24. Hirano K, Imbens GW. Estimation of causal effects using propensity score weighting: an application to data on right heart catheterization. Health Services and Outcomes Research Methodology 2001; 2(3): 259-278.
25. Xu S, Ross C, Raebel MA, Shetterly S, Blanchette C, Smith D. Use of stabilized inverse propensity scores as weights to directly estimate relative risk and its confidence intervals. Value in Health 2010; 13(2): 273-277.
26. Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association 1984; 79(387): 516-524.
27. Rubin DB, Thomas N. Matching using estimated propensity scores: relating theory to practice. Biometrics 1996; 52(1): 249-264.
28. Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. International Journal of Epidemiology 2006; 35(5): 1292-1300.
29. Zou G, Donner A. Extension of the modified poisson regression model to prospective studies with correlated binary data. Statistical Methods in Medical Research 2013; 22(6): 661-670.
30. Turner RM, White IR, Croudace T. Analysis of cluster randomized cross-over trial data: a comparison of methods. Statistics in Medicine 2007; 26(2): 274-289.
31. Greenland S, Robins JM, Pearl J. Confounding and collapsibility in causal inference. Statistical Science 1999; 14(1): 29-46.
32. Kraemer H. Ramifications of a population model for kappa as a coefficient of reliability. Psychometrika 1979; 44(4): 461-472.
33. Caille A, Leyrat C, Giraudeau B. Dichotomizing a continuous outcome in cluster randomized trials: impact on power. Statistics in Medicine 2012; 31(24): 2822-2832.
34. Greenland S. Interpretation and choice of effect measures in epidemiologic analyses. American Journal of Epidemiology 1987; 125(5): 761-768.
35. Cummings P. The relative merits of risk ratios and odds ratios. Archives of Pediatrics & Adolescent Medicine 2009; 163(5): 438-445.
36. Austin PC, Grootendorst P, Normand SLT, Anderson GM. Conditioning on the propensity score can result in biased estimation of common measures of treatment effect: a monte carlo study. Statistics in Medicine 2007; 26(4): 754-768.
37. Austin PC. The performance of different propensity-score methods for estimating relative risks. Journal of Clinical Epidemiology 2008; 61(6): 537-545.
38. McNutt LA, Wu C, Xue X, Hafner JP. Estimating the relative risk in cohort studies and clinical trials of common outcomes. American Journal of Epidemiology 2003; 157(10): 940-943.
39. Lee J. Odds ratio or relative risk for cross-sectional data?International Journal of Epidemiology 1994; 23(1): 201-203.
40. Austin PC, Grootendorst P, Anderson GM. A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Statistics in Medicine 2007; 26(4): 734-753.
41. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology 1996; 49(12): 1373-1379.
42. Shen J, Gao S. A solution to separation and multicollinearity in multiple logistic regression. Journal of Data Science : JDS 2008; 6(4): 515-531.
43. Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Statistics in Medicine 2006; 25(24): 4279-4292.
44. Rosenbaum PR, Rubin DB. The bias due to incomplete matching. Biometrics 1985; 41(1): 103-116.
45. Austin PC. The performance of different propensity-score methods for estimating differences in proportions (risk differences or absolute risk reductions) in observational studies. Statistics in Medicine 2010; 29(20): 2137-2148.
46. Lunceford JK, Davidian M. Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Statistics in Medicine 2004; 23(19): 2937-2960.
47. Leon AC, Hedeker D, Teres JJ. Bias reduction in effectiveness analyses of longitudinal ordinal doses with a mixed-effects propensity adjustment. Statistics in Medicine 2007; 26(1): 110-123.
48. Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: a review of recent methodological developments. American Journal of Public Health 2004; 94(3): 423-432.
49. Ukoumunne OC, Carlin JB, Gulliford MC. A simulation study of odds ratio estimation for binary outcomes from cluster randomized trials. Statistics in Medicine 2007; 26(18): 3415-3428.
50. Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Stürmer T. Variable selection for propensity score models. American Journal of Epidemiology 2006; 163(12): 1149-1156.
51. Ravaud P, Giraudeau B, Logeart I, Larguier JS, Rolland D, Treves R, Euller-Ziegler L, Bannwarth B, Dougados M. Management of osteoarthritis (OA) with an unsupervised home based exercise programme and/or patient administered assessment tools. a cluster randomised controlled trial with a 2x2 factorial design. Annals of the Rheumatic Diseases 2004; 63(6): 703-708.
52. Kuss O. The z-difference can be used to measure covariate balance in matched propensity score analyses. Journal of Clinical Epidemiology 2013; 66(11): 1302-1307.
53. Zou G, Donner A. Confidence interval estimation of the intraclass correlation coefficient for binary outcome data. Biometrics 2004; 60(3): 807-811.
54. Shah BR, Laupacis A, Hux JE, Austin PC. Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. Journal of Clinical Epidemiology 2005; 58(6): 550-559.
55. Birhanu T, Molenberghs G, Sotto C, Kenward MG. Doubly robust and multiple-imputation-based generalized estimating equations. Journal of Biopharmaceutical Statistics 2011; 21(2): 202-225.
56. An W. Bayesian propensity score estimators: incorporating uncertainties in propensity score into causal inference. Sociological Methodology 2010; 40(1): 151-189.
57. Westreich D, Lessler J, Funk MJ. Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta-classifiers as alternatives to logistic regression. Journal of Clinical Epidemiology 2010; 63(8): 826-833.
58. Patrick AR, Schneeweiss S, Brookhart M.A, Glynn RJ, Rothman KJ, Avorn J, Stürmer T. The implications of propensity score variable selection strategies in pharmacoepidemiology: an empirical illustration. Pharmacoepidemiology and Drug Safety 2011; 20(6): 551-559.
59. Senn S, Graf E, Caputo A. Stratification for the propensity score compared with linear regression techniques to assess the effect of treatment or exposure. Statistics in Medicine 2007; 26(30): 5529-5544.
60. Mancl LA, DeRouen TA. A covariance estimator for GEE with improved small-sample properties. Biometrics 2001; 57(1): 126-134.
61. Teerenstra S, Lu B, Preisser JS, van Achterberg T, Borm GF. Sample size considerations for GEE analyses of three-level cluster randomized trials. Biometrics 2010; 66(4).
62. Preisser JS, Lu B, Qaqish BF. Finite sample adjustments in estimating equations and covariance estimators for intracluster correlations. Statistics in Medicine 2008; 27(27): 5764-5785.
63. Skov T, Deddens J, Petersen MR, Endahl L. Prevalence proportion ratios: estimation and hypothesis testing. International Journal of Epidemiology 1998; 27(1): 91-95.