Design and Analysis of Group-Randomized Trials: A Review of Recent Methodological Developments

American Journal of Public Health

Volumn 94, Issue 3, 2004, Pages 423-432

  Murray, David M ^a,c   Varnell, Sherri P ^b   Blitstein, Jonathan L ^a  

^a University of Memphis   (United States)

^b NORTHROP GRUMMAN MISSION SYSTEMS   (United States)

^c 202 Psychology Bldg ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; BAYES THEOREM; BINARY DATA; CLINICAL RESEARCH; CLINICAL TRIAL; COMPUTER PROGRAM; CONDITIONAL MODEL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DATA ANALYSIS; GROUP RANDOMIZED TRIAL; HEALTH SURVEY; HUMAN; INTRACLASS CORRELATION; MARGINAL MODEL; MATCHED DESIGN; METHODOLOGY; MODEL BASED ESTIMATOR METHOD; NON LINEAR MIXED MODEL; NONLINEAR SYSTEM; PARAMETER; POWER ANALYSIS; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL; REVIEW; SANDWICH ESTIMATOR METHOD; STATISTICAL ANALYSIS; STATISTICAL MODEL; SURVIVAL; TIME SERIES ANALYSIS; TREATMENT OUTCOME;

EID: 1442305727     PISSN: 00900036     EISSN: None     Source Type: Journal    
DOI: 10.2105/AJPH.94.3.423     Document Type: Review

References (138)

1. Murray DM. Design and Analysis of Group-Randomized Trials. New York, NY: Oxford University Press Inc; 1998.
2. Kish L. Survey Sampling. New York, NY: John Wiley & Sons Inc; 1965.
3. Zucker DM. An analysis of variance pitfall: the fixed effects analysis in a nested design. Educ Psychol Meas. 1990;50:731-738.
4. Cornfield J. Randomization by group: a formal analysis. Am J Epidemiol. 1978;108:100-102.
5. Campbell MK, Grimshaw JM. Cluster randomised trials: time for improvement. BMJ. 1998;317:1171-1172.
6. Atienza AA, King AC. Community-based health intervention trials: an overview of methodological issues. Epidemiol Rev. 2002;24:72-79.
7. Kerry SM, Bland JM. Analysis of a trial randomised in clusters. BMJ. 1998;316:54.
8. Kirkwood BR, Cousens SN, Victora CG, de Zoysa I. Issues in the design and interpretation of studies to evaluate the impact of community-based interventions. Trop Med Int Health. 1997;2:1022-1029.
9. Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M. Analysis of cluster randomized trials in primary care: a practical approach. Farm Pract. 2000;17:192-196.
10. Donner A. Some aspects of the design and analysis of cluster randomization trials. Appl Stat. 1998;47:95-113.
11. Carvajal SC, Baumler E, Harrist RB, Parcel GS. Multilevel models and unbiased tests for group based interventions: examples from the Safer Choices Study. Multivariate Behav Res. 2001;36:185-205.
12. Kenny DA, Mannetti L, Pierro A, Livi S, Kashy DA. The statistical analysis of data from small groups. J Pers Soc Psychol. 2002;83:126-137.
13. Kerry SM, Bland JM. Trials which randomize practices 1: how should they be analysed? Fam Pract. 1998;15:80-83.
14. Bloom HS, Bos JM, Lee S-W. Using cluster random assignment to measure program impacts: statistical implications for the evaluation of education programs. Eval Rev. 1999;23:445-469.
15. Altman DG. Statistics in medical journals: some recent trends. Stat Med. 2000;19:3275-3289.
16. Klar N, Donner A. Current and future challenges in the design and analysis of duster randomization trials. Stat Med. 2001;20:3729-3740.
17. Feng Z, Diehr P, Peterson A, McLerran D. Selected statistical issues in group randomized trials. Annu Rev Public Health. 2001;22:167-187.
18. Feng Z, Thompson B. Some design issues in a community intervention trial. Control Clin Trials. 2002;23:431-449.
19. Bland JM. Sample size in guidelines trials. Fam Pract. 2000;17(suppl):S17-S20.
20. Kerry SM, Bland JM. Trials which randomize practices II: sample size. Fam Pract. 1998;15:84-87.
21. Hayes RJ, Bennett S. Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999;28:319-326.
22. Resnicow K, Braithwaite R, Dilorio C, Vaughan R, Cohen MI, Uhl GA. Preventing substance use in high risk youth: evaluation challenges and solutions. J Primary Prev. 2001;21:399-415.
23. Zucker DM. Design and analysis of cluster randomization trials. In: Geller N, ed. Advances in Clinical Trials Biostatistics. New York, NY: Marcel Dekker Inc; 2003.
24. Murray DM. Statistical models appropriate for designs often used in group-randomized trials. Stat Med. 2001;20:1373-1385.
25. Reed JF. Eliminating bias in randomized cluster trials with correlated binomial outcomes. Comput Methods Programs Biomed. 2000;61:119-123.
26. Brown CH, Liao J. Principles for designing randomized preventive trials in mental health: an emerging developmental epidemiology paradigm. Am J Community Psychol. 1999;27:673-710.
27. Hayes RJ, Alexander NDE, Bennett S, Cousens SN. Design and analysis issues in cluster-randomized trials of interventions against infectious diseases. Stat Methods Med Res. 2000;9:95-116.
28. Loeys T, Vansteelandt S, Goetghebeur E. Accounting for correlation and compliance in cluster randomized trials. Stat Med. 2001;20:3753-3767.
29. Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London, England: Arnold; 2000.
30. McCulloch CE, Searle SR. Generalized, Linear and Mixed Models. New York, NY: John Wiley & Sons Inc; 2001.
31. Brown H, Prescott R. Applied Mixed Models in Medicine. Chichester, England: John Wiley & Sons Inc; 1999.
32. Raudenbush SW, Bryk AS. Hierarchical Linear Models. 2nd ed. Thousand Oaks, Calif: Sage Publications; 2002.
33. Kreft I, De Leeuw J. Introducing Multilevel Modeling. London, England: Sage Publications; 1998.
34. Murray DM, Blitstein JL. Methods to reduce the impact of intraclass correlation in group-randomized trials. Eval Rev. 2003;27:79-103.
35. Feng Z, Diehr P, Yasui Y, Evans B, Beresford S, Koepsell TD. Explaining community-level variance in group randomized trials. Stat Med. 1999;18:539-556.
36. Murray DM, Short BJ. Intraclass correlation among measures related to alcohol use by school aged adolescents: estimates, correlates, and applications in intervention studies. J Drug Educ. 1996;26:207-230.
37. Murray DM, Short BJ. Intraclass correlation among measures related to alcohol use by young adults: estimates, correlates and applications in intervention studies. J Stud Alcohol. 1995;56:681-694.
38. Murray DM, Short BJ. Intraclass correlation among measures related to tobacco use by adolescents: estimates, correlates, and applications in intervention studies. Addict Behav. 1997;22:1-12.
39. Murray DM, Clark MH, Wagenaar AC. Intraclass correlations from a community-based alcohol prevention study: the effect of repeat observations on the same communities. J Stud Alcohol. 2000;61:881-890.
40. Elbourne DR, Campbell MK. Extending the CONSORT statement to cluster randomized trials: for discussion. Stat Med. 2001;20:489-496.
41. Slymen DJ, Hovell MF. Cluster versus individual randomization in adolescent tobacco and alcohol studies: illustrations for design decisions. Int J Epidemiol. 1997;26:765-771.
42. Murray DM, Feldman HA, McGovern PG. Components of variance in a group-randomized trial analyzed via a random-coefficients model: the REACT Trial. Stat Methods Med Res. 2000;9:117-133.
43. Kerry SM, Bland JM. Unequal cluster sizes for trials in English and Welsh general practice: implications for sample size calculations. Stat Med. 2001;20:377-390.
44. Lake S, Kaumann E, Klar N, Betensky R. Sample size re-estimation in cluster randomization trials. Stat Med. 2002;21:1337-1350.
45. Liu A, Shih WJ, Gehan E. Sample size and power determination for clustered repeated measurements. Stat Med. 2002;21:1787-1801.
46. Raudenbush SW. Statistical analysis and optimal design in cluster randomized trials. Psychol Methods. 1997;2:173-185.
47. Varnell S, Murray DM, Janega JB, and Blitstein BL. Design and analysis of group-randomized trials: a review of recent practices. Am J Public Health. 2004;94:393-399.
48. Klar N, Donner A. The merits of matching in community intervention trials: a cautionary tale. Stat Med. 1997;16:1753-1764.
49. Thompson SG. The merits of matching in community intervention trials: a cautionary tale [letter]. Stat Med. 1998;17:2147-2152.
50. Raab GM, Butcher I. Balance in cluster randomized trials. Stat Med. 2001;20:351-365.
51. Varnell SP, Murray DM, Baker WL. An evaluation of analysis options for the one group per condition design: can any of the alternatives overcome the problems inherent in this design? Eval Rev. 2001;25:440-453.
52. Whiting-O'Keefe QE, Henke C, Simborg DW. Choosing the correct unit of analysis in medical care experiments. Med Care. 1984;22:1101-1114.
53. Roberts C. The implications of variation in outcome between health professionals for the design and analysis of randomized controlled trials. Stat Med. 1999;18:2605-2615.
54. Schnurr PP, Friedman MJ, Lavori PW, Hsieh FY. Design of Department of Veterans Affairs Cooperative Study No. 420: group treatment of posttraumatic stress disorder. Control Clin Trials. 2001;22:74-88.
55. Hoover DR. Clinical trials of behavioral interventions with heterogeneous teaching subgroup effects. Stat Med. 2002;21:1351-1364.
56. Varnell S, Murray DM, Hannan PJ, Baker WL. Intraclass correlation at the level of the unit of intervention in a randomized clinical trial: implications for analysis. Paper presented at: Annual Meeting of the American Evaluation Association, November 7-10, 2001, St. Louis, Mo.
57. Harville DA. Maximum likelihood approaches to variance component estimation and to related problems. J Am Stat Assoc. 1977;72:320-338.
58. Liang KY, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73:13-22.
59. Zeger SL, Liang K-Y. Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986;42:121-130.
60. Thornquist MD, Anderson GL. Small sample properties of generalized estimating equations in group-randomized designs with Gaussian response. Paper presented at: 120th Annual Meeting of the American Public Health Association, October 8-12, 1992, Washington, DC.
61. Feng Z, McLerran D, Grizzle J. A comparison of statistical methods for clustered data analysis with Gaussian error. Stat Med. 1996;15:1793-1806.
62. Murray DM, Hannan PJ, Baker WL. A Monte Carlo study of alternative responses to intraclass correlation in community trials: is it ever possible to avoid Cornfield's penalties? Eval Rev. 1996;20:313-337.
63. Emrich LJ, Piedmonte MR. On some small sample properties of generalized estimating equation estimates for multivariate dichotomous outcomes. J Stat Computation Simulation. 1992;41:19-29.
64. Lipsitz SR, Fitzmaurice GM, Orav EJ, Laird NM. Performance of generalized estimating equations in practical situations. Biometrics. 1994;50:270-278.
65. MacKinnon JG, White H. Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties. J Econometrics. 1985;29:305-325.
66. Murray DM, Hannan PJ, Wolfinger RD, Baker WL, Dwyer JH. Analysis of data from group-randomized trials with repeat observations on the same groups. Stat Med. 1998;17:1581-1600.
67. Mancl LA, DeRouen TA. A covariance estimator for GEE with improved small-sample properties. Biometrics. 2001;57:126-134.
68. Bellamy SL, Gibberd R, Hancock L, et al. Analysis of dichotomous outcome data for community intervention studies. Stat Methods Med Res. 2000;9:135-159.
69. Long JS, Ervin LH. Using heteroscedasticity consistent standard errors in the linear regression model. Am Statistician. 2000;54:217-224.
70. Corcoran C, Ryan L, Senchaudhuri P, Mehta C, Patel N, Molenberghs G. An exact trend test for correlated binary data. Biometrics. 2001;57:941-948.
71. Fay M, Graubard P. Small-sample adjustments for Wald-type tests using sandwich estimators. Biometrics. 2001;57:1198-1206.
72. Kauermann G, Carroll RJ. A note on the efficiency of sandwich covariance matrix estimation. J Am Stat Assoc. 2001;96:1387-1396.
73. Pan W, Wall MM. Small-sample adjustments in using the sandwich variance estimator in generalized estimating equations. Stat Med. 2002;21:1429-1441.
74. Bell RM, McCaffrey DF. Bias reduction in standard errors for linear regression with multi-stage samples. Survey Methodology. 2002;28:169-181.
75. Preisser JS, Young ML, Zaccaro DJ, Wolfson M. An integrated population-averaged approach to the design, analysis and sample size determination of cluster-unit trials. Stat Med. 2003;22:1235-1254.
76. Rodriguez G, Goldman N. An assessment of estimation procedures for multilevel models with binary responses. J R Stat Soc. 1995;158:73-89.
77. Breslow NE, Clayton DG. Approximate inference in generalized linear mixed models. J Am Stat Assoc. 1993;88:9-25.
78. Ten Have TR, Kunselman A, Zharichenko E. Accommodating negative intracluster correlation with a mixed effects logistic model for bivariate binary data. J Biopharm Stat. 1998;8:131-149.
79. Hannan PJ, Murray DM. Gauss or Bernoulli? A Monte Carlo comparison of the performance of the linear mixed model and the logistic mixed model analyses in simulated community trials with a dichotomous outcome variable at the individual level. Eval Rev. 1996;20:338-352.
80. Gibbons RD, Hedeker D. Random effects probit and logistic regression models for three-level data. Biometrics. 1997;53:1527-1537.
81. Aitkin M. A general maximum likelihood analysis of variance components in generalized linear models. Biometrics. 1999;55:117-128.
82. Kleinman KP, Ibrahim JG. A semi-parametric Bayesian approach to generalized linear mixed models. Stat Med. 1998;17:2579-2596.
83. Ten Have TR, Localio AR. Empirical Bayes estimation of random effects parameters in mixed effects logistic regression models. Biometrics. 1999;55:1022-1029.
84. Turner RM, Omar RZ, Thompson SG. Bayesian methods of analysis for cluster randomized trials with binary outcome data. Stat Med. 2001;20:453-472.
85. Hedeker D, Siddiqui O, Hu FB. Random-effects regression analysis of correlated grouped-time survival data. Stat Methods Med Res. 2000;9:161-179.
86. Ross EA, Moore D. Modeling clustered, discrete, or grouped time survival data with covariates. Biometrics. 1999;55:813-819.
87. Segal MR, Neuhaus JM, James IR. Dependence estimation for marginal models of multivariate survival data. Lifetime Data Analysis. 1997;3:251-268.
88. Cai T, Cheng SC, Wei LJ. Semiparametric mixed-effects models for clustered failure time data. J Am Stat Assoc. 2002;95:514-522.
89. Gray RJ, Li Y. Optimal weight functions for marginal proportional hazards analysis of clustered failure time data. Lifetime Data Analysis. 2002;8:5-19.
90. Sargent DJ. A general framework for random effects survival analysis in the Cox proportional hazards setting. Biometrics. 1998;54:1486-1497.
91. Vaida F, Xu R. Proportional hazards model with random effects. Stat Med. 2000;19:3309-3324.
92. Yau KK. Multilevel models for survival analysis with random effects. Biometrics. 2001;57:96-102.
93. Lui K-J, Mayer JA, Eckhardt L. Confidence intervals for the risk ratio under duster sampling based on the beta-binomial model. Stat Med. 2000:19:2933-2942.
94. Bennett S, Parpia T, Hayes R, Cousens S. Methods for the analysis of incidence rates in duster randomized trials. Int J Epidemiol. 2002;31:839-846.
95. Gail MH, Byar D, Pechacek TF, Corle D. Aspects of statistical design for the Community Intervention Trial for Smoking Cessation (COMMIT). Control Clin Trials. 1992;13:6-21.
96. COMMIT Research Group. Community Intervention Trial for Smoking Cessation (COMMIT): I. Cohort results from a four-year community intervention. Am J Public Health. 1995;85:183-192.
97. COMMIT Research Group. Community Intervention Trial for Smoking Cessation (COMMIT): II. Changes in adult cigarette smoking prevalence. Am J Public Health. 1995;85:193-200.
98. Gail MH, Mark SD, Carroll RJ, Green SB, Pee D. On design considerations and randomization-based inference for community intervention trials. Stat Med. 1996;15:1069-1092.
99. Braun T, Feng Z. Optimal permutation tests for the analysis of group randomized trials. J Am Stat Assoc. 2001;96:1424-1432.
100. LaVange LM, Koch GG, Schwartz TA. Applying sample survey methods to clinical trials data. Stat Med. 2001;20:2609-2623.
101. Korn EL, Graubard BI. Analysis of Health Surveys. New York, NY: John Wiley & Sons Inc; 1999.
102. Muthen BO. Beyond SEM: general latent variable modeling. Behaviormetrika. 2002;29:81-117.
103. Schulenberg J, Maggs JL. Moving targets: modeling developmental trajectories of adolescent alcohol misuse, individual and peer risk factors, and intervention effects. Appl Dev Sci. 2001;5:237-253.
104. Muthen BO, Curran PJ. General longitudinal modeling of individual differences in experimental designs: a latent variable framework for analysis and power estimation. Psychol Methods. 1997;2:371-402.
105. Curran PJ, Muthen BO. The application of latent curve analysis to testing developmental theories in intervention research. Am J Community Psychol. 1999;27:567-595.
106. Hser Y-I, Shen H, Chuang C-P, Messer SC, Anglin MD. Analytic approaches for assessing long-term treatment effects. Eval Rev. 2001;25:233-262.
107. Davidian M, Giltinan DM. Nonlinear Models for Repeated Measurement Data. London, England: Chapman & Hall; 1995.
108. Vonesh EF, Chinchilli VM. Linear and Nonlinear Models for the Analysis of Repeated Measurements. New York, NY: Marcel Dekker; 1997.
109. Gruenewald PJ. Analysis approaches to community evaluation. Eval Rev. 1997;21:209-230.
110. Biglan A, Ary D, Wagenaar AC. The value of interrupted time-series experiments for community intervention research. Prev Sci. 2000;1:31-49.
111. Krull J, MacKinnon DP. Multilevel mediation modeling in group-based intervention studies. Eval Rev. 1999;23:418-444.
112. MacKinnon DP, Taborga MP, Morgan-Lopez AA. Mediation designs for tobacco prevention research. Drug Alcohol Depend 2002;68:S69-S83.
113. Yi GY, Cook RJ. Marginal methods for incomplete longitudinal data arising in clusters. J Am Stat Assoc. 2002;97:1071-1080.
114. Hunsberger S, Murray DM, Davis CE, Fabsitz R. Imputation strategies for missing data in a school based multicenter study: the Pathways study. Stat Med. 2001;20:305-316.
115. Zhou Z-H, Perkins AJ, Hui SL. Comparisons of software packages for generalized linear multilevel models. Am Statistician. 1999;53:282-290.
116. Bryk AS, Raudenbush SW. Hierarchical Linear Models: Applications and Data Analysis Methods. Newbury Park, Calif: Sage Publications; 1992.
117. SAS/STAT User's Guide, Version 8. Cary, NC: SAS Institute Inc; 1999.
118. Littell BC, Milliken GA, Stroup WW, Wolfinger RD. SAS System for MIXED Models. Cary, NC: SAS Institute Inc; 1996.
119. Singer J. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. J Educ Behav Stat. 1998;24:322-354.
120. Wolfinger RD. Fitting nonlinear mixed models with the new NLMIXED procedure. Paper presented at: 24th Annual SAS Users Group International Conference, April 1999, Miami, Fla.
121. SAS/STAT Software: Changes and Enhancements, Release 8.1. Cary, NC: SAS Institute Inc; 2000.
122. Hedeker D, Gibbons RD. MIXOR: a computer program for mixed-effects ordinal regression analysis. Comput Methods Programs Biomed. 1996;49:157-176.
123. Hedeker D, Gibbons RD. MIXREG: a computer program for mixed-effects regression analysis with autocorrelated errors. Comput Methods Programs Biomed 1996;49:229-252.
124. Hedeker D. MIXNO: a computer program for mixed-effects nominal logistic regression. J Stat Software. 1999;4(5):1-92.
125. Hedeker D, Gibbons RD. A random-effects ordinal regression model for multilevel analysis. Biometrics. 1994;50:933-944.
126. Hedeker D. A mixed-effects multinomial logistic regression model. Stat Med. 2003;22:1433-1446.
127. Goldstein H, Browne W, Rasbash J. Multilevel modelling of medical data. Stat Med. 2002;21:3291-3315.
128. MIXED. In: SPSS 11.0 Syntax Reference Guide. Chicago, III: SPSS Inc; 2002:136-151.
129. Baskerville NB, Hogg W, Lemelin J. The effect of cluster randomization on sample size in prevention research. J Fam Pract. 2001;50;242-246.
130. Campbell MK, Mollison J, Grimshaw JM. Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001;20:391-399.
131. Piaggio G, Carroli G, Villar J, et al. Methodological considerations on the design and analysis of an equivalence stratified cluster randomization trial. Stat Med. 2001;20:401-416.
132. Smeeth L, Ng ES-W. Intraclass correlation coefficients for cluster randomized trials in primary care: data from the MRC trial of the assessment and management of older people in the community. Control Clin Trials. 2002;23:409-421.
133. Gulliford MC, Ukoumunne OC, Chinn S. Components of variance and intraclass correlations for the design of community-based surveys and intervention studies. Am J Epidemiol. 1999;149:876-883.
134. Scheier LM, Griffin KW, Doyle MM, Botvin GJ. Estimates of intragroup dependence for drug use and skill measures in school-based drug abuse prevention trials: an empirical study of three independent samples. Health Educ Behav. 2002;29:83-101.
135. Murray DM, Phillips GA, Birnbaum AS, Lytle LA. Intraclass correlation for measures from a school-based nutrition intervention study: estimates, correlates and applications. Health Educ Behav. 2001;28:666-679.
136. Murray DM, Alfano CM, Zbikowski SM, Padgett LS, Robinson LA, Klesges R. Intraclass correlation among measures related to cigarette use by adolescents: estimates from an urban and largely African American cohort. Addict Behav. 2002;27:509-527.
137. Lazovich D, Murray DM, Brosseau LM, Parker DL, Milton FT, Dugan SK. Sample size considerations for studies of intervention efficacy in the occupational setting. Ann Occup Hyg. 2002;46:219-227.
138. Martinson BC, Murray DM, Jeffery RW, Hennrikus DJ. Intraclass correlation for measures from a worksite health promotion study: estimates, correlates and applications. Am J Health Promotion. 1999;13:347-357.