Modeling site effects in the design and analysis of multi-site trials

American Journal of Drug and Alcohol Abuse

Volumn 37, Issue 5, 2011, Pages 383-391

  Feaster, Daniel J ^a   Mikulich Gilbertson, Susan ^b   Brincks, Ahnalee M ^a  

^a UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF COLORADO   (United States)

Author keywords

Clinical trials; Fixed effects; Multi site; Power; Random effects

Indexed keywords

ARTICLE; DRUG ABUSE; HUMAN; MEASUREMENT ERROR; POWER ANALYSIS; RANDOMIZATION; SAMPLE SIZE; SEXUALLY TRANSMITTED DISEASE; STATISTICAL MODEL;

CLINICAL TRIALS AS TOPIC; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; MULTICENTER STUDIES AS TOPIC; RESEARCH DESIGN; RESEARCH SUBJECTS; SUBSTANCE-RELATED DISORDERS;

EID: 80052242457     PISSN: 00952990     EISSN: 10979891     Source Type: Journal    
DOI: 10.3109/00952990.2011.600386     Document Type: Article

References (46)

1. Nunes EV, Ball S, Booth R, Brigham G, Calsyn DA, Carroll K, Feaster DJ, Hien D, Hubbard RL, Ling W, Petry NM, Rotrosen J, Selzer J, Stitzer M, Tross S, Wakim P, Winhusen T, Woody G. Multisite effectiveness trials of treatments for substance abuse and co-occurring problems: Have we chosen the best designs? J Subst Abuse Treat 2010; 38(Suppl. 1): S97-S112.
2. Lewis JA. Discussion on the paper by Senn. J R Stat Soc Ser D 2000; 49:156-157.
3. Kraemer HC. Pitfalls of multisite randomized clinical trials of efficacy and effectiveness. Schizophr Bull 2000; 26(3): 533-541.
4. Locallo AR, Berlin JA, Ten Have TR, Kimmel SE. Adjustments for center in multicenter studies: An overview. Ann Intern Med 2001; 135:112-123. (Pubitemid 32661194)
5. Wampold BE, Serlin RC. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychol Methods 2000; 5(4):425-433.
6. Lee K, Thompson SG. Clustering by health professional in individually randomised trials. Br Med J 2005; 330(7483):142-144. (Pubitemid 40138505)
7. Hutchison D. Designing your sample efficiently: Clustering effects in education surveys. Educ Res 2009; 51(1):109-126.
8. McCoach DB, Adelson JL. Dealing with dependence (part I): Understanding the effects of clustered data. Gifted Child Q 2010; 54:152-155.
9. Kenny DA. The effect of nonindependence on significant testing in dyadic research. Pers Relationsh 1995; 2:67-75.
10. Petry NM, Peirce JM, Stitzer ML, Blaine J, Roll JM, Cohen A, Obert J, Killeen T, SaladinME, CowellM, Kirby KC, Sterling R, Royer-Malvestuto C, Hamilton J, Booth RE, Macdonald M, Lievert M, Rader L, Burns R, DiMaria J, Copersino M, Stabile PQ, Kolodner K, Li R. Effect of prize-based incentives on outcomes in stimulant abusers in outpatient psychosocial treatment programs: A National Drug Abuse Treatment Clinical Trials Network study. Arch Gen Psychiatry 2005; 62:1148-1156. (Pubitemid 41396940)
11. Peirce JM, Petry NM, Stitzer ML, Blaine J, Kellogg S, Satterfield F, Schwartz M, Krasnansky J, Pencer E, Silva- Vazquez L, Kirby KC, Royer-Malvestuto C, Roll JM, Cohen A, Copersino ML, Kolodner K, Rui L. Effects of lower-cost incentives on stimulant abstinence in methadone maintenance treatment: A National Drug Abuse Treatment Clinical Trials Network study. Arch Gen Psychiatry 2006; 63(2):201-208. (Pubitemid 43213882)
12. Ruvuna F. Unequal center sizes, sample size, and power in multicenter clinical trials. Drug Inf J 2004; 38(4):387-394.
13. Maddala GS. Econometrics. NY, NY: McGraw-Hill, 1977; 326-327.
14. Brown H, Prescott R. Applied Mixed Models in Medicine. New York, NY: Wiley, 1999.
15. Carroll KM, Ball SA, Nich C, Martino S, Frankforter TL, Farentinos C, Kunkel LE, Mikulich-Gilbertson SK, Morgenstern J, Obert JL, Polcin D, Snead N, Woody GE. Motivational interviewing to improve treatment engagement and outcome in individuals seeking treatment for substance abuse: A multisite effectiveness study. Drug Alcohol Depend 2006; 81:301-312. (Pubitemid 43152457)
16. Reid MA, Fallon B, Sonne S, Flammino F, Nunes EV, Jaing H, Kourniotis E, Lima J, Brady R, Burgess C, Arfken C, Pihlgren E, Giordano L, Starosta A, Robinson J, Rotrosen J. Smoking cessation treatment in community-based substance abuse rehabilitation programs. J Subst Abuse Treat 2008; 35:68-77. (Pubitemid 351734600)
17. Tross S, Campbell ANC, Cohen LR, Calsyn D, Pavlicova M, Miele GM, Hu M, Haynes L, Nugent N, Gan W, Hatch- Maillette M, Mandler R, McLaughlin P, El-Bassel N, Crits- Christoph P, Nunes EV. Effectiveness of HIV/STD sexual risk reduction groups for women in substance abuse treatment programs: Results of NIDA clinical trials network trial. J Acquir Immun Def Syn 2008; 48(5):581-589.
18. Snijders T, Bosker R. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. London: Sage Publications, 2000.
19. Kraemer HC, Robinson TN. Are certain multicenter randomized clinical trial structures misleading clinical and policy decisions? Contemp Clin Trials 2005; 26(5):518-529. (Pubitemid 41242397)
20. Ball SA, Martino S, Nich C, Frankforter TL, Van Horn D, Crits-Christoph P,Woody GE, Obert JL, Farentinos C, Carroll KM. Site matters: Multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. J Consult Clin Psychol 2007; 75(4):556-567. (Pubitemid 47454576)
21. Winhusen T, Kropp F, Babcock D, Hague D, Erickson SJ, Renz C, Rau L, Lewis D, Leimberger J, Somoza E. Motivational enhancement therapy to improve treatment utilization and outcome in pregnant substance users. J Subst Abuse Treat 2008; 35(2):161-173.
22. Kallen A. Treatment-by-center interaction: What is the issue? Drug Inf J 1997; 31:927-936. (Pubitemid 27360438)
23. Fleiss JL. Analysis of data from multiclinic trials. Control Clin Trials 1986; 7(4):267-275. (Pubitemid 17204882)
24. Lin Z. An issue of statistical analysis in controlled multicentre studies: How shall we weight the centres? Stat Med 1999; 18(4):365-373.
25. Senn S. Some controversies in planning and analysing multicentre trials. Stat Med 1998; 17(15-16):1753-1765. (Pubitemid 28409930)
26. Senn S. Consensus and controversy in pharmaceutical statistics. J R Stat Soc Ser D 2000; 49(2):135-176.
27. Carroll KM, Martino S, Ball SA, Nich C, Frankforter T, Anez LM, Paris M, Suarez-Morales L, Szpocznik J, Miller WR, Rosa C, Matthews J, Farentinos C. A multisite randomized effectiveness trial of motivational enhancement therapy for Spanish-speaking substance users. J Consult Clin Psychol 2009; 77(5):993-999.
28. Woody GE, Poole SA, Subramaniam G, Dugosh K, Bogenschutz M, Abbott P, Patkar A, Publicker M, McCain K, Potter JS, Forman R, Vetter V, McNicholas L, Blaine J, Lynch KG, Fudala P. Extended versus short-term buprenorphinenaloxone for treatment of opioid-addicted youth: A randomized trial. J Am Med Assoc 2008; 300(17):2003-2011.
29. Hien DA, Wells EA, Jiang H, Suarez-Morales L, Campbell ANC, Cohen LR, Miele GM, Killeen T, Brigham GS, Zhang Y. Multi-site randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders. J Consult Clin Psychol 2009; 77(4):607-619.
30. Carroll KM, Farentinos C, Ball SA, Crits-Christoph P, Libby B, Morgenstern J, Obert JL, Polcin D,Woody GE. MET meets the real world: Design issues and clinical strategies in the Clinical Trials Network. J Subst Abuse Treat 2002; 23:73-80. (Pubitemid 36151689)
31. Lin Z. The number of centers in a multicenter clinical study: Effects on statistical power. Drug Inf J 2000; 34(2):379-386. (Pubitemid 30350990)
32. Raudenbush SW, Liu X. Statistical power and optimal design for multisite randomized trials. Psychol Methods 2000; 5(2):199-213.
33. Moerbeek M, van Breukelen GJ, Berger MP. A comparison between traditional methods and multilevel regression for the analysis of multicenter intervention studies. J Clin Epidemiol 2003; 56(4):341-350. (Pubitemid 36593313)
34. Feaster DJ, Robbins MS, Horigian V, Szapocznik J. Statistical issues in multi-site effectiveness trials: The case of brief strategic family therapy for adolescent drug abuse treatment. Clin Trials 2004; 1:428-439.
35. Robbin MS, Szapocznik JS, Horigian VE, Feaster DJ, Puccinelli M, Jacobs P, Burlew K, Werstlein R, Bachrach K, Brigham G. Brief Strategic Family TherapyTM for adolescent drug abusers: A multi-site effectiveness study. Contemp Clin Trials 2009; 30(3):269-278.
36. Booth RE, Campbell BK, Mikulich-Gilbertson SK, Tillotson CJ, Choi D, Robinson J, Calsyn DA, Mandler RN, Jenkins LM, Thompson LL, Dempsey CL, Liepman MR, McCarty D. Reducing HIV-related risk behaviors among injection drug users in residential detoxification. AIDS Behav 2010; 15: 30-44.
37. Singer JD. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. J Educ Behav Stat 1998; 23(4):323-355. (Pubitemid 128474255)
38. Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.
39. Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Anal 2006; 1(3):515-533.
40. Gould AL. Multi-centre trial analysis revisited. Stat Med 1998; 17(15-16):1779-1797.
41. Subbiah M, Kumar BK, Srinivasan MR. Bayesian approach to multicentre sparse data. Commun Stat Simul Comput 2008; 37(4):687-696.
42. Spybrook J, Raudenbush SW, Congdon R, Martinez A. Optimal design for longitudinal and multilevel research: Documentation for the "Optimal Design" software. W.T. Grant Foundation, 2009. Available at http://www.wtgrantfoundation.org/news/foundation-news/optimal-design. Accessed on July 24, 2011.
43. Friedman LM, Furberg CD, DeMets DL. Fundamentals of Clinical Trials. New York, NY: Springer, 1998.
44. Rosenberger WF, Lachin JM. Randomization in Clinical Trials: Theory and Practice. New York, NY: Wiley, 2002.
45. Carroll KM, Rounsaville BJ. Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatr Serv 2003; 54(3):333-339. (Pubitemid 36753005)
46. Edgington ES. Randomization Test. New York, NY: Marcel Dekker, 1995.